字号 ·· | 护眼
卫报

学者与AI评分:是给过劳教职工的得力助手,还是草率的捷径?Academics and AI marking: a welcome aid for overworked staff or a sloppy shortcut?

点「原文对照」整页切到原文,或双击某段只看那段的原文。

多所澳大利亚大学允许教职员工在评分和向学生提供反馈时使用人工智能。

Several Australian universities allow staff to use AI in marking assessments and providing students with feedback.

秀,佩戴智能手表,自称“科技爱好者”。

Photograph: Olena Malik/Getty Images Armin Alimardani has blue hair, is fresh faced, wears a smart watch and describes himself as “a tech enthusiast”.

他或许是一位不同寻常的哨兵,正警告人们:学者们借助生成式人工智能辅助评分学生作业的趋势,可能对高等教育构成生存威胁。

Photograph: Olena Malik/Getty Images Armin Alimardani has blue hair, is fresh faced, wears a smart watch and describes himself as “a tech enthusiast”.

这位西悉尼大学法学与技术高级讲师多年来一直在研究和实验人工智能——他目前正在意大利巴勒莫参加一系列关于该技术的大学研讨会。他表示,近期有同事询问他是否能利用AI减轻评分负担。Alimardani认为这种讨论“极其令人担忧”。

He is an unlikely sentinel, perhaps, to warn that a drift towards academics using generative artificial intelligence to help mark students assignments could pose an existential threat to higher education. The Western Sydney University senior lecturer in law and technology has been studying and experimenting with AI for years – he is speaking from Palermo in Italy, where he is attending a series of university workshops on the technology. He says, colleagues have been asking him lately if it could help lighten the burden of grading. Alimardani finds this talk “extremely concerning”.

他说:“我们必须非常小心我们正在踏入的领域。因为我认为,高等教育目前面临着崩塌的风险。”

The Western Sydney University senior lecturer in law and technology has been studying and experimenting with AI for years – he is speaking from Palermo in Italy, where he is attending a series of university workshops on the technology. He says, colleagues have been asking him lately if it could help lighten the burden of grading. Alimardani finds this talk “extremely concerning”.

利用AI评分作业不再是理论假设,而是大学突然面临的一个十字路口。

“We’ve got to be really careful where we are stepping here,” he says. “Because I think there’s always a risk, at the moment, for higher education to collapse”.

Alimardani所在的大学是澳大利亚允许教职员工在评估评分和提供学生反馈时使用AI的几所高校之一。

AI being used to mark assignments is no theoretical prospect – but a fork in the road at which universities have suddenly found themselves confronted.

订阅《澳大利亚突发新闻》 虽然目前应用范围有限,但批评人士指出,这种AI用法存在风险:大学可能用数据中心的算法取代校园里人类学者的工作,并可能形成所谓的“垃圾循环”——学生提交AI生成的作业,学者再用AI进行评分。

Alimardani’s is among several universities in Australia that allow staff to use AI in marking assessments and giving students feedback. Sign up for the Breaking News Australia Though limited, fellow critics say such use of AI risks universities replacing the work of human academics on campuses with algorithms in datacentres – and that it could create a so-called “slop-cycle”, in which students submit AI generated assignments that academics mark with AI.

“学生们已经在经济上举步维艰了,”阿利马达尼说。“如果他们得不到适当的反馈,如果他们觉得学位对雇主来说没有多大意义,如果他们认为大学学位并不能在多大程度上帮助他们保证就业——他们到底为什么还要上大学呢?”新南威尔士州的纽卡斯尔大学、维多利亚州的迪肯大学和皇家墨尔本理工大学,以及南澳大利亚州的阿德莱德大学,都给出了与西悉尼大学类似的许可。在所有这些情况下,都是对AI有条件的“绿灯”。例如,纽卡斯尔大学赋予学生选择退出的权利,迪肯大学则表示教职员工可以使用AI来“提高效率,支持评估和行政活动”,但不能“分配成绩”。

“Students are already financially struggling,” Alimardani says. “If they are not receiving proper feedback, if they feel like their degree is not as meaningful for employers and if they think that having a university degree doesn’t help them that much with guaranteeing a job – why would they come to university, really?” The University of Newcastle, also in New South Wales, Deakin University and RMIT in Victoria and South Australia’s University of Adelaide all give similar allowances to WSU. In all those cases, it is a qualified green light for AI. Newcastle, for example, gives students the right to opt out and Deakin says staff can use AI to “improve efficiency and support assessment and administrative activities” but not “assign grades”.

一位发言人表示,西悉尼大学在评估中使用生成式AI方面采取了“以人为本的方法”,其中“授予分数、等级和反馈必须始终是学术人员的责任”。

A spokesperson said WSU took “a human-centred approach to generative AI use in assessment” in which “the awarding of marks, grades and feedback must also always be the responsibility of academic staff”.

“学术人员可以使用AI工具来支持评估和反馈的某些方面,但学术判断的责任必须始终由大学教学人员承担,”该发言人说。

“Academic staff may use AI tools to support certain aspects of assessment and feedback, however responsibility for academic judgment must always remain with university teaching staff,” the spokesperson said.

阿利马达尼表示,AI确实有潜力通过充当“第二双眼睛”来提高评分质量——他正在致力于创建能够识别人工评估中不一致之处的模型。他指出,AI辅助的前景出现之时,正值许多大学教职员工因过度工作而濒临“崩溃点”,评分占据了学者大量时间。

Alimardani says AI does have the potential to improve the quality of marking by acting as a “second pair of eyes” – he is working to create models that can pick out inconsistencies in human assessment. And the promise of AI assistance comes at a time when many university staff are overworked to “breaking point”, he notes, with marking taking up a large portion of academics’ time.

但他表示,关于AI给评分带来潜在益处的说法在很大程度上未经验证,而其带来的风险极大,理应对这些说法进行“非常缓慢”且审慎的评估。阿利马达尼不确定如何在不招致灾难的情况下,大规模利用AI来加快评估进程。

But claims of the potential benefit AI would bring to marking, he says, are largely untested, while the risk it poses is so great as to behoove a “really slow” and considered evaluation of those claims. Alimardani is not sure how AI could be used at scale to speed up assessments at all, without inviting disaster.

阿利马达尼说,想象一下,100名学者被配发了一款AI评分工具,但被要求核实其评估结果。

But claims of the potential benefit AI would bring to marking, he says, are largely untested, while the risk it poses is so great as to behoove a “really slow” and considered evaluation of those claims. Alimardani is not sure how AI could be used at scale to speed up assessments at all, without inviting disaster.

“我们假设有 80 个人完全按建议操作,仍会有 20 个人不这么做。”

Imagine 100 academics are given an AI marking tool but told to verify its assessments, Alimardani says. “Let’s say 80 do exactly as advised, there are going to be 20 who do not”.

他称之为“验证漂移”:在几次 AI 生成的评估看起来都没问题后,负责监督的工作人员——他们自己往往也超负荷工作——不再那么警惕,导致 AI 的幻觉内容以事实的面目溜了过去。

He calls this “verification drift”: after a few AI generated assessments appear fine, the human charged with its oversight – often overworked themselves – stops being as vigilant and AI hallucinations slip through as facts.

他说,正如近年来法庭上所见的此类丑闻几乎是不可避免的,这将玷污大学声誉,并在学生中滋生不公平感,进而让他们质疑高等教育的价值。这或许能解释为何包括新南威尔士大学、墨尔本大学和悉尼大学在内的多所名校,尽管在课堂的其他环节热情拥抱生成式 AI,却在评分环节划清了界限。

Such scandals, as have been seen in courtrooms over recent years would be almost inevitable, he says, tarnishing university reputations and fostering a sense of unfairness among students that would see them question the value of higher education Which may explain several high-ranking universities – including University of NSW, the University of Melbourne and the University of Sydney – draw the line at using generative AI in marking, despite enthusiastically allowing it in other aspects of the classroom.

定论尚早 尽管许多大学已表明立场,但仍有不少大学表示正在考虑如何将 AI 用作评分工具。

Jury still out For all those that have adopted a position on the matter, a number of universities say they are considering how they might use AI as a marking tool.

莫纳什大学发言人表示:“目前,AI 未用于评分过程”,但该校“正通过系统性方法变革评估”,其中“AI 被融入教学与评估,以支持学生学习”。

A Monash spokesperson said “at this time, AI is not used in the marking process”, but that the university was “transforming assessment through a programmatic approach” in which “AI is integrated into teaching and assessment to support students’ learning”.

卧龙岗大学和詹姆斯库克大学给出了类似回复。其他一些大学则似乎完全回避了该问题。

Wollongong and James Cook universities responded similarly. Others appeared to dodge the question entirely.

昆士兰大学发言人称,其教职员工“须确认所有规定的学习成果均已达成,且授予的成绩反映学生的成就水平”。

A University of Queensland spokesperson said its academics are “required to confirm that all specified learning outcomes are achieved and that grades awarded reflect the level of student attainment”.

“昆士兰大学坚持要求教职员工评估学生作业,并正积极制定政策,以在 AI 时代维持这一期望,”该发言人在回应直接提问时表示。

“UQ maintains an expectation that academics assess their students’ work and is actively developing policies to maintain this expectation in the age of AI,” the spokesperson said in response to a direct question.

跳过时事通讯推广 昆士兰科技大学在 8 月底发给员工的邮件中也使用了类似的官样文章,告知其“评估提升项目”。

skip past newsletter promotion after newsletter promotion Similar jargon was deployed by the Queensland University of Technology in an email sent to staff in late August advising them of its “assessment uplift project”.

“该项目是一项全校范围的举措,旨在转型昆士兰科技大学(QUT)的评估生态系统,使评估在日益AI赋能的学习环境中,依然保持真实、可信、可扩展且面向未来,”邮件写道。

“The project is a whole-of-university initiative to transform QUT’s assessment ecosystem so that assessment remains authentic, trusted, scalable and future-focused in an increasingly AI-enabled learning environment,” it read.

“目前正处于启动阶段,正在进行广泛咨询,以了解评估全生命周期中的现有体验、挑战与机遇。”这种“企业腔”引得一位QUT学者调侃道,听起来像是AI在写信通知学者们,它要抢他们的饭碗了。

“It is currently progressing through initiation, with broad consultation underway to understand current experiences, challenges, and opportunities across the assessment lifecycle.” Such “corporate speak” prompted one QUT academic to quip that it sounded like AI was writing to inform academics it was taking their job.

另一位资深同事也要求匿名,他表示教职员工的反应是“普遍担忧”。

“It is currently progressing through initiation, with broad consultation underway to understand current experiences, challenges, and opportunities across the assessment lifecycle.” Such “corporate speak” prompted one QUT academic to quip that it sounded like AI was writing to inform academics it was taking their job.

虽然“令人担忧地模糊”,但该学者表示,这封邮件“确实似乎在暗示,如果可行,我们将减少人工评分”。

While a senior colleague, who also spoke on the condition of anonymity, said the reaction among staff was one of “widespread concern”.

他们表示,在本已不稳定的工作中,兼职教学人员往往依靠评分作为主要收入来源。“大家担心自己的工作会变得多余,”他们说。学生不能用AI写作,凭什么老师能用AI评分?

Though “worryingly vague”, the academic said the email “certainly seems to be flagging that we will use less human marking if we can”. They said sessional academics often rely on marking as a primary source of income in an already precarious line of work. “People are concerned their job might be made redundant,” they said.

除了部分员工对环境和伦理方面存有顾虑外,许多人远未被说服AI能可靠、准确地评估作业,他们说,毕竟他们看到一些学生试图将质量低劣的AI生成作业冒充为自己的作品。

Why mark with AI if students can’t write with it? As well as some staff having concerns about the environmental and ethical considerations, many are a long way from being convinced that AI could reliably and accurately assess work, they said, given the poor quality of AI generated assignments they were seeing some students try to pass off as their own.

“我们一直在告诉学生,他们在评估中使用AI存在诚信问题,”该学者说。

As well as some staff having concerns about the environmental and ethical considerations, many are a long way from being convinced that AI could reliably and accurately assess work, they said, given the poor quality of AI generated assignments they were seeing some students try to pass off as their own.

“如果我们转头又说:但我们要用它来给你们评分,这传递了什么信号?”对QUT创意与专业写作专业的学生Alex Cameron来说,这个信号再明确不过。

“We are telling students all the time that there are integrity issues with their use of AI in assessment,” the academic said. “What message does it send if we then say: but we are going to use it to mark you?” For QUT creative and professional writing student, Alex Cameron, the message would be clear.

“到了那个地步,我们不如全用AI得了,”他说。“直接靠AI拿学位,让AI写作业。”

“At that point, we might as well just have AI everything,” he says. “Just get our degrees through AI and have AI write our assignments”.

QUT《Glass Magazine》编辑卡梅隆表示,他的三年高等教育经历“非常棒”,因为他身边围绕着志同道合、有趣的人——“这才是大学的意义所在”。

An editor at the QUT’s Glass Magazine, Cameron says his three years of higher education have been an “awesome” time in which he has been surrounded by like-minded and interesting people – “the whole point of universities”.

但卡梅隆说,如果学位是由AI评分的,他“绝不会花1000美元去读”——而且他认为他的同届同学中也没多少人会对这种前景感到高兴。“我会暴跳如雷,”他说。“我会气得要命。

But Cameron says he “wouldn’t pay $1000” for a degree in which he was marked with AI – and doesn’t think many of his cohort would be happy with the prospect. “I would be irate,” he says. “I would be absolutely bloody incensed.

“我们喜欢人类写作,喜欢让人类来审阅——也喜欢从人类那里获得反馈。”

“We like to do human writing, we like to have humans look at it – and we like to get feedback from humans”.