字号·· | 护眼
卫报

不合理也不公平:严厉调查批评工党的养老护理算法工具Unreasonable and unfair: damning investigation criticises Labor’s algorithm-based tool for aged care

点「原文对照」整页切到原文,或双击某段只看那段的原文。

这项监察专员调查是在《卫报》澳大利亚版报道之后展开的。该报道称,在政府强制推行的综合评估工具中,一项“不人道”的算法评估了老年人的居家支持需求,导致他们陷入痛苦且得不到充分照护。摄影:卡莉·厄尔The ombudsman investigation followed reporting by Guardian Australia that older people were being left distressed and without adequate care after their home support needs were assessed by an ‘inhumane’ algorithm as part of the government’s mandatory Integrated Assessment Tool. Photograph: Carly Earl

联邦政府用于评估澳大利亚老年人有权获得的护理等级的一种算法不合理、不公平,且缺乏人工监督,联邦申诉专员的一份严厉调查报告指出。

An algorithm used by the federal government to assess the level of care older Australians are entitled to is unreasonable, unfair and lacks human oversight, according to a damning investigation by the commonwealth ombudsman.

调查还发现,“机器人债务”皇家委员会提出的透明度建议被忽视了。

The investigation also found transparency recommendations from the robodebt royal commission have been ignored.

联邦申诉专员伊恩·安德森周一对《卫报澳大利亚版》表示,必须修改立法,允许老年护理评估员自行更改临床上不正确的算法决定,该工具还存在重大法律问题。

The legislation must be changed to allow aged care assessors to change clinically incorrect algorithmic decisions themselves, and there are also significant legal issues with the tool, the commonwealth ombudsman, Iain Anderson, told Guardian Australia on Monday.

此次调查源于《卫报澳大利亚版》的报道:作为政府强制性的综合评估工具(IAT)的一部分,老年人的居家支持需求由一种“非人道”的算法进行评估,导致他们陷入困境,无法获得足够的护理。

The investigation followed reporting by Guardian Australia that older people were being left distressed and without adequate care after their home support needs were assessed by an "inhumane" algorithm as part of the government's mandatory Integrated Assessment Tool (IAT).

即使决定错误,老年护理评估员也被禁止推翻IAT的资助方案建议。

Aged care assessors are barred from overriding the IAT's funding package recommendation, even when the decision is wrong.

这份长达104页的申诉专员报告指出:“根据法律,这些自动化决定无法被推翻和更改,即使它们在临床上是不恰当的。”

"Under the law, these automated decisions cannot be overridden and changed, even if they are clinically inappropriate," the 104-page ombudsman report found.

“没有公开可用的信息能有意义地解释算法如何将输入转化为结果。没有这一点,IAT就是一个技术黑箱。”

"There is no public information available that meaningfully explains how the algorithm converts inputs into outcomes. Without this, the IAT is a technological black box."

报告认定,这意味着IAT及其算法“不仅有可能破坏公众对公平一致评估制度管理的信心,而且依我们看来,一个理性的人将缺乏信心,认为该制度实际上是公平一致的。”

It meant the IAT and its algorithm "do not merely have the potential to undermine public confidence in the administration of a fair and consistent assessment system," the report found. "Rather, a reasonable person would, in our view, lack confidence that the system is in fact fair and consistent." Guardian Australia reported that those involved in developing the IAT had no idea that an algorithm would be added to it by the government by the time changes were rolled out in November.

《卫报澳大利亚版》报道称,参与开发IAT的人员根本不知道,到11月推出变更时,政府会给它增加一个算法。

Documents released under freedom of information reveal departmental panic severe clinical distress among frontline assessors secret IT workarounds after officials realised in the hours before the rollout of the algorithm that legislation legally barred human override, and that this was causing distress within days of implementation.

根据信息自由法案发布的文件显示,在算法推出前几小时,官员们意识到法律禁止人工覆盖,且这一规定在实施后几天内就造成了困扰,由此引发了部门恐慌、一线评估员严重临床痛苦以及秘密的IT变通方案。

"It's very concerning that the department was telling people this system was going to operate in a particular way, showing them versions of that system, only to change it," Anderson told Guardian Australia.

安德森对《卫报澳大利亚版》表示:“非常令人担忧的是,该部门曾告诉人们该系统将以特定方式运行,并向他们展示了该系统的版本,结果却对其进行了更改。”

The report found: "Information provided by the department to the public suggests that key trials and consultation over several years directly supported the IAT and its associated decision-making framework in its current form, but that is not correct".

报告指出:“该部门向公众提供的信息表明,历经数年的关键试验和咨询直接支持了IAT及其相关决策框架的当前形式,但这并不正确。”

"Those trials and consultation related to earlier versions of the IAT and earlier legislation. There was no meaningful consultation." Since the rollout there had been a failure of oversight, the investigation found. The qualifications and skill of assessors are critical to the IAT, but the Ombudsman found the department failed to enforce contractual quality controls or verify whether assessors held mandatory clinical qualifications.

“这些试验和咨询涉及的是IAT的早期版本和早期立法。不存在有意义的咨询。”调查发现,自推出以来,监管机制失效。评估员的资质和技能对IAT至关重要,但监察专员发现,该部门未能强制执行合同规定的质量控制,也未核实评估员是否持有强制性的临床资质。

Senior staff raised concerns about a lack of review pathways for wrong decisions before the rollout of the algorithm, the Ombudsman found. One email read; "I am concerned that our current framework does not satisfy the first of these requirements (that there be a clear path for those affected to seek review), because it appears [that] the review pathways only allow for the algorithm outcomes to be confirmed".

监察专员发现,在算法推出前,高级员工曾对缺乏针对错误决定的复核途径提出担忧。一封邮件写道:“我担心我们目前的框架不满足第一项要求(即受影响者有明确途径寻求复核),因为复核途径似乎只允许确认算法结果。”

Anderson said a range of concerns had been raised by the media and public about the operation of the IAT for support at home packages, triggering the investigation in April, and in particular there was a lack of transparency around how the IAT algorithm worked in making its decisions.

联邦监察专员伊恩·安德森。摄影:AAPThe commonwealth ombudsman, Iain Anderson. Photograph: AAP

安德森表示,媒体和公众对IAT在居家支持包运作方面提出了一系列担忧,从而在4月触发了调查,特别是缺乏关于IAT算法如何做出决策的透明度。

"The department has not complied with recommendations … of the royal commission into the robodebt scheme regarding transparency of government automated decision-making," the report found.

报告发现,“该部门未遵守……关于政府自动化决策透明度的‘机器人债务’皇家委员会的建议。”

The report calls for a comprehensive review of the legislation related to the needs assessment process, and of the rules underpinning the algorithm.

报告呼吁对与需求评估流程相关的立法,以及支撑该算法的规则进行全面审查。

"The robodebt royal commission said that when government uses automated decision making or artificial intelligence, it needs to be very transparent so people can understand how are decisions being made that are impacting them significantly," he said.

他说:“‘机器人债务’皇家委员会表示,当政府使用自动化决策或人工智能时,需要非常透明,以便人们能够了解影响他们重大的决策是如何做出的。”

"The department needs to much more effectively, in our view, give oversight to the assessment providers because the inputs that are provided by assessment providers to the algorithm are really critical in determining what then comes out of the other end through the algorithm." While the department of health and ageing in July announced a new review process, where aged care assessors can escalate wrong decisions to the department for review, Anderson said he is concerned this is not adequate.

“依我们看来,该部门需要更有效地对评估提供者进行监督,因为评估提供者输入算法的数据对于决定算法最终输出的结果至关重要。”虽然卫生与养老部在7月宣布了一项新的审查流程,养老评估员可将错误决定上报至部门复核,但安德森表示,他担心这还不够。

"I think that assessors being able to change decisions because they appear to be clinically inappropriate is really important, and so I am concerned that the escalation pathway will not necessarily do that," he said.

他说:“我认为评估员能够因决定在临床上显得不当而更改决定,这非常重要,因此我担心上报途径未必能做到这一点。”安德森表示,调查发现了许多法律问题,正等待政府处理。

Anderson said numerous legal concerns had been identified by the investigation that it is waiting for the government to address.

他说:“当你不知道算法是如何做出决定时,你如何能真正对决定提出质疑?”

"How can you actually challenge decisions when you don't know how they're made by the algorithm?" he said.

“存在重大法律问题,我们认为这些问题需要作为紧急事项加以解决。依我们看来,该部门未曾,且可能仍不了解其所创建的法律框架的关键组成部分,也不了解它本应创建什么样的法律框架。”卫生与养老部已被联系请其置评。

"There are significant legal issues, and we think that those need to be addressed as a matter of urgency. In our view, the department did not, and may still not, understand key components of the legal framework it created, nor did it understand what legal framework it was meant to create." The department of health and ageing has been contacted for comment.

阅读媒体原文 ↗