字号·· | 护眼
政治报

“我不想吓到大家”‘I don't want to freak people out’

点「原文对照」整页切到原文,或双击某段只看那段的原文。

堪培拉 — 珀斯选区柯廷的独立议员凯特·钱尼已成为议会中人工智能发展议题的领军声音,并且是联合特设委员会的跨党派代表,该委员会正在调查这项新兴技术。

CANBERRA — Independent MP for the Perth electorate of Curtin, Kate Chaney, has emerged as a leading voice in parliament on the development of AI, and is a crossbench representative on a joint-select committee probing the emerging technology.

芬恩·麦克休在她的议会办公室与钱尼坐下来,就如何持续审查人工智能、人工智能在生物武器方面的风险,以及为什么我们将在未来十年都在讨论这项技术进行了广泛的访谈。此 transcripts 已为清晰度进行了编辑。

Finn McHugh sat down with Chaney in her parliament office for a wide-ranging interview on how to provide ongoing AI scrutiny, AI risks around bioweapons, and why we're all going to be talking about the technology for a decade. This transcript has been edited for clarity.

看起来总理办公室在委员会致总理的信件中高度参与。大卫·波科克表示,这是政府暗中操作的证据。他说得对吗?

It seems the Prime Minister’s Office was heavily involved in a letter sent by the committee to him. David Pocock’s saying this is evidence of a government stitch up. Is he correct?

如果总理办公室对这封信的内容感到满意,我其实很高兴,因为这封信内容非常广泛。它涉及了我一直非常担忧的许多安全问题,而且除非总理办公室参与其中,否则什么都不会发生。所以我认为这是一个非常好的信号。

I’m pretty happy if the PMO is comfortable with the content of this letter because it's really broad. It addresses a lot of the safety issues that I've been really concerned about, and nothing's going to happen unless the PMO is on board. So I think it's a really good sign.

虽然过程本身并不理想,但我更关注内容和达成成果。人工智能作为新兴事物的好处在于,目前尚未形成根深蒂固的政治立场,我们实际上可以作为一个委员会共同合作,梳理问题。这确实需要与政府合作。您具体对什么感到满意?

The process itself was not ideal, but I'm more focused on the content and getting an outcome. The upside of AI being novel is there are not entrenched political positions on it, and we can actually work together as a committee and nut out the issues. That does involve collaborating with the government. What specifically were you pleased with?

我一直关注的许多我所担忧的人工智能防护措施,比如关键事件报告、早期访问、生物武器、独立评估以及对人工智能安全研究所的资助,这些都让我感到满意。这些是重要议题。它们不依赖于澳大利亚的数据中心。这些是我们需要尽快落实的防护措施。

A lot of the AI safeguards that I was concerned about around critical incident reporting, early access, bioweapons, independent evaluation and funding for the AI Safety Institute, which I've been pretty focused on. These are important issues. They are not dependent on data centers in Australia. They're safeguards we need to get in place as soon as possible.

关于人工智能安全研究所,有人批评它资金不足,尤其是与英国相比,英国常被视为黄金标准。您一直在研究其他国家的研究所 — — 我们能从他们那里学到什么?

On the AI Safety Institute, there’s a criticism that it’s underfunded compared to places like the U.K., which is often talked about as the gold standard. You’ve been looking at institutes in other countries — what can we learn from them?

我们获得的资金只有英国人工智能安全研究所的1/16。我的问题是:英国研究所所做工作的15/16我们没有做,那是什么?

We get 1/16th of the funding that the U.K. AI Safety Institute gets. My question was: what's the 15 sixteenths of what the U.K. Institute is doing that we're not doing?

对于相对较小的投资,我们实际上可以在全球范围内占据重要席位。很多事情将取决于全球标准,而不是国内法规,因此现在我们成为这一讨论中的可信声音非常重要,这样我们才能对其发展方向产生一些影响。

For a relatively small investment, we can actually have a significant seat at the table globally. A lot of this is going to come down to global standards, not domestic regulation, so it's really important now that we are a credible voice in that discussion, so that we have some influence over where it goes.

总理安东尼·阿尔巴尼斯一直在把自己塑造成那个可信声音。你认为世界在倾听我们吗?

Prime Minister Anthony Albanese has been framing himself as that credible voice. Do you think the world is listening to us?

在社交媒体上,我们表明了我们的行动很重要。但一年只有25人和800万美元的资金,当这些科技公司提供1亿美元的签约奖金时,人工智能安全研究所要发挥重要作用将很困难。这凸显了相对性。虽然它仅成立于今年,但现在的机遇是将其规模扩大。

On social media, we showed that it matters what we do. But with 25 people and $8 million funding a year, it will be difficult for the AI Safety Institute to play a big role when these tech companies are delivering $100 million sign-on bonuses. That's a sense of the relativity. It's only been around this year, but the opportunity now is to ramp it up.

我们的人工智能安全研究所具有最广泛的范围——相比国际 counterparts,其范围非常广泛,因此需要匹配的资金。它需要承担起国际角色,参与测试工作。我们需要在此具备测试能力。

Our AI Safety Institute has the broadest scope — it's a very broad scope compared to international comparators, so it needs the funding to match. It needs to be playing that international role, contributing to testing. We need to have that testing capability here.

显然,与其他机构重复工作没有意义,但我们需要在这一方面尽到自己的责任,并具备一些安全测试的主权能力,同时也要向监管机构提供建议。

Obviously, it doesn't make sense to duplicate with all the others, but we need to be pulling our weight on that and have some sovereign capability in safety testing, and then advising the regulators as well.

我们所有的监管机构都需要在这些领域提升能力,了解即将到来的风险,并能够更快速地做出响应。这是人工智能安全研究所必须承担的另一个重要角色——而仅靠25人无法完成所有这些工作。这是我们目前最紧迫的事情,因为它能让机构建设到位,从而为快速发展的领域做好准备。

All our regulators are going to need to upskill in these areas and be aware of upcoming risks and be able to respond much faster. That's another really big role that the AI Safety Institute has to deliver — and you can't do all of that with 25 people. This is the most urgent thing that we can do because it gets the institutions right so we're preparing for a rapidly evolving space.

这些事物变化如此之快,以至于立法可能难以跟上。你有没有想过,政府需要制定足够灵活的立法,以跟上发展的步伐?

This stuff moves so quickly that legislation may struggle to keep up. Have you thought about how governments need to write legislation that’s flexible enough to keep pace with developments?

这具有挑战性,因此以原则为基础是合理的。当然,这也显然带来了不确定性。我们现在可以做的一些事情只是把基础做好。但我们将继续发展。为人工智能安全研究所提供资金,确保我们在发生关键事件时能够实际收到通知。

That's challenging, so it makes sense for it to be principle-based. Now, that obviously creates uncertainty as well. There are some things we can do now that are just getting the basics right. But we're going to continue to evolve. Funding the AI Safety Institute, making sure that we actually get notified when there are critical incidents.

在安全和风险管理方面,我认为我们可以制定要求:如果你在这里部署技术,我们必须知道你已经先测试了它是否安全。在澳大利亚,如果没有先证明你已经测试过,你就不能卖自行车头盔。这比劣质自行车头盔危险得多。

In terms of safety and risk management, I think we can create requirements that if you're deploying technology here, we have to know that you've tested to see if it's safe first. You can't sell a bike helmet in Australia without showing that you've tested it first. This is much more dangerous than a dodgy bike helmet.

我们还需要弄清楚,在快速变化的领域中,我们的内部监督应该是什么。因此,我希望看到该委员会成为常设委员会,因为我认为其职责范围意味着在我们被分配的时间内,我们实际上无法覆盖所有内容。

We also need to work out what our internal oversight is in a rapidly changing space. So, I'd like to see that committee become a standing committee, because I think the scope of the terms of reference mean there's no way we can actually cover all of that in the time we’ve been allocated.

我设想,未来10年可能会就人工智能的不同方面进行滚动调查,以确保我们能够及时应对其在广泛领域所带来的深远影响。

I imagine there could be rolling inquiries on different aspects of AI for the next 10 years to ensure that we are dealing with the really deep consequences that it has across a broad range of portfolios, in a timely way.

我们的制度最初设计并不是为了快速制定立法,但随着世界变化得更快,我们将需要更新一些这些机构。我认为,设立一个常设委员会,就不同方面进行短而锐的调查,有助于实现这一目标。

Our system is not designed to develop legislation quickly for good reason, but as the world changes faster, we will need to update some of those institutions, and I think having a standing committee with short, sharp inquiries on different aspects contributes to that.

我们同样需要先把本国事务打理好,确保自身的网络安全水平达标。生物武器问题其实有简单的解决办法:能够合成核酸材料——比如合成DNA——的实验室数量有限。我们应当规定,只有那些事先完成了安全测试的实验室才允许进口合成DNA,这样才能避免本国成为新型生物武器的诞生地。

We also need to just be getting our own house in order as well in terms of ensuring our own cyber-security is up to scratch. Bioweapons is a really simple fix. There are limited labs that can create nucleic acid materials — but let's say synthetic DNA — and we should be requiring that you can only import synthetic DNA from labs that do safety testing first, so that we are not going to be the place where a new bioweapon is created.

或许您是委员会中唯一询问OpenAI有关生物武器问题的人。您从对方的答复中获得了些许安心感吗?

You might have been the only committee member to ask OpenAI about bioweapons. Were you at all reassured by what you heard?

相关技术发展速度极快,没人能确切知晓未来能实现什么。据预测,我们尚未面世的最新版模型将大幅提升生物技术能力。这对科学研究而言固然是好事,却也带来了生物武器扩散的巨大风险。我不想吓唬大家,但我们确实需要客观面对即将到来的挑战。

It's evolving really fast. No one really knows what's possible. With the latest round of models that we haven't seen yet, it's expected that there is going to be a big uplift in biological capability. That's great for scientific research — it's also really scary for bioweapons. I don't want to freak people out, but we do need to make sure that we are realistic about what's coming.

眼下我们有一些简单易行的举措可实施。澳大利亚在生物安全领域处于世界领先地位,我们可以在此基础上进一步发力。据我所知,只需部长做出决策即可推行这些措施,无需立法。就像我们此前实施的16岁以下用户使用禁令那样,我们完全可以借助现有的监管框架及我们在生物安全领域的领先优势,制定并推动全球生物武器管控及DNA检测标准的建立。

There are simple things that we can do now. Australia is a leader in biosecurity, and we can build on that capability. We can do this, as I understand it, just through the minister making a decision. It doesn't require legislation. Just as we did on the under-16s ban, we could actually be setting and contributing to a global standard on bioweapons and biological DNA testing using our existing framework and our leadership in biosecurity.

我们还听取了OpenAI关于数据泄露事件的说明。目前尚不清楚当AI代理出现违规行为时,相关企业需承担怎样的法律责任。您认为应当如何界定呢?

We also saw OpenAI testify about its data breach. It seems unclear what the legal liabilities are for those companies when their agents go rogue. What do you think they should be?

关于自主行动型AI的法律责任问题目前仍悬而未决,由于这属于全新领域,还有大量工作亟待完成。西澳大学的一些研究人员正在研究一种置于合同之下的法律层机制,该机制包含相应代码,可约束AI代理的行为,确保其不会违反合同条款。这些研究成果实在令人惊叹,不过理解起来也相当困难。

There's this huge open question about liability when it comes to agentic AI, and there's so much work to be done because it's a novel problem. There are some researchers at UWA working on sort of legal layer that sits under contracts, that contains code that can harness agents to stop them working outside the terms of those contracts. Now, this is mind-blowing stuff — it's really hard to get your head around it.

至少,在我们弄清楚谁应该对这些问题负责之前,我们应该非常谨慎地考虑如何部署这些人工智能系统。

At the very least, I think that until we've worked out who's liable for these issues, we should be very careful about how these agentic AI are being deployed.

从实际操作的角度来看,ASIC(澳大利亚证券和投资委员会)此前从未需要考虑过这样的情况:某个人工智能系统在未经明确指令的情况下,会自行创建一家新公司。因此,所有相关监管机构都必须认真思考这个问题。人工智能安全研究所(AI Safety Institute)在这方面可以提供重要的建议,但这一转变需要整个社会做出重大调整。

At a really mundane level, ASIC has never had to think about what happens if an agent goes and creates a new company, without the person that's put the instructions in specifically asking it to go and create a new company. So, this is why all of our regulators need to be thinking about this. And the AI Safety Institute is an important source of advice for that, but it will require a big shift.

以金融行业为例:该行业早在几年前就实现了数字化,从纸质票据和实体货币转向了虚拟货币。法律行业也必须做出类似的变革,以明确人工智能在法律体系中的责任边界。这些都是极其重要的问题。

One analogy is the financial sector digitized a while ago, and went from notes and coins to virtual money. The legal sector has to do the same thing in terms of legal liability. These are really big issues.

历史上,政府在处理劳动力转型方面并不总是做得很好;而这次的人工智能转型可能会引发前所未有的社会变革。我们该如何在将人工智能融入劳动力市场的过程中,避免某些行业被彻底淘汰,同时确保整个社会的平稳过渡呢?

Governments haven’t always managed labor force transitions well, and this could be the mother of all labor force transitions. How do you balance the need to integrate AI into the labor force without wiping out whole sectors without a soft landing?

在评估这些变化时,我们不能仅仅依赖历史数据。我在人工智能政策报告中提出的方法是进行情景规划:借鉴其他行业在面对不确定性时采用的方法,思考“不同情景会是什么样子?在什么情况下政府需要采取不同的应对措施?”也许某些工作的描述方式会发生变化,但不会带来重大影响;或者在未来10年内,我们30%的工作中会有40%的内容变得多余(即这些工作将被人工智能取代)。

I don't think we can just rely on historical data when it comes to assessing that. The approach that I've proposed in my AI policy paper is scenario planning, taking some of these methodologies that other sectors use in situations of uncertainty and asking: ‘What do these different scenarios look like, and what are the triggers when government needs to approach this problem differently?’It may be that there's a little bit of change in how jobs are described, but no big significant impacts.

这将对税收、福利体系、社会秩序以及人类的生活意义产生深远影响。因此,这个问题涉及多个层面(即需要从多个角度进行全面考虑)。

Or it may be that 40% of the work in 30% of our jobs becomes redundant in the next 10 years. That has big implications for tax take, welfare and societal purpose, societal order and human meaning and purpose. So it's multi-layered.

我们现在至少需要进行情景规划,并且需要非常仔细地跟踪这些发展趋势。就业部门已经在根据历史数据和趋势开展工作,但我希望看到更多具有前瞻性的情景规划方案被制定出来,以应对这种巨大的不确定性。

We do need to be at least doing scenario planning now, and then tracking those trends very carefully. There is work happening in the Department of Employment based on historical data and trends, but I'd like to see some more forward-looking scenario planning being used to look to deal with that huge uncertainty.

关于版权问题,委员会里有什么新的讨论或观点改变了你的看法吗?

On copyright, has anything in the committee changed your mind or given you a different perspective?

这确实是个非常棘手的问题。我们的现行版权制度是为复制材料而设计的;但在训练人工智能模型时,我们实际上并不是在复制这些材料,而是在研究词语之间的关系,并将这些信息用于完全不同的目的。因此,我认为现有的版权制度并不符合当前的需求。我们可能需要制定一个新的版权体系,政府或许也应该介入其中——毕竟在澳大利亚建立训练数据中心是有其积极意义的。

It's really tough. It's really tough. Our copyright system was designed for replicating materials. When you're training an AI model, you're not replicating the materials — you're looking at the relationships between the words, and using it for a very different purpose. I don't think the existing copyright system is fit for purpose. We are going to have to come up with a new structure, and there probably is a case for government intervention into that, which is based on the assumption that having training data centers in Australia is good.

从经济角度来看,这确实有一定的可行性;但从地缘战略的角度来看,情况也较为复杂。虽然计算能力最终可能会变成一种普通的商品,但凭借我们在土地和能源方面的优势,我们仍然有可能在这个领域保持竞争力。从地缘战略的角度来看,95%的人工智能应用最终并不会使用最先进、最前沿的模型,但那剩下的5%的应用对国家安全至关重要。

Now, the case for that — there's an economic case and a geostrategic case. The economic case is a little bit uncertain, but even if compute ends up being a commodity, with our land and energy advantages, we may still be quite competitive in that space. The geostrategic argument: 95% of AI use will not use frontier models in the long run, but for that 5% it's pretty important that we have early access for national defense.

此外,网络安全和编程等领域也需要使用最先进的模型。因此,在澳大利亚建立数据中心意味着我们在相关讨论中拥有谈判筹码,从而确保自己能够继续使用这些最先进的模型。

Cybersecurity,coding is probably another purpose for which you'd want the frontier models. So having data centers here means that we have a bargaining chip in discussions about ensuring that we continue to have access to those frontier models.

这是否也意味着:即使我们不能成为人工智能供应链中的核心部分,至少也要成为其中的重要一环,这样我们才能影响全球人工智能发展的规则和标准?

Is it also a matter of making yourself, if not a major part of the supply chain, at least an important one, so you could even shape the way AI is governed globally?

是的,这确实是一个重要的策略。通过成为供应链中的关键参与者,我们不仅能够影响人工智能的发展方向,还能在全球标准的制定过程中发挥重要作用。

Yeah, which is again a bargaining chip for access, but also that seat at the table in terms of those global standards that will continue to emerge.

我听说过你谈到议会辩论的氛围。这周,自由党议员安吉·贝尔竟然呼吁用石头砸死两名部长;你认为她还应该继续担任议会核心成员(即“前排议员”)吗?

I’ve heard you speak about the tenor of debate in parliament. This week we had Liberal MP Angie Bell call for two ministers to be stoned.

我认为这种言论令人发指、极其恶劣。对于一名议员来说,工作本身就已经非常艰难了,更不应该忍受同事们说出这种伤人、侮辱性的话。因此,我们都应该自我反省,努力提升辩论的质量,真正专注于讨论的核心问题。

Do you think she should still be on the frontbench? I think it's abhorrent, that sort of language. It's hard enough being an MP without your colleagues saying things like that. So I think we all need to watch ourselves and improve the quality of the debate and really focus on the issues.