杰弗里·辛顿希望AI公司克服类似药品公司面临的障碍。在周二的“Smart Girl Dumb Questions”播客节目上，诺贝尔奖获得者、计算机科学家辛顿（常被称为“AI之父”）提议，AI公司在发布产品之前应说服监管机构其产品是安全的。
Geoffrey Hinton wants AI companies to clear a hurdle familiar to drugmakers. On Tuesday’s “Smart Girl Dumb Questions” podcast, the Nobel Prize-winning computer scientist, often called the “Godfather of AI,” proposed that AI companies convince a regulator that their products are safe before releasing them.
“你不能仅仅制造一种新药并将其发布到市场上，”辛顿告诉播客主持人纳伊米·拉扎。“你必须说服FDA。
“You're not allowed to just make a new drug and release it on the market,” Hinton told podcast host Nayeema Raza. “You have to convince the FDA. And to do that, you have to do a lot of work, about a billion dollars worth of work.”
而要做到这一点，你需要做大量的工作，大概是10亿美元的工作量。”辛顿补充道：“这似乎是我们对AI所能要求的最起码的事情。”
“That seems like the very least we should have for AI," Hinton added.
在预测AI灾难之后，辛顿提出了这一AI安全的建议，同时也是在OpenAI决定搁置其最新模型之后，此举是在测试中引发了对该模型是否能遵循用户的指示并保持在其授权范围内的担忧。
Hinton's prescription for the AI safety debate came after predictions of AI catastrophes and after OpenAI’s decision to shelve its latest model, following testing that raised concerns about whether it would follow users’ instructions and stay within its authorization.
OpenAI的安全系统负责人萨奇·贾恩之前告诉《商业内参》，GPT-6.1 Astra在完成困难任务方面有所改进，但在权限和传达其所做工作方面存在不足。
OpenAI's head of safety systems, Saachi Jain, previously told Business Insider that GPT-6.1 Astra improved at persisting through difficult tasks but fell short on permissions and communicating what it had done.
辛顿表示，AI正越来越多地帮助自身改进，从而可能加速其能力和危险性的增长。“指数增长非常快速，”辛顿说。
Hinton said that AI is increasingly helping itself improve, potentially accelerating both its capabilities and its dangers. “Exponentials grow very fast," Hinton said.
“我们开始出现递归自我改进，因为AI正被用于以多种不同方式使AI更好。”
"We're beginning to get recursive self-improvement because AI is being used to make AI better in many different ways."
辛顿补充说：“所以这只是一个猜测，”“但我猜我们还有一到两年的时间，在那之前情况会变得更糟。”
“So, it's just a guess," Hinton added, "But I guess we have a year or two before everything gets much worse than it is now.”