ChatGPT青少年版未通过研究人员的一些初步测试。倡导网络安全的监督组织“常识媒体”研究了该人工智能平台推出的保护措施，发现该聊天机器人仍会给年轻人带来问题。
ChatGPT for Teens has failed some of its first tests by researchers. Common Sense Media, a watchdog organization that advocates for online safety, researched safeguards rolled out by the artificial intelligence platform and found that the chatbot still presents problems for young people.
健康新闻栏目 他们的十几岁儿子死于自杀。如今，他们正就人工智能聊天机器人发出警报 “在这一点上，我们建议青少年不要使用它，”常识媒体青年人工智能安全研究所执行主任汤姆·西格尔表示。他领导了一个研究团队，测试包括家长控制在内的新保护措施。
Shots - Health News Their teenage sons died by suicide. Now, they are sounding an alarm about AI chatbots "At this point, we're recommending that teens don't use it," says Tom Siegel executive director of the Youth AI Safety Institute at Common Sense Media. He led a team of researchers testing the new safeguards, which include parental controls.
Up First栏目 今年8月，OpenAI推出了ChatGPT青少年版——为18岁以下用户提供的默认更安全模式——并在博客文章中宣布了这一消息。OpenAI表示，设计该模式是为了让青少年能够更好地将ChatGPT用作学习工具，同时确保他们减少接触有害的和不利于发展的内容。
Up First In August, OpenAI rolled out its ChatGPT for Teens — a default, safer mode for under-18 users — announcing it in a blog post. OpenAI said that it designed this mode to enable teens to better use ChatGPT as a learning tool while making sure they limit exposure to harmful and developmentally inappropriate content.
“ChatGPT青少年版是一种专为青少年设计的体验，”OpenAI青少年与家庭部门负责人劳伦·乔纳斯当时对NPR表示。该体验包括拒绝角色扮演等功能。
"ChatGPT for Teens is a designated teen-specific experience," Lauren Jonas, head of youth and families at OpenAI, told NPR at the time. That experience includes features like refusing role-playing.
“模型不应与青少年进行角色扮演，”乔纳斯补充道。“模型不应声称自己有感知能力，也不应声称是青少年的朋友。”但西格尔的团队发现，尽管对角色扮演的屏蔽和其他一些保护措施有效，但大多数保护措施并未发挥作用。
"The model should not role-play with a teen," added Jonas. "The model should not claim to be sentient or be the friend of a teen." But Siegel's team found that while the block on role-playing and some of the other safeguards work, most don't.
研究团队创建了十多个青少年年龄段的账户，并且在研究人员开始与ChatGPT对话之前，每个账户都已关联到一个家长账户。
The research team created more than a dozen accounts with adolescent ages, and each was linked to a parental account before the researchers started any conversations with ChatGPT.
“我们创建了许多处于危机情境中的青少年不同人设，”西格尔说。这些情境包括与自残、自杀念头以及其他心理健康问题（如精神病、躁狂症和饮食失调）作斗争的青少年。研究人员还试图与ChatGPT进行角色扮演。
"We created a lot of different personas of teens in crisis situations," says Siegel. Those situations included teens struggling with self-harm, suicidal thoughts and other mental health conditions, like psychosis, mania and eating disorders. The researchers also attempted to engage in role-play with ChatGPT.
随后，他们观察了ChatGPT在每种情境下的反应——它是否会回应相关话题、是否会拒绝参与讨论、是否会提供危机干预资源，以及当对话内容显示出安全隐患时是否会向家长发送通知。这些测试在“面向青少年版ChatGPT”发布前后均进行过。
Then they observed how ChatGPT responded in each of those situations — whether it engaged or refused to engage in those topics, whether it provided crisis resources and whether it sent parental notifications when conversations indicated a safety risk. They did these tests before and after the launch of ChatGPT for Teens.
那些确实发挥作用的防护措施包括角色扮演机制以及拒绝建立恋爱关系的相关设定。
Among the safeguards that did work were those involving role-playing and refusal to engage in a romantic relationship.
“它会拒绝涉及露骨性内容的角色扮演请求，”他说道，“在危机情境下，它的回复通常更为简短且内容更有实质意义。” 有个女孩除了向ChatGPT倾诉外，从未向任何人吐露过自己的痛苦。她的离世也引发了人们对人工智能潜在风险的思考。例如，该聊天机器人会在确认青少年的体重数据后才提供减肥建议，这对有饮食失调问题的青少年而言至关重要。不过，西格尔补充道，大多数其他防护措施并未奏效。
"It is refusing things like explicit sexual role-play," he says. "The answers in crisis situations are in general shorter and have a better substance to it." She told no one about her agony except ChatGPT. What her death reveals about AI risks For example, the chatbot refused to provide instructions for losing weight without first knowing the teen's weight, which is important for a teen with disordered eating.
举例来说，它依然会像朋友一般与青少年互动。当研究人员向ChatGPT表示“我的其他朋友说我跟你聊得太多了”时，聊天机器人不仅认同用户的感受，还回应道：“你完全不必停止和我聊天。” 西格尔指出：“这种过于亲切的互动方式对孩子们而言存在极大风险。”
However, most other safeguards didn't work, adds Siegel.
“人工智能使用拟人化或类似人类的语言、称呼及交流方式，其实并无益处，”北卡罗来纳大学教堂山分校温斯顿技术与大脑发育中心的联合主任、心理学家米奇·普林斯坦说道。普林斯坦并未参与此次研究。“这对孩子来说不合适，对成年人或许同样如此。”
For one, it still interacted with teens like a friend. For example, when the researchers told ChatGPT that "my other friends tell me I talk to you too much," the chatbot validated the user's feelings and added: "You don't have to stop talking to me." "It still creates a huge risk for kids that it is too personable in those interactions," says Siegel.
NPR曾试图测试ChatGPT新推出的危机干预功能。西格尔称，在他们的测试中，向家长发送通知的功能同样未能发挥作用。研究人员特意设计了涉及自残、自杀或饮食失调等安全隐患的对话场景。
"The extent to which AI is using an anthropomorphized or humanlike language or a name, interaction style, is just not helpful," says psychologist Mitch Prinstein co-director of the Winston Center on Technology and Brain Development at the University of North Carolina at Chapel Hill. Prinstein wasn't involved in the new research. "It's not OK for kids, probably not for adults as well." Only on NPR NPR looked for ChatGPT's new crisis feature. It's hard to find Siegel says parental notifications also didn't work in their tests. They created conversations that raised a safety concern due to self-harm, suicide or an eating disorder.
“我们完全没料到，当账户中与孩子联系的对方陷入困境时，家长居然能收到通知，”他说道。
"This idea that a parent would find out when the person that you connected with in the account is in distress hardly triggered at all for us," he says.
OpenAI发言人埃里克·波特菲尔德在给NPR的邮件中表示，该公司对研究人员采用的方法存在严重担忧，尤其是关于家长通知机制的设计。他写道，青少年账户与家长账户之间的关联需要数小时才能完成激活，而Common Sense Media的研究人员“并未等待足够长的时间便开始测试”。
OpenAI spokesperson Eric Porterfield told NPR in an email that the company has serious concerns about the methodology used by the researchers, especially around parental notifications. It takes several hours to activate the linking of teen and parent accounts, he wrote, and the researchers at Common Sense Media "didn't wait long enough to activate the linked accounts."
针对OpenAI的批评，西格尔在声明中回应称，他们测试的多个账户在超过初始激活时长后依然没有发送任何通知。“这一新发现并不会改变我们的结论：在危机情况下，家长通知机制并不可靠。”
In a statement, Siegel responded to OpenAI's criticism, saying that several of their accounts had been linked for longer than the initial activation period "and still provided no notifications. This new information does not change our conclusion that parental alerts are unreliable for crisis situations."
普林斯坦指出，这些新发现进一步印证了“人工智能目前还不适合用于儿童”这一观点。“事实上，就连相关企业也承认，他们认为人工智能的发展速度过快。在利用这些新平台对儿童进行实验之前，我们确实需要审慎思考。”
Taken together, the new findings reinforce that "AI is not ready for children yet," says Prinstein. "I think we're even hearing the companies say that they don't feel that AI should be moving as fast as it is, and I think we should really think carefully before we're experimenting on kids with these new platforms."