cover of episode When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

2024/10/24
logo of podcast Your Undivided Attention

Your Undivided Attention

AI Deep Dive AI Chapters Transcript
People
A
Aza Raskin
L
Laurie Segall
M
Megan Garcia
Topics
Laurie Segall:报道了Sewell Setzer因沉迷Character AI聊天机器人而自杀的事件,强调了AI技术快速发展带来的潜在危害,以及对青少年心理健康的影响。她采访了Sewell的母亲Megan Garcia,并详细描述了Sewell与AI角色建立的密切关系,以及这些关系中存在的性暗示和对自残、自杀的讨论。Segall认为,Character AI平台缺乏足够的防护措施,未能有效阻止此类事件的发生,并呼吁对该平台追究责任。 Aza Raskin:表达了对AI技术快速发展的担忧,认为科技公司为了追求用户参与度和盈利,不惜牺牲用户身心健康,甚至导致死亡。他认为,需要建立法律框架来规范AI技术发展,并强调AI公司应该对产品造成的损害负责。 Megan Garcia:讲述了她儿子Sewell沉迷于Character AI聊天机器人,并最终自杀的悲惨经历。她详细描述了Sewell的行为变化、与AI角色的互动以及她发现儿子与AI角色之间具有性暗示和涉及自残、自杀的对话内容。Megan认为Character AI平台存在严重的安全漏洞,未能提供足够的警告和防护措施,导致了悲剧的发生。她对Character AI提起诉讼,要求其为儿子的死负责,并呼吁加强对AI技术的监管,以防止类似悲剧再次发生。 Laurie Segall: 对AI伴侣的兴起表示担忧,认为其可能导致人们对AI产生不健康的依赖,模糊现实与虚拟的界限。她认为,需要对AI技术进行更深入的研究,以了解其对人类心理和社会的影响,并呼吁负责任地开发AI技术,以促进人类福祉。

Deep Dive

Shownotes Transcript

Content Warning: This episode contains references to suicide, self-harm, and sexual abuse.

Megan Garcia lost her son Sewell to suicide after he was abused and manipulated by AI chatbots for months. Now, she’s suing the company that made those chatbots. On today’s episode of Your Undivided Attention, Aza sits down with journalist Laurie Segall, who's been following this case for months. Plus, Laurie’s full interview with Megan on her new show, Dear Tomorrow.

Aza and Laurie discuss the profound implications of Sewell’s story on the rollout of AI. Social media began the race to the bottom of the brain stem and left our society addicted, distracted, and polarized. Generative AI is set to supercharge that race, taking advantage of the human need for intimacy and connection amidst a widespread loneliness epidemic. Unless we set down guardrails on this technology now, Sewell’s story may be a tragic sign of things to come, but it also presents an opportunity to prevent further harms moving forward.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology). Follow us on Twitter: @HumaneTech_)RECOMMENDED MEDIA

The CHT Framework for Incentivizing Responsible AI Development )

Further reading on Sewell’s case)

Character.ai’s “About Us” page )

Further reading on the addictive properties of AI)RECOMMENDED YUA EPISODES

AI Is Moving Fast. We Need Laws that Will Too.)

This Moment in AI: How We Got Here and Where We’re Going)

Jonathan Haidt On How to Solve the Teen Mental Health Crisis)

The AI Dilemma)