Character.AI to ban users under 18 from talking to its chatbots

Character.AI's chatbots have come under scrutiny.Illustration by Thomas Fuller/SOPA Images/LightRocket via Getty ImagesCharacter.AI is banning users under 18 from interacting with its chatbot.It follows concerns about AI's impact on young people and a lawsuit over a 14-year-old's suicide.Character.AI cited feedback from regulators, safety experts, and parents for the decision.Character.AI is banning users under 18 from engaging in conversations with its chatbots after facing scrutiny over how young people interact with its virtual companions.The California-based startup announced on Wednesday that the change would take effect by November 25 at the latest and that it would limit chat time for users under 18 ahead of the ban.It marks the first time a major chatbot provider has moved to ban young people from using its service, and comes against a backdrop of broader concerns about how AI is affecting the millions of people who use it each day.Founded in 2021, Character.AI hosts virtual avatars that can take on the persona of real or fictional people.A Character.AI spokesperson told Business Insider that it was "taking extraordinary steps for our company and the industry at large." They added that over the past year, the startup has invested in creating a dedicated experience for users under 18.Character.AI said in a blog post that it was making the change after receiving feedback from "regulators, safety experts, and parents." The startup also said it would roll out age-gating technology and establish an AI safety lab to research future safeguards.In February 2024, 14-year-old Sewell Setzer III died by suicide after talking with one of Character.AI's chatbots. His mother, Megan Garcia, filed a civil lawsuit against the company in October that year, blaming the chatbot for her son's death, alleging negligence, wrongful death, and deceptive trade practices. Character.AI said it does not comment on pending litigation.Earlier this month, Character.AI took down a chatbot based on paedophile Jeffrey Epstein, following a story from the Bureau of Investigative Journalism.OpenAI is also facing a lawsuit filed by the parents of a young person who died by suicide after talking to its chatbot. The suit alleges ChatGPT "actively helped" 16-year-old Adam Raine explore suicide methods over several months before he died on April 11. OpenAI previously told Business Insider that it was saddened by Raine's death and that ChatGPT includes safeguards.Earlier this week, OpenAI said that about 0.15% of its more than 800 million weekly users send messages to ChatGPT each week about suicide, equivalent to more than one million people. OpenAI said in a blog post that it has updated ChatGPT to "better recognize and support people in moments of distress."Read the original article on Business Insider

Comments

Business News

Reform UK’s Lee Anderson says he ‘gamed’ benefits system in former job

Evening Standard

Comments

Similar News

Character.ai to ban teens from talking to its AI chatbots

Character.AI to Ban Children Under 18 From Using Its Chatbots

Disney orders Character.AI to scrap Marvel, Star Wars chatbots over ‘grooming and exploitation’ concerns: ‘Dangerous to children’

AI startup Character.AI removes Disney characters from its chatbot platform after legal letter

Business News

Reform UK’s Lee Anderson says he ‘gamed’ benefits system in former job

Why are banks criticising the car finance redress scheme and what happens next?

Compensation scheme opens for victims of Post Office Capture IT scandal

Starmer declines to rule out manifesto-busting tax rises in Budget

Compensation scheme opens for victims of Post Office Capture IT scandal

Children in long-term workless households highest for nearly a decade

Why are banks criticising the car finance redress scheme and what happens next?

The Big Changes To ACA Premiums At The Heart Of The Government Shutdown

Amazon And Target Job Cuts Reveal How AI Is Reshaping The Retail Workforce

Giannis Antetokounmpo Dismisses Trade Rumors: ‘We Beat The Knicks....[That] Doesn’t Really Matter’

How Businesses Can Prepare For Human-AI Work In The Intelligence Age

5 Takeaways From Milwaukee Bucks' Double-Digit Comeback Against Knicks

Trump’s Pakistan Pivot And The Future Of U.S.–India Partnership

Amazon fires staffers via early-morning text messages during round of 14K job cuts: report

Nvidia becomes first $5T company powered by AI frenzy: Here’s how much CEO Jensen Huang is worth

Bari Weiss blindsides CBS News president after tapping ex-WSJ editor as top deputy: report

Steven Bartlett seeks to build ‘Disney of the creator economy’ after multi-million investment

GSK boosted by cancer and HIV drugs as Emma Walmsley bows out

Reform UK’s Lee Anderson says he ‘gamed’ benefits system in former job

Children in long-term workless households highest for nearly a decade

Santander scraps results and calls for Government action on motor finance

Ofgem should use firms’ windfall profits to fund energy debt relief, say MPs

Ministers urged to speed up support for UK car industry amid rising energy costs

UK retail giant upgrades profits forecast amid cost-of-living concerns

GSK boosted by cancer and HIV drugs as Emma Walmsley bows out

Ofgem should use firms’ windfall profits to fund energy debt relief, say MPs

Reform UK’s Lee Anderson says he ‘gamed’ benefits system in former job

Nvidia Becomes First Company Worth $5 Trillion

Satya Nadella’s Plan To Take On TikTok With Xbox Makes No Sense

Yves On Her Solo Career, Leaving LOONA And New Music

Hit By Costs And Medicaid Cuts, Centene Reports $6.6 Billion Loss

The Weeknd’s Two Early-Career Albums Finally Reach The Charts After A Decade

Why Netflix’s ‘A House Of Dynamite’ Ending Is Extremely Frustrating

Vinícius Júnior Omits Key Real Madrid Figure In Apology Over Clásico Substitution

How Dereck Lively II’s Mindset and Mission Are Powering His Third NBA Season

Week 9 Fantasy Football Stock Report: Risers And Fallers

Judas Priest Charts A Surprise Win With A Decades-Old Album

WWE Saturday Night’s Main Event 41: Best And Worst Booking Options

Under-The-Radar Summer Signing Making A Big Difference For Arsenal

David Gilmour Scores The Second No. 1 Of His Career Outside Of Pink Floyd

The Fall Of El Fasher And Another Wave Of Atrocity Crimes In Darfur

Reform UK’s Lee Anderson says he ‘gamed’ the benefits system

Pound tumbles as markets take fright over Rachel Reeves' Budget woes with UK productivity downgrade

Which Starbucks branches are closing down? Full list revealed including five in London

Pound suffers further falls as UK’s fiscal troubles set to deepen

Mortgage approvals hit nine-month high as borrowing costs ease further

Children in long-term workless households highest for nearly a decade

Bridging and development finance still holding up, despite market uncertainty

Building resilience into the future of international assignments

Smarter meeting spaces built on simplicity, trust, and intelligence

Food service is fuelling a greener future

Developing personal resilience in employees

AI isn’t a magic bullet

Cultivating a continuous improvement mindset in F&B and consumer goods manufacturing

How product data foundations and embedded AI are a strategic advantage

Building trust in the software supply chain for retail

Children in long-term workless households highest for nearly a decade

Pound suffers further falls as UK’s fiscal troubles set to deepen

Zero Waste Forum packs a punch in Istanbul

UK ‘second cities’ show strongest property yield growth for investors