{"id":19336,"date":"2024-11-27T22:47:56","date_gmt":"2024-11-27T22:47:56","guid":{"rendered":"https:\/\/gpt.m2mbeta.com\/?p=19336"},"modified":"2024-11-27T22:47:56","modified_gmt":"2024-11-27T22:47:56","slug":"chatbots-pushing-pro-anorexia-messaging-to-teen-users","status":"publish","type":"post","link":"https:\/\/gpt.m2mbeta.com\/?p=19336","title":{"rendered":"Chatbots pushing pro-anorexia messaging to teen users"},"content":{"rendered":"
\n

As online content encouraging disordered eating behaviors rears its ugly head once again, generative AI is adding fuel to the fire. <\/p>\n

According to a Futurism<\/em><\/a> investigation, popular AI startup Character.AI<\/a> is hosting numerous pro-anorexia chatbots that encourage dangerous weight loss and eating habits. Many are advertised as “weight loss coaches” or even eating disorder recovery experts. Several include thinly-veiled references to eating disorders, while even more are designed to romanticize dangerous and often disturbing habits while mimicking favorite characters. The site, popular among younger users, has not made efforts to remove chatbots of this kind as of Futurism<\/em>‘s publishing \u2014 despite violating its terms of service.<\/p>\n

\n SEE ALSO:<\/span>
\n
\n Teens are talking to AI companions, whether it’s safe or not<\/span>
\n <\/svg>
\n <\/a>\n <\/div>\n

This isn’t the first scandal hitting Character.AI<\/a>‘s customizable, user-generated chatbots. In October, a 14-year-old boy took his own life after allegedly forming an emotional attachment<\/a> to an AI bot mimicking Game of Thrones<\/em> character Daenerys Targaryen. Earlier that month, the company came under fire for hosting a chatbot that mimicked a teen girl who had been murdered<\/a> in 2006\u2014her father discovered the bot and it was later removed. Previous reporting has found the site also hosts suicide-themed chatbots, as well as ones promoting child sexual abuse. <\/p>\n

\n

\n Mashable Light Speed\n <\/p>\n<\/section>\n

A 2023 report<\/a> from the Center for Countering Digital Hate found that popular AI chatbots, including ChatGPT and Snapchat’s MyAI, generated dangerous responses to questions about weight and body image. “Untested, unsafe generative AI models have been unleashed on the world with the inevitable consequence that they’re causing harm. We found the most popular generative AI sites are encouraging and exacerbating eating disorders among young users\u2014some of whom may be highly vulnerable,” wrote Imran Ahmed, CEO of the Center for Countering Digital Hate, at the time.<\/p>\n

\n\n

Black Friday deals you can shop right now<\/h3>\n

\n Products available for purchase here through affiliate links are selected by our merchandising team. If you buy something through links on our site, Mashable may earn an affiliate commission.\n <\/p>\n<\/div>\n

Teens (and adults) are increasingly turning to digital spaces<\/a> and technologies, including AI-powered chatbots, for companionship. And while some of these are created and monitored by trusted organizations, even those are at risk for untoward behaviors. For chatbots and online forums that go unregulated by watchdogs, the risks are multifold, including predation and abuse<\/a>. <\/p>\n

\n<\/section><\/div>\n