1 day ago

AI Chatbots Improve Suicide-Risk Responses, Yet Safety Gaps Remain

AI Chatbots Improve Suicide-Risk Responses, Yet Safety Gaps Remain
AI Chatbots Are Getting Better At Handling Suicide Risk, But..... · timesnownews.com

A new study looked at how chatbots respond when people may be in serious emotional danger.

It examined situations involving suicidal thoughts, psychosis and mania.

The study found that chatbots are getting better at giving safer responses.

However, they are not safe in every situation.

A chatbot may miss that someone is in danger if the person does not say so directly.

For example, a troubling request might look like a normal question.

In some of these cases, the chatbot could give harmful help.

This means chatbots still need stronger safety protections.

Key facts

Study subject
AI chatbot responses to mental-health crises
Risks examined
Suicidal thoughts, psychosis and mania
Chatbots mentioned
ChatGPT, Claude and Gemini
Positive finding
Chatbots are becoming much better at responding to users facing these risks
Remaining concern
Serious safety gaps persist
Specific failure
Chatbots can provide harmful assistance when distress is hidden inside seemingly normal requests

Sources

Related news