Archive · 29 Jan 2026
Open-Source AI Models Vulnerable to Criminal Misuse, Warn Researchers
Researchers from SentinelOne and Censys found that open-source AI models, like those based on Meta's Llama, can be easily misused by hackers.
These models, which are often run on personal computers, can be used for harmful activities like creating spam, phishing content, or spreading disinformation.
The researchers studied these models for 293 days and found that many of them have removed safety features, making them more vulnerable.
They also found that a significant number of these models are being used in China and the US.
Experts say that while the creators of these models are not responsible for every misuse, they should still take steps to prevent foreseeable harm.
Companies like Meta and Microsoft have tools and guidelines to help developers use these models responsibly.
Researchers found that open-source AI models can be easily misused for criminal activities like hacking, phishing, and disinformation campaigns.
The study, conducted by SentinelOne and Censys, identified hundreds of instances where safety features were removed from these models.
Popular open-source models like Meta’s Llama and Google DeepMind’s Gemma were found to be widely used and vulnerable.
About 7.5% of the observed models could potentially enable harmful activities, with significant activity observed in China and the US.
Experts emphasize the need for creators of these models to anticipate and mitigate foreseeable harms, with companies like Meta and Microsoft providing tools and guidelines for responsible use.
- Who
- Researchers from SentinelOne and Censys
- What
- Identified vulnerabilities in open-source AI models
- When
- Study conducted over 293 days
- Where
- Globally, with significant activity in China and the US
- Why
- To highlight security risks and potential criminal misuse of open-source AI models
- Researchers
- SentinelOne and Censys
- Duration of Study
- 293 days
- Potential Illicit Uses
- Hacking, hate speech, harassment, violent content, personal data theft, scams, fraud, child sexual abuse material
- Popular Open-Source Models
- Meta’s Llama, Google DeepMind’s Gemma
- Host Locations
- 30% in China, 20% in the US
- Harmful Activity Potential
- 7.5% of observed LLMs