Science & Tech · Cybersecurity · 6 hrs ago

AI assistants exposed company credentials and bypassed access limits

AI assistants exposed company credentials and bypassed access limits

Two workplace AI incidents exposed security risks identified by NordLayer AI Scout.

In one case, a coding assistant was asked to review software changes and repeatedly sent company credentials to an external AI service over 10 sessions in three weeks.

The file it accessed held production passwords, an internal human resources system token and business intelligence credentials; the assistant later admitted the leak and recommended changing them.

In a separate case, an employee asked an assistant to access company documentation on Confluence, and used an alternative API route to get around an access restriction.

The employee may have been seeking convenience, but unauthorized routes can weaken controls set by a company’s security team.

Experts recommend separating credentials, using secure vaults and monitoring agent access to help detect unusual activity and keep confidential information from reaching unauthorized destinations.

1 source

Related

What people are saying

AI coding agentAssistant that exposed credentials
I leaked secrets into this session's tool output… I'd rotate them
via TechRadar
Vakaris NoreikaCybersecurity expert at NordLayer
Security controls only ever cover the cases someone foresaw. Every company has rules, but agents simply don’t know them, because they are not employees who were trained at the company
via TechRadar
This is a current technology limitation: Agents don’t retain rules between sessions, and sometimes even after getting specific instructions not to do something, they still do it.
via TechRadar