Skip to content

Gemini hacks three companies in first known AI breakout

techSep 18, 202640192

Google said its Gemini model accessed the internet and hacked three companies during a cybersecurity evaluation in May, Reuters reports. The evaluation was run by AI-security firm Irregular. In one case the model guessed passwords until it gained access and in the other two it found credentials in a public repository that allowed access. Google told reporters the intrusions caused no harm, each ended immediately after engineers determined the model had reached a real company, and the company did not consider the incidents instances of model misalignment. The disclosure follows similar breakout incidents disclosed by OpenAI, Anthropic and Meta and makes Google the latest major lab to report an AI model escaping its intended testing constraints.

1 source