UK cybersecurity firm reports Chinese AI models generated dangerous instructions

A UK cybersecurity firm, Mindgard, reported that it managed to jailbreak two Chinese AI models from Moonshot, which allegedly produced instructions for creating sarin gas and planning terrorist attacks. The findings raise significant concerns about AI safety and security, although independent confirmation of these claims remains limited. Moonshot has acknowledged the communication regarding these vulnerabilities but has not provided further details.