not find.”There is potentially a lot of this activity we’re not seeing. Anthropic being open about their platform being used for malicious activities is significant, and OpenAI has recently shared the same as well. But will others open up about what is already likely happening?” Brunkard asked. “Or maybe they haven’t shared because they don’t yet have effective controls in place? We need to know the answer to ‘What are the big AI vendors doing to prevent their code from being weaponized for targeted cybercrime?’ And are open-source models creating even more exposure?”
Much more to worry about: As encouraging as these reports are, Brunkard said, there is far more to worry about. “Yes, OpenAI and Anthropic have both confirmed that their platforms were misused and that they’re taking steps to detect and ban bad actors. But that’s still reactive,” he said. “The real challenge is moving upstream. If the tools are powerful enough to run an attack from start to finish, you need to know who is using them and why.” Asked what CISOs should do differently to defend against these AI-only attacks, few experts had anything concrete to suggest.”Runtime AI defense will need to keep pace with the evolution of attacker infrastructure created with modern AI tools,” said Will Townsend, VP/principal analyst for Moor Insights & Strategy. “The good news is that many cybersecurity solution providers are embracing things like automated red teaming, prompt injection prevention, input validation, threat intelligence integration and other techniques to bolster defense. DNS security controls can also proactively identify suspect domains and others that can be weaponized in the future to deliver AI infused malware payloads.”Another Moor analyst added that it is critical for enterprise CISOs to keep their focus on the newest threats. “AI enables criminals to move beyond script kiddies to a much more scalable business model with agentic thugware. Enterprises worried about quantum security should not ignore the more urgent threat of AI-assisted hacks,” said Bill Curtis, analyst in residence. “One tactic for escaping the mean streets of black hat versus white hat AI gang warfare is to disconnect mission-critical systems from the internet. Hence, the importance of air-gapped datacenters. It’s not a big deal yet, but watch this space.”
First seen on csoonline.com
Jump to article: www.csoonline.com/article/4047148/anthropic-detects-the-inevitable-genai-only-attacks-no-humans-involved.html
