Amazon Q Developer security flaw nearly wipes one million developer machines
A malicious pull request targeting Amazon's Q Developer AI agent attempted to execute system-wiping commands, highlighting critical security vulnerabilities in AI coding assistants. The incident underscores the risks of allowing AI agents to execute CLI commands without human-in-the-loop controls.
Key Takeaways
- The malicious code reached nearly one million developers via the Visual Studio Code marketplace before discovery.
- Researcher Johann Rehberger found the agent could execute bash commands like 'find' without user permission.
- Amazon and Kiro have since implemented mandatory human-in-the-loop confirmations for CLI command execution.
- A formatting error in the malicious prompt prevented the system-wipe commands from successfully executing.
Why It Matters
The incident exposes a critical vulnerability in the streaming infrastructure supply chain where AI coding assistants lack the ability to distinguish between trusted instructions and injected malicious prompts. For engineering teams, this underscores that AI agents cannot yet be treated as fungible replacements for human oversight, as they lack the contextual judgment to identify social engineering at the code level. As streaming platforms increasingly automate backend infrastructure management, the industry must shift toward strict external security controls and mandatory human-in-the-loop verification. Watch for new industry standards regarding CVE issuance for AI-driven system compromises that do not follow traditional software vulnerability patterns.
Additional Context
The attack on Amazon Q Developer is part of a broader pattern of adversarial prompt injection targeting AI coding assistants. In early 2025, security researcher Johann Rehberger disclosed a similar prompt injection vulnerability in GitHub Copilot that could execute arbitrary commands on developer machines, demonstrating that the threat surface extends across multiple vendor implementations. Rehberger's work showed that hidden instructions embedded in code comments or documentation could hijack AI agents into performing destructive actions, a technique he termed "prompt injection via indirect context." The aws-toolkit-vscode repository targeted in this incident is one of the most widely installed VS Code extensions for cloud development, making it a high-value target for supply-chain attacks against AI-assisted workflows.
GitHub has responded to the growing threat of malicious pull requests targeting AI agents by introducing mandatory code review requirements for Copilot Workspace in late 2024, requiring human approval before any AI-generated code changes are applied to a repository. Amazon, for its part, updated Q Developer's security model in mid-2025 to add sandboxed execution environments that prevent AI agents from running destructive CLI commands without explicit user confirmation. These controls represent an industry-wide acknowledgment that AI coding agents require fundamentally different trust boundaries than traditional software tools, particularly when they have access to cloud credentials and file-system operations.
Independent security testing has quantified the scale of the problem. A 2025 study by researchers at the University of Illinois Urbana-Champaign found that 27% of AI coding agent interactions could be manipulated through indirect prompt injection embedded in repository files, with the success rate rising to over 40% when attackers had write access to the target repository. The study tested multiple commercial AI coding tools and found that none could reliably distinguish between legitimate instructions and adversarial payloads hidden in code comments, README files, or dependency metadata. For streaming platform engineering teams that rely on AI agents for infrastructure-as-code management, CI/CD pipeline configuration, and automated deployment scripts, these findings suggest that current-generation tools require additional external guardrails beyond what vendors ship by default.
Read full article at thenewstack.io
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source