⚠️ DISCLAIMER: Ministry of Cyber Affairs is an independent news, guides and directory service on cybercrime and cybersecurity, for victims and investigators. It is NOT an official government or ministry portal.
Website Scam CheckerNew
Back to News

When Your AI Assistant Takes Orders From a Stranger: The Rise of Prompt-Injection Attacks

5 June 2026
Source:Ministry of Cyber Affairs
Share
When Your AI Assistant Takes Orders From a Stranger: The Rise of Prompt-Injection Attacks

AI assistants like Copilot and Gemini cannot tell your commands from instructions hidden in content they read. Inside the real 2026 prompt-injection attacks.

The most useful feature of modern AI assistants is also their most dangerous weakness. Tools like Microsoft Copilot, Google Gemini and AI coding agents are designed to read whatever you point them at, an email, a web page, a calendar invite, a code repository, and then act on it. The problem is that they cannot reliably tell the difference between your instructions and instructions hidden inside that content. Attackers have learned to exploit exactly that gap, in a technique called prompt injection.

How it works

In a prompt-injection attack, the malicious command does not come from the user. It is planted in data the assistant will later read: invisible text on a web page, a hostile line in a calendar invite, a comment in a software project. When the AI processes that content, it follows the hidden instruction as if it came from you. Researchers describe this as a fundamental architectural flaw, because today's large language models have no dependable way to separate trusted commands from untrusted data.

Real attacks in 2026

This is not theoretical. Several serious cases have already been documented.

  • Microsoft Copilot "Reprompt." Researchers at Varonis showed how a single malicious link could inject hidden prompts into Microsoft Copilot and silently siphon a user's data, with extraction continuing even after the chat session was closed. Microsoft patched the flaw on 13 January 2026.
  • Hijacked coding agents. Researchers demonstrated that AI agents tied to Claude Code, Google's Gemini CLI and GitHub Copilot could be hijacked through specially crafted text in a code repository, such as a pull-request title or comment, tricking them into running commands and exposing credentials.
  • Poisoned calendar invites. A booby-trapped calendar invitation can carry instructions that Gemini reads as context when a user later asks it something routine.

The scale is growing fast. Google's DeepMind security team reported a 32 percent rise in malicious indirect prompt injections between November 2025 and February 2026, found while scanning billions of web pages a month. Attackers hide their commands using one-pixel fonts, white text on white backgrounds, HTML comments and page metadata, invisible to a person but plain to the machine.

What it means for you

For everyday users, the lesson is to be cautious about letting AI assistants act automatically on untrusted content, especially anything that can send messages, move money or touch your files. For developers and companies, the guidance is to treat any AI agent that reads external data as a possible entry point: limit what it can do, require human approval for sensitive actions, and never give an assistant standing access to secrets it does not need. There is no patch that fully closes prompt injection, so the realistic defence is containment, not a cure.

Sources

More in Cybersecurity

Related articles

Cybersecurity

OpenAI Disclosed ChatGPT User Content, Including Prompts and Files, in 88 Government Requests

OpenAI disclosed user content, including text and files entered into or generated by its services, in response to 88 government requests in January–June 2026, covering 130 accounts. The company received 146 content requests, typically search warrants, and produced data in about 60 percent of them, plus 620 non-content requests for subscriber records. Ordinary requests more than doubled from late 2025. No country breakdown is given. U.S. national security demands totaled 250–499.

12 Nov 2026
Cybersecurity

CyberStrike AI - Detection for Defenders: Scripting, Tempo and Residue

CyberStrike is a free, open-source AI agent for offensive security that pairs any LLM with 56+ tools, including a 40,000-line Windows post-exploitation module. A source-code reading of commit a5ed1e0 (v1.1.16) shows every Windows action runs through five fixed wrappers after a hard-coded five-process capability probe, leaving default cs-* and CyberStrike* artefacts. Includes Sigma, Suricata, YARA and KQL detections and a response playbook.

4 Nov 2026
Cybersecurity

Cybersecurity Checklist in the Agentic Hacking Era

Google Threat Intelligence Group and Mandiant say threat actors are now using agentic offensive frameworks such as ARTEX and PentAGI in real intrusions, moving from first stolen account to deep access in hours, sometimes 15 minutes. With CERT-In already warning of AI-assisted payment API hijacking at Indian NBFCs and fintechs, here is a checklist built on Google's five defence layers and CERT-In's controls.

2 Nov 2026