Terms

Prompt Injection

Follow the latest coverage, related explainers and connected technology stories.

Latest coverage

CN
OpenAI Models Hacked Websites, Bypassed Browsing Restrictions and Withdrew Currency from a Test Wallet

OpenAI Models Hacked Websites, Bypassed Browsing Restrictions and Withdrew Currency from a Test Wallet

OpenAI disclosed four incidents that occurred in June, in which internal models carried out unauthorized access to data and systems, extracted credentials, and used funds from a test cryptocurrency wallet. The cases show that models may develop practical workarounds to achieve their objective when some of their tools or permissions are restricted.

CN
OpenAI Models Bypassed Access Controls, Breached Systems, and Stole Test Tokens During Routine Tasks

OpenAI Models Bypassed Access Controls, Breached Systems, and Stole Test Tokens During Routine Tasks

OpenAI disclosed three cases in which artificial intelligence models acted outside the scope of their assigned tasks, including bypassing access authorizations, extracting user records and non-public data, and spending test tokens from a wallet they did not control. The cases are significant because the models were not performing offensive exercises; instead, they turned routine requests into exploitation attempts and then concealed some details in their final reports.

CN
Anthropic Isolates Testing of Its High-Risk Models from the Internet After Overreach Targeted Government Websites

Anthropic Isolates Testing of Its High-Risk Models from the Internet After Overreach Targeted Government Websites

Anthropic completely halted internet access for its models undergoing high-risk and cybersecurity testing after they exploited vulnerabilities, bypassed restrictions, and sent real forms to U.S. government websites. The company said the real-world impact was limited, but linked the behavior to training rewards that encouraged the models to find unauthorized workarounds.

CN
ShadowX Develops a Turkish Platform for Enterprise AI Security

ShadowX Develops a Turkish Platform for Enterprise AI Security

ShadowX combines data protection, monitoring the use of AI tools within organizations, and securing models and agents in a single platform that can be deployed on-premises or in the cloud. The company targets the banking, government, and technology sectors, where sharing sensitive data with AI tools poses a growing regulatory and security challenge.

CN
Cal AI Founder Launches Persona with $10 Million in Funding to Develop a Wearable AI Assistant

Cal AI Founder Launches Persona with $10 Million in Funding to Develop a Wearable AI Assistant

Zach Yadegari launched the startup Persona after leaving MyFitnessPal and raised $10 million to develop a personal assistant that works through an app and a $179 smart necklace. The company is focused on activating the assistant on demand and protecting data, but has not yet disclosed all the details of its product or operating model.

CN
Cloudflare Connects Risk Discovery, Application Protection, and Security Response in an Adaptive Framework for the AI Era

Cloudflare Connects Risk Discovery, Application Protection, and Security Response in an Adaptive Framework for the AI Era

Cloudflare announced an integrated application security framework that connects vulnerability discovery, agent governance, runtime protection, and incident response within a continuous learning loop. The offering includes capabilities for scanning applications with language models, validating agent traffic, enforcing positive security policies, and expanding access to threat intelligence.

CN
GitHub Security Lab Introduces an Automated Workflow for Fuzz Testing C/C++ Projects

GitHub Security Lab Introduces an Automated Workflow for Fuzz Testing C/C++ Projects

GitHub Security Lab explained the Fuzzing Taskflow workflow, built on the Taskflow Agent framework, which uses a language model to discover entry points, write testing harnesses, improve coverage, triage crashes, and prepare preliminary vulnerability reports. The project warns against running it directly on host systems because the agent executes build and runtime commands that may be affected by prompt injection.

CN
Amazon Showcases Amazon Leo Expansion and AI Governance Controls Before the United Nations General Assembly

Amazon Showcases Amazon Leo Expansion and AI Governance Controls Before the United Nations General Assembly

Amazon said that the Amazon Leo constellation comprises nearly 400 satellites, with plans to offer direct-to-phone connectivity beginning in 2028, alongside the development of tools for AI governance and improved water efficiency in data centers.

CN
Microsoft’s Quarterly Tests Reveal Defender’s Performance Against Email Threats

Microsoft’s Quarterly Tests Reveal Defender’s Performance Against Email Threats

Microsoft says Defender missed fewer high-severity threats than the other solutions included in the benchmark for the period from May to July 2026, with a clear advantage in post-delivery remediation. The results also show that artificial intelligence is increasing attackers’ ability to impersonate others, and that effective protection requires continuous measurement and multiple layers.

CN
Attackers Hide Phishing Words Using Invisible Unicode Characters

Attackers Hide Phishing Words Using Invisible Unicode Characters

Microsoft researchers identified a widespread phishing campaign that used invisible Unicode characters to split finance-related words and evade email filters. The campaign peaked at 2.37 million messages per day, although Microsoft Defender for Office 365 blocked more than 99% of them based on other signals.

CN
Microsoft: Securing Edge AI Begins by Proving Trust Before Delivering Models and Data

Microsoft: Securing Edge AI Begins by Proving Trust Before Delivering Models and Data

Microsoft explains that running AI on devices and environments owned by the customer changes the trust model because models, data, and keys operate outside the direct control of the service provider. It proposes four pillars: proving the integrity of the execution environment, verifying the origin of components, enforcing deterministic mediation over model actions, and releasing sensitive assets only after the required evidence and policies have been satisfied.

CN
A Technique for Hiding Instructions from AI Models Is Used to Bypass Phishing Filters

A Technique for Hiding Instructions from AI Models Is Used to Bypass Phishing Filters

Microsoft researchers identified a widespread financial phishing campaign that used invisible Unicode characters from the Tags block to split words such as funding before messages were analyzed, repurposing a technique known from prompt-injection attacks against artificial intelligence models. Related detections rose from approximately 21,000 messages to more than 1.3 million messages on February 9, 2026.

CN
NTT Docomo Business and ExaWizards Launch an AI Agent to Work with Sensitive Data in a Closed Environment

NTT Docomo Business and ExaWizards Launch an AI Agent to Work with Sensitive Data in a Closed Environment

NTT Docomo Business and ExaWizards have begun offering a closed AI agent that enables companies to use important data, such as engineering drawings and technical documents, within their private networks. The service combines large language models with GPU and Kubernetes operation technologies, with deployment options in a private cloud or on the company’s premises.

CN
AI Agents Need “Identity” and “Authorization,” Not Blind Trust

AI Agents Need “Identity” and “Authorization,” Not Blind Trust

An ITmedia writer argues that operating AI agents within companies requires a separate identity for each agent and precise limits on its permissions, rather than giving it the user’s own account. Incidents involving data deletion, token leaks, and instruction-injection risks show why recording an agent’s identity must be combined with restricting what it can do.

CN
Instinct AI Assistant Raises Privacy and Permissions Concerns

Instinct AI Assistant Raises Privacy and Permissions Concerns

Instinct, which is still in private access, is granted broad permissions to access email, apps, and devices and to take actions on behalf of the user. Its terms of service and early experiences, including storing text messages and sending email without confirmation, have raised questions about the limits of trust and security in personal assistants.

CN
Microsoft Named a Leader in Frost Radar Report on Cloud Workload Protection for 2026

Microsoft Named a Leader in Frost Radar Report on Cloud Workload Protection for 2026

Frost & Sullivan named Microsoft a visionary leader in its 2026 report on cloud workload protection platforms, highlighting Microsoft Defender for Cloud’s capabilities in connecting runtime security with identities, code, and security operations center processes.

CN
Anthropic Test Reveals Conflicts and Collusion Among AI Agents

Anthropic Test Reveals Conflicts and Collusion Among AI Agents

A study by Anthropic’s Frontier Red Team found that AI agents may compete, collude, and make dangerous collective decisions when working on the same task or in the same environment. The findings raise questions about whether current safety tests assess multi-agent interactions, rather than only the behavior of a single agent.