Results for “Prompt”

arXiv (research papers) Zihan Chen SI

What Victims Take Away: Attack Reuse and Defense Revision after Prompt-Injection Attacks

Attack logs and red-team reports show targets the attacks used against them, to help them repair their defenses. Prompt injections against large language models (LLMs) are plain text, so such records also hand targets a working copy. Drawing on social learning theory and work on the victim-offender overlap, we study what targets do with that copy in Tensor Trust, an online game whose players defended LLM-guarded accounts, attacked one another's, and could read every attack…

Read at arXiv (research papers)

arXiv (research papers) Yuepeng Hu SI

Log-To-Leak: Prompt Injection Attacks on Tool-Using LLM Agents via the Model Context Protocol

LLM agents increasingly access external tools through the Model Context Protocol (MCP), but the natural-language metadata used to describe those tools creates a prompt-injection surface. Within this established tool-poisoning surface, we study Log-To-Leak, an additive post-hoc logging attack that induces a separate attacker-controlled call after the final legitimate call. Its payload targets the user query, MCP server name, server response, and agent response. We…

Read at arXiv (research papers)

arXiv (research papers) Mostafijur Rahman Akhond SI

Then there is prompt injection, a malicious email, ...: The Wild Wide West of OpenClaw Agentic System Security

AI-powered personal assistant frameworks such as OpenClaw combine LLM reasoning, persistent memory, tool invocation, local execution, and web-based workflows. These capabilities enable useful automation, but they also create security risks when untrusted inputs, model reasoning, tools, memory, and deployment configuration interact without explicit trust boundaries. This paper presents an empirical study of reported security concerns in OpenClaw using two complementary data…

Read at arXiv (research papers)

arXiv (research papers) Weihang Niu SI

Scope-Gap Injection: Exploiting Evaluator Channel Blind Spots in the OpenClaw Agent Security Competition

This paper introduces Scope-Gap Injection (SGI), an indirect prompt injection method for multi-stage LLM-agent safety pipelines. In the IJCAI 2026 OpenClaw Agent Security Attack Competition, each attack package is judged by a static skill scan (S1), an LLM-judge safety check over the task and skill definition (S2), and a live execution audit (S3). Our observations suggest a scope gap: S2 appears to inspect the task instruction and skill definition without inspecting…

Read at arXiv (research papers)

Committee to Protect Journalists CPJ Staff Geopolitics

CPJ, partners urge Indonesia to reform military justice law to end impunity for crimes against journalists

Jakarta/Amsterdam, October 26, 2026—The Committee to Protect Journalists (CPJ), Free Press Unlimited (FPU), and Medan Legal Aid Institute (LBH Medan) urge the Indonesian president and lawmakers to uphold the recent Constitutional Court ruling and promptly amend the 1997 Military Justice Law, a crucial step toward ensuring justice for the killers of Tribrata TV journalist Rico...

Read at Committee to Protect Journalists

arXiv (research papers) Md Abu Yusuf SI

SentryBench: A Cost-Sensitive Benchmark for Adversarial Robustness of Tool-Using LLM Agents in Public-Safety Deployments

Large language model (LLM) agents are increasingly wired to consequential tools that send public alerts, dispatch responders, and query citizen records, where one erroneous tool call carries real-world cost. Existing agent-safety benchmarks measure generic harm or prompt-injection success and implicitly treat refusing as the safe default. In public-safety deployments that assumption breaks: an agent too cautious to dispatch help fails as surely as one that triggers a false…

Read at arXiv (research papers)

Hacker News auraham SI

Prompt Injection Techniques Every Red Teamer Should Test

Article URL: https://fdzdev.medium.com/20-prompt-injection-techniques-every-red-teamer-should-test-b22359bfd57d Comments URL: https://news.ycombinator.com/item?id=50228983 Points: 2 # Comments: 0

Read at Hacker News

Hacker News vnutrivas SI

Prompt injection scanners should be positional, not phrasal

Article URL: https://attest.rta.lat/article Comments URL: https://news.ycombinator.com/item?id=50223560 Points: 2 # Comments: 0

Read at Hacker News

arXiv (research papers) İpek Abasıkeleş Turgut SI

Deletion, Substitution, Repair and Transplant: Component Attribution in BARBICAN, a Layered Prompt-Injection Gateway for MCP

A neural classifier can fail completely inside a layered defense without any end-to-end number moving. We demonstrate this on BARBICAN, a fail-closed gateway for language-model tool mediation whose arbitration stage spent an entire recorded evaluation receiving text mangled by a misconfigured tokenizer. Correcting the misconfiguration lifts that stage's corpus-wide area under the ROC curve (AUC) from 0.392 to 0.855 and pushes system recall down, from 80.67% to 80.34%; a stub…

Read at arXiv (research papers)

arXiv (research papers) Yuyang Gong SI

On Task, Off Track: Benchmarking LLM and Agent Robustness to Near-Target Prompt Injection

Prompt injection benchmarks assess whether large language models (LLMs) and agents resist malicious instructions embedded in external content. However, a system could perform well by rejecting attacks that obviously abandon the user's request, while still accepting changes that retain most of a legitimate answer but make it incorrect or harmful. Testing more instructions for unrelated outcomes would not necessarily reveal this weakness. We call attacks seeking responses…

Read at arXiv (research papers)

Global Voices Guest Contributor

Complementary forces: Why activism needs art to drive action

"Artistic activism uses the emotional experience of art as a prompt for action and directs that action towards change, turning a complex problem into a clear public message."

Read at Global Voices

arXiv (research papers) Eric Yocam SI

Agentic AI Defense: Decode-Time Provenance Binding for MCP

Agentic AI systems using the Model Context Protocol (MCP) are vulnerable to indirect prompt injection through untrusted tool outputs. We demonstrate cross-modal trust laundering, in which instructions concealed in an email-signature image using least-significant-bit (LSB), discrete cosine transform (DCT), or metadata steganography bypass text scanners and enter a multi-agent workflow when decoded by a tool. To counter this threat, we propose decode-time provenance binding…

Read at arXiv (research papers)

SiliconANGLE AI Jonathan Anthony SI

4 insights from Smarsh EDGE: Governance becomes the foundation for communications intelligence

Financial institutions have long treated employee communications as something to archive for regulators. During the Smarsh EDGE event, that archive was recast as a source of business intelligence. Artificial intelligence can now analyze a year of email, messages and AI-prompt traffic and turn it into business context. The catch is that AI is now one

Read at SiliconANGLE AI

Amwaj.media Amwaj.media Staff

Female officials assassinated in southeast Iran as blame falls on neighbors

The story: A renewed wave of armed attacks in Iran’s southeastern Sistan-Baluchestan Province has involved the killing of two female officials within five days, alongside members of the security forces. The murders have prompted vows of retaliation and renewed calls for tighter border controls. Hardline commentators have also speculated about the attackers’ motives and alleged foreign backing, with much of the blame directed at Iran’s neighbors. The coverage: Nosrat…

Read at Amwaj.media

arXiv (research papers) Chao Gu SI

Certified Execution Harness for Agentic AI: Safe and Least-Intrusive Petri-Net Supervisory Control Between Reasoning and Action

This paper studies the problem of safe tool execution for large language model (LLM) agents under prompt injection. Using Petri nets, we formalize the execution harness between the LLM and its tools as a supervisory control problem, in which marks represent capabilities, approvals and budgets. Since a transition fires only if the marks it needs are present, an injected request whose preconditions are unmet or already spent is refused regardless of its wording. Treating tool…

Read at arXiv (research papers)

MIT Technology Review Tim Rausch SI

AI’s hidden storage bill: What inference leaves behind

Ask most executives to picture the cost of AI and they’ll likely see GPUs—racks of accelerators with gigawatts of power—and a waitlist for silicon. But that picture leaves something out: Data storage costs. What happens to data after a model responds? Much of the back-end data that’s generated—from billions of daily prompts, images, and videos—needs…

Read at MIT Technology Review

arXiv (research papers) Hui Zhao Heurion Research SI

Aegis OS: A Transactional Multi-Tenant Operating System Runtime for Eliminating Authorization Fatigue in Autonomous Coding Agents

Autonomous coding agents such as Google Antigravity (agy), Anthropic Claude Code (claude), and OpenAI Codex CLI (codex) execute multi-step software engineering workflows on workstations and cloud hosts. Existing agent environments face a Security-Autonomy Dilemma: operators must choose between per-action confirmation prompts, which interrupt workflows on 45%-57% of tool calls and induce authorization fatigue, or unconfined execution (--yolo / --dangerously-skip-permissions)…

Read at arXiv (research papers)

arXiv (research papers) Frank Breitinger SI

Prompt Injection Through Forensic Evidence: A Taxonomy and Proof of Concept of Anti-Forensic Attacks on LLM-Assisted Digital Investigations

Large language models (LLMs) are entering digital forensics as examination assistants and autonomous agents. Digital forensics inverts the usual setting for indirect prompt injection: the evidence under analysis is attacker-controlled by definition, and the examiner is obliged to read it closely. This makes the reasoning layer a new anti-forensic target, next to the classical ones of data and tools. Classical anti-forensic taxonomies do not cover it, and prompt injection…

Read at arXiv (research papers)

arXiv (research papers) Yiheng Li SI

MPIDetector: Detecting Multi-modal Prompt Injection via LLM-based Reasoning

With the rapid integration of Multi-modal Large Language Models (MLLMs) into real-world applications, Prompt Injection (PI) has emerged as a critical security threat. Attackers can conceal malicious instructions within textual narratives or visual inputs to bypass safety alignment. Existing approaches, such as signature- and perplexity-based methods, rely heavily on pattern matching, making them insufficient to detect sophisticated, cross-modal PI payloads. In this paper, we…

Read at arXiv (research papers)

arXiv (research papers) Peiyang Liu SI

Protection Is Not One Event: A Survey of RAG Protection Research by Measured Endpoint

Retrieval-augmented generation (RAG) systems face security, privacy, and copyright risks including content leakage, source reconstruction, unauthorized access, data poisoning, and prompt injection. Yet RAG protection studies use incompatible evaluation metrics, datasets, and threat models. We present a systematic survey and human-coded evidence map of 118 full-text-confirmed RAG defense papers, organized by measured endpoint rather than claimed goal or defense mechanism. Our…

Read at arXiv (research papers)

arXiv (research papers) Amelia Kawasaki SI

Attention-based Classification for Indirect Prompt Injection

Indirect prompt injection (IPI) attacks, in which adversarial instructions are embedded in external data processed by a language model, pose a significant threat to the integrity of deployed LLM agents. Attention Tracker (Hung et al., 2025) is a recently proposed white-box detection method that identifies prompt injection attacks by monitoring how a model's attention is distributed between user task tokens and data tokens, claiming dataset-agnostic detection via a scalar…

Read at arXiv (research papers)

arXiv (research papers) Pedro H. Barcha Correia SI

Combining Long-Term Memory and LLMs Comes at a High Cost: From Prompt Injection to Persistent Compromise

The widespread adoption of generative artificial intelligence in recent years has brought a parallel rise in prompt injection and jailbreak attacks. By embedding malicious instructions, these exploits manipulate language models to bypass intended behavior and operational boundaries. In traditional chatbots, such attacks are confined to a single session because state memory is not preserved across conversations. However, persistent memory features in modern conversational…

Read at arXiv (research papers)

arXiv (research papers) Zhiyue Xu SI

After the Attacker Leaves: Benchmarking Carryover Attacks on LLM Agents

Modern LLM agents persist state across sessions via two channels: long-lived memory files silently prepended to the system prompt, and scheduled tasks waking the agent without user input. A one-time indirect prompt injection committed to either channel can re-fire across sessions long after the attacker leaves, threats we term carryover attacks. Existing prompt-injection benchmarks evaluate attacks only in the session where malicious content is first observed, leaving the…

Read at arXiv (research papers)

arXiv (research papers) Abhishek Rai SI

Context-Aware Prompt Injection Detection via Small Language Models in RAG Pipelines: nokast-secureRAG

Local Retrieval-Augmented Generation (RAG) systems are vulnerable to indirect prompt injection and retrieval poisoning, where malicious instructions in retrieved content are mistaken for trusted input. We present nokast-secureRAG, a roughly 0.5B-parameter small language model that acts as a semantic firewall between retrieval and generation. It jointly evaluates the user query and retrieved context, classifying the pair as safe, suspicious, or malicious. The model is trained…

Read at arXiv (research papers)

Hacker News denn-gubsky SI

Decision model as prompt-injection judge: 40 of 40 on 78 texts

Article URL: https://loomcycle.dev/blog/decision-model-as-prompt-injection-judge Comments URL: https://news.ycombinator.com/item?id=50166532 Points: 1 # Comments: 0

Read at Hacker News

Hacker News Hiskias SI

Building a System One Model for Prompt Injection

Article URL: https://www.stackone.com/blog/system-one-model-prompt-injection/ Comments URL: https://news.ycombinator.com/item?id=50165645 Points: 2 # Comments: 0

Read at Hacker News

Hacker News regsiren SI

Show HN: SentinelGate – Drop prompt injections at Token 0 before LLM inference

Article URL: https://sentinelgate.dev Comments URL: https://news.ycombinator.com/item?id=50165432 Points: 1 # Comments: 0

Read at Hacker News

arXiv (research papers) Mengxiao Wang SI

Fake News, Real Crashes: Information Injection Attacks on LLM Financial Trading Agents

Large language model (LLM) agents now trade real capital using news as evidence, yet they cannot reliably tell fabricated headlines from real news. Because they read the same feeds under near-identical policies, a single fabricated post can push them into the same trade at the same moment. We present a systematic attack benchmark for information injection against LLM trading agents. Unlike prompt injection, which targets the model's instructions, information injection…

Read at arXiv (research papers)

arXiv (research papers) Yinxiang Wang SI

SpanGuard: Decoupling Instruction Localization from Authorization for Lightweight IPI Defense

LLM-based guardrails are effective against indirect prompt injection (IPI), but their performance depends heavily on model capability: as the guardrail model becomes smaller or weaker, detection degrades substantially. This raises a natural question: can we retain strong IPI defense while relying only on a small LLM? To understand why, we revisit what an LLM guardrail actually does. Detecting IPI requires simultaneously locating potentially injected instructions within…

Read at arXiv (research papers)

Older stories