Detecting Adversarial Prompts in Business Context
Joshua Kehrer · Team Joshua Kehrer & Joshua Quenzer-Hohmuth
Submitted to AI Manipulation Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.
This work examines how strategically framed user inputs can manipulate AI systems in organizational settings. It investigates whether such manipulation-inducing inputs can be detected before model execution through a lightweight pre-processing layer. The study frames input filtering as a risk-management and governance challenge rather than a purely technical fix.
Reviews
Shifting the focus from technical jailbreaks to 'business context' manipulation (like urgency or authority framing) is a smart, novel approach. While the initial validation on ~38 samples serves as a good proof-of-concept for the hackathon, I would love to see this expanded to a larger dataset in future iterations to better support the generalization claims. Additionally, verifying the results against human-authored data (e.g., Enron or real phishing logs) would be a fantastic next step to mitigate the risk of circularity inherent in synthetic testing. Great concept that addresses a real gap.
Excellent work overall!
Cite this project
@misc{kehrer2026detecting,
title = {{Detecting Adversarial Prompts in Business Context}},
author = {Joshua Kehrer},
year = {2026},
month = jan,
note = {Submitted to AI Manipulation Hackathon, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/detecting-adversarial-prompts-in-business-context-wv35}},
url = {https://apartresearch.com/sprints/projects/detecting-adversarial-prompts-in-business-context-wv35}
}More from AI Manipulation Hackathon
- 1st placeView project: Who Does Your AI Serve? Manipulation By and Of AI Assistants
Who Does Your AI Serve? Manipulation By and Of AI Assistants
Cart Abandonment Issues 🛒
AI assistants can be both instruments and targets of manipulation. In our project, we investigated both directions across three studies. AI as Instrument: Operators can instruct AI to prioritise their interests at the …
- 2nd placeView project: Eliciting Deception on Generative Search Engines
Eliciting Deception on Generative Search Engines
Ardy
Large language models (LLMs) with web browsing capabilities are vulnerable to adversarial content injection—where malicious actors embed deceptive claims in web pages to manipulate model outputs. We investigate whether …
- 3rd placeView project: Cross-Linguistic Sycophancy in Frontier LLMs: A Benchmark Study
Cross-Linguistic Sycophancy in Frontier LLMs: A Benchmark Study
Talex
We developed a cross-linguistic sycophancy benchmark testing whether frontier AI models exhibit different manipulation behaviours across English, Japanese, and Bengali. Our results show significant language-dependent …