General Pervasiveness
Andres Sepulveda Morales, Patrick Huang · Team Andres and Patrick
Submitted to AI capabilities and risks demo-jam. Sprint projects are early-stage work by participants, not Apart Research publications.
Imposter scam between patients and medical practices/GPs
Reviews
Demo didn’t show me things that weren’t possible before. I think showing amazing TTS and good conversational fluidity could have been helpful but wasn’t done. I think one could demo the later through playing through different scripts/typical behaviours. So far I am not more impressed by it than by “a call centre” doing same things.Another way to show how things are different now is to demonstrate cost-effectiveness, e.g., make a plausible BOTEC about cost reduction once again benchmarking against “a call centre.” Relatedly, it’s interesting to ask ourselves why this impersonation scam more widespread today? What’s limiting criminals in using AI systems like that? How can we engineer around that?
I feel like the idea of this demonstration is good, an AI impersonating your own GP for instance could be a real problem. However, I feel like the demonstration as it is does not really show how this scenario is different from current scams and how AI plays a part in that.
Cite this project
@misc{morales2024general,
title = {{General Pervasiveness}},
author = {Andres Sepulveda Morales and Patrick Huang},
year = {2024},
month = aug,
note = {Submitted to AI capabilities and risks demo-jam, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/general-pervasiveness}},
url = {https://apartresearch.com/sprints/projects/general-pervasiveness}
}More from AI capabilities and risks demo-jam
- 1st place by peer reviewView project: Speculative Consequences of A.I. Misuse
Speculative Consequences of A.I. Misuse
Team S.C.A.M.
This project uses A.I. Technology to spoof an influential online figure, Mr Beast, and use him to promote a fake scam website we created.
- View project: Demonstrating LLM Code Injection Via Compromised Agent Tool
Demonstrating LLM Code Injection Via Compromised Agent Tool
This project demonstrates the vulnerability of AI-generated code to injection attacks by using a compromised multi-agent tool that generates Svelte code. The tool shows how malicious code can be injected during the code …
- View project: Phish Tycoon: phishing using voice cloning
Phish Tycoon: phishing using voice cloning
Phish Tycoon
This project is a public service announcement highlighting the risks of voice cloning, an AI technology capable of creating synthetic voices nearly indistinguishable from real ones. The demo involves recording a user's …