Speculative Consequences of A.I. Misuse
Joseph Karam, Charlie Nguyen, Andrew Lam · Team S.C.A.M.
Submitted to AI capabilities and risks demo-jam. Sprint projects are early-stage work by participants, not Apart Research publications.
This project uses A.I. Technology to spoof an influential online figure, Mr Beast, and use him to promote a fake scam website we created.
Reviews
Cool presentation! I think it’s plausible that making/promoting these videos and rick rolling people might be a good way to spread the message. Good job!
Cool project! The deepfake video is solid, the scenario is plausible, and I like the attention to detail. Also, the UI replication of Youtube+Google auth substantially increases the emotionally impact of the demo. It’s also entertaining, which matters a lot for public consumption of a demo like this. While the chat part does introduce some interactivity, some additional personalization could also increase emotional impact.
This is great!The mockup for youtube and gmail are very good, and the faceswap on MrBeast is very impressive. I feel like this demo does a very good job demonstrating the erosion of trust that AI will create and how easy this kind of attacks will be in the future
Cite this project
@misc{karam2024speculative,
title = {{Speculative Consequences of A.I. Misuse}},
author = {Joseph Karam and Charlie Nguyen and Andrew Lam},
year = {2024},
month = aug,
note = {Submitted to AI capabilities and risks demo-jam, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/speculative-consequences-of-a-i-misuse}},
url = {https://apartresearch.com/sprints/projects/speculative-consequences-of-a-i-misuse}
}More from AI capabilities and risks demo-jam
- View project: Demonstrating LLM Code Injection Via Compromised Agent Tool
Demonstrating LLM Code Injection Via Compromised Agent Tool
This project demonstrates the vulnerability of AI-generated code to injection attacks by using a compromised multi-agent tool that generates Svelte code. The tool shows how malicious code can be injected during the code …
- View project: Phish Tycoon: phishing using voice cloning
Phish Tycoon: phishing using voice cloning
Phish Tycoon
This project is a public service announcement highlighting the risks of voice cloning, an AI technology capable of creating synthetic voices nearly indistinguishable from real ones. The demo involves recording a user's …
- View project: Misinformational AI-Generated Academic Papers
Misinformational AI-Generated Academic Papers
The Fake Academics
This study explores the potential for generative AI to produce convincing fake research papers, highlighting the growing threat of AI-generated misinformation. We demonstrate a semi-automated pipeline using large …