Simulation Operators: The Next Level of the Annotation Business
Ardy Haroen · Team Ardy
Submitted to Hackathon for Technical AI Safety Startups. Sprint projects are early-stage work by participants, not Apart Research publications.
We bet on agentic AI being integrated into other domains within the next few years: healthcare, manufacturing, automotive, etc., and the way it would be integrated is into cyber-physical systems, which are systems that integrate the computer brain into a physical receptor/actuator (e.g. robots). As the demand for cyber-physical agents increases, so would be the need to train and align them. We also bet on the scenario where frontier AI and robotics labs would not be able to handle all of the demands for training and aligning those agents, especially in specific domains, therefore leaving opportunities for other players to fulfill the requirements for training those agents: providing a dataset of scenarios to fine-tune the agents and providing the people to give feedback to the model for alignment. Furthermore, we also bet that human intervention would still be required to supervise deployed agents, as demanded by various regulations. Therefore leaving opportunities to develop supervision platforms which might highly differ between different industries.
Reviews
No public critique yet.
Cite this project
@misc{haroen2024simulation,
title = {{Simulation Operators: The Next Level of the Annotation Business}},
author = {Ardy Haroen},
year = {2024},
month = sep,
note = {Submitted to Hackathon for Technical AI Safety Startups, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/simulation-operators-the-next-level-of-the-annotation-business}},
url = {https://apartresearch.com/sprints/projects/simulation-operators-the-next-level-of-the-annotation-business}
}More from Hackathon for Technical AI Safety Startups
- 1st place by peer reviewView project: DarkForest - Defending the Authentic and Humane Web
DarkForest - Defending the Authentic and Humane Web
DarkForest
DarkForest is a pioneering Human Content Verification System (HCVS) designed to safeguard the authenticity of online spaces in the face of increasing AI-generated content. By leveraging graph-based reinforcement …
- View project: Jailbreaking general purpose robots
Jailbreaking general purpose robots
Luax Labs
We show that state of the art LLMs can be jailbroken by adversarial multimodal inputs, and that this can lead to dangerous scenarios if these LLMs are used as planners in robotics. We propose finetuning small multimodal …
- View project: AI Safety Collective - Crowdsourcing Solutions for Critical AI Safety Challenges
AI Safety Collective - Crowdsourcing Solutions for Critical AI Safety Challenges
AI Safety Collective
The AI Safety Collective is a global platform designed to enhance AI safety by crowdsourcing solutions to critical AI Safety challenges. As AI systems like large language models and multimodal systems become more …