Practices for Governing Agentic AI Systems
Captured source
source ↗Practices for Governing Agentic AI Systems | OpenAI
December 14, 2023
Practices for Governing Agentic AI Systems
Read paper Apply for agentic AI research grant
Loading…
Share
Abstract
Agentic AI systems—AI systems that can pursue complex goals with limited direct supervision—are likely to be broadly useful if we can integrate them responsibly into our society. While such systems have substantial potential to help people more efficiently and effectively achieve their own goals, they also create risks of harm. In this white paper, we suggest a definition of agentic AI systems and the parties in the agentic AI system life-cycle, and highlight the importance of agreeing on a set of baseline responsibilities and safety best practices for each of these parties. As our primary contribution, we offer an initial set of practices for keeping agents’ operations safe and accountable, which we hope can serve as building blocks in the development of agreed baseline best practices. We enumerate the questions and uncertainties around operationalizing each of these practices that must be addressed before such practices can be codified. We then highlight categories of indirect impacts from the wide-scale adoption of agentic AI systems, which are likely to necessitate additional governance frameworks.
Agentic AI research grant program
We are launching a program to award grants of between $10,000 – $100,000 to fund research into the impacts of agentic AI systems and practices for making them safe.
The grant program is now closed.
- Ethics & Safety
- Reasonings & Policy
- Community & Collaboration
Lead authors
Yonadav Shavit, Sandhini Agarwal, Miles Brundage
Contributing authors
Steven Adler, Cullen O’Keefe, Rosie Campbell, Teddy Lee, Pamela Mishkin, Tyna Eloundou, Alan Hickey, Katarina Slama, Lama Ahmad, Paul McMillan, Andrea Vallone, Alexandre Passos, David G. Robinson
Related articles
Disrupting malicious uses of AI by state-affiliated threat actorsSecurityFeb 14, 2024
Building an early warning system for LLM-aided biological threat creationPublicationJan 31, 2024
Democratic inputs to AI grant program: lessons learned and implementation plansSafetyJan 16, 2024