Apply to join Foresight Intelligent Cooperation program: https://foresight.org/intelligent-coo...
A group of scientists, engineers, and entrepreneurs in computer science, ML, cryptocommerce, and related fields who leverage those technologies to improve voluntary cooperation across humans, and ultimately AIs.

David Bloomin | Metta Learning - Love Is All You Need
David Bloomin, with over 20 years in software engineering, helped shape large-scale infrastructure and AI projects at early-stage Google, Facebook, and Asana. Now, he delves into multi-agent reinforcement learning and collective intelligence-inspired AI, also co-founding Plurality Institute to advance collective intelligence research. His work blends practical engineering with a quest to explore AI's broader potential.

This talk presents an innovative approach in AI research aimed at the development of generally-intelligent, alignable agents. Inspired by kin-selection theory, we use reward sharing to create dynamic, socially complex environments. We believe that training agents in these environments may lead to both general intelligence and cooperative behaviors.

Our approach centers on creating adaptable agents capable of handling unforeseen scenarios, beyond their training environments. This adaptability is achieved through a self-generating learning curriculum, which challenges agents without overwhelming them. A key aspect of our methodology is the introduction of a social dimension, where agents interact with and adapt to the actions of others. This mirrors real-world social complexities and shifts the learning focus from the simulated environment to the minds of other agents.
This setup encourages a diverse range of strategies, fostering continuous learning and adaptation. It explores the full spectrum between cooperation and competition, avoiding the pitfalls of stagnant overly adversarial behaviors.

The end goal is to create AI that not only exhibits advanced intelligence but also allows for intra-agent cooperation, a vital step towards AI alignment.

Challenge for Progress:
A crucial challenge in my field is engineering environments that effectively balance complexity and adaptability. These should prompt agents not only to develop advanced cognitive skills but also to navigate and cooperate within intricate social dynamics. Such environments would be instrumental in driving progress toward more adaptive and intelligent AI systems.
  / daveey  

Abstract: This talk presents an innovative approach in AI research aimed at the development of generally-intelligent, alignable agents. Inspired by kin-selection theory, we use reward sharing to create dynamic, socially complex environments. We believe that training agents in these environments may lead to both general intelligence and cooperative behaviors.

Our approach centers on creating adaptable agents capable of handling unforeseen scenarios, beyond their training environments. This adaptability is achieved through a self-generating learning curriculum, which challenges agents without overwhelming them. A key aspect of our methodology is the introduction of a social dimension, where agents interact with and adapt to the actions of others. This mirrors real-world social complexities and shifts the learning focus from the simulated environment to the minds of other agents.
This setup encourages a diverse range of strategies, fostering continuous learning and adaptation. It explores the full spectrum between cooperation and competition, avoiding the pitfalls of stagnant overly adversarial behaviors.

The end goal is to create AI that not only exhibits advanced intelligence but also allows for intra-agent cooperation, a vital step towards AI alignment.


══════════════════════════════════════

About The Foresight Institute

The Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1986 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support. From molecular nanotechnology, to brain-computer interfaces, space exploration, cryptocommerce, and AI, Foresight gathers leading minds to advance research and accelerate progress toward flourishing futures.

We are entirely funded by your donations. If you enjoy what we do please consider donating through our donation page: https://foresight.org/donate/

Visit https://foresight.org, subscribe to our channel for more videos or join us here:
• Twitter:   / foresightinst  
• Facebook:   / foresightinst  
• LinkedIn:   / foresight-institute