Join us for a day of insightful discussions on building AI systems that are both collaborative and trustworthy, bringing together leading experts to bridge the gap between multi-agent systems, human-AI teaming, and rigorous safety mechanisms. We will explore high-stakes scenarios such as strategic agents optimizing public health interventions and AI co-pilots autonomously negotiating consensus in large-scale collectives. Realizing this vision requires integrating modern generative capabilities with foundational decision-making frameworks, including security games, automated negotiation, and interactive learning. This workshop focuses on the algorithmic breakthroughs needed to transform these powerful models into robust partners capable of planning over long horizons and coordinating safely in the real world.