VMAS is a comprehensive toolkit for building and training multi-agent systems using deep reinforcement learning. It supports GPU-based parallel simulation of hundreds of environment instances, enabling high-throughput data collection and scalable training. VMAS includes implementations of popular MARL algorithms like PPO, MADDPG, QMIX, and COMA, along with modular policy and environment interfaces for rapid prototyping. The framework facilitates centralized training with decentralized execution (CTDE), offers customizable reward shaping, observation spaces, and callback hooks for logging and visualization. With its modular design, VMAS seamlessly integrates with PyTorch models and external environments, making it ideal for research in cooperative, competitive, and mixed-motive tasks across robotics, traffic control, resource allocation, and game AI scenarios.

Aurora Innovation specializes in creating cutting-edge AI technology for self-driving vehicles. Their systems leverage deep learning and robotics to enhance perception, planning, and control, enabling cars to navigate safely and efficiently in various conditions. Aurora’s software integrates with existing vehicle platforms, offering manufacturers a reliable route to autonomy while focusing on real-world testing and safety.

Embedded BDI provides a full BDI lifecycle engine: it models an agent’s beliefs about its environment, manages evolving desires or goals, selects intentions from a library of plans, and executes behaviors in real time. The framework includes modules for belief base storage, plan library definition, event triggering, and concurrency control tailored for memory-limited microcontrollers. With a simple API, developers annotate beliefs, specify desires, and implement plans in code. Its scheduler handles priority-based intention execution and integrates with hardware interfaces for sensors, actuators, and network communication, making it ideal for autonomous IoT devices, mobile robots, and industrial controllers.

VacuumWorld is an open-source simulation platform designed to facilitate the development and evaluation of multi-agent reinforcement learning algorithms. It provides grid-based environments where virtual vacuum cleaner agents operate to detect and remove dirt patches across customizable layouts. Users can adjust parameters such as grid size, dirt distribution, stochastic movement noise, and reward structures to model diverse scenarios. The framework includes built-in support for agent communication protocols, real-time visualization dashboards, and logging utilities for performance tracking. With simple Python APIs, researchers can quickly integrate their RL algorithms, compare cooperative or competitive strategies, and conduct reproducible experiments, making VacuumWorld ideal for academic research and teaching.

Stemrobo is designed to promote STEM education through a hands-on approach, enabling students and educators to create, program, and control robots. It offers a user-friendly interface that guides users through various projects, providing resources and support to foster learning in science, technology, engineering, and mathematics. With features such as coding assistance, robotics simulation and real-time interaction, Stemrobo makes complex concepts accessible to learners of all ages.

ePH-MAPF provides an efficient pipeline for computing collision-free paths for dozens to hundreds of agents on grid-based maps. It uses prioritized heuristics, incremental search techniques, and customizable cost metrics (Manhattan, Euclidean) to balance speed and solution quality. Users can select between different heuristic functions, integrate the library into Python-based robotics systems, and benchmark performance on standard MAPF scenarios. The codebase is modular and well-documented, enabling researchers and developers to extend it for dynamic obstacles or specialized environments.