Gym-Recsys is a toolbox that wraps recommendation tasks into OpenAI Gym environments, allowing reinforcement learning algorithms to interact with simulated user-item matrices step by step. It provides synthetic user behavior generators, supports loading popular datasets, and delivers standard recommendation metrics like Precision@K and NDCG. Users can customize reward functions, user models, and item pools to experiment with different RL-based recommendation strategies in a reproducible manner.

GridWorldEnvs offers a comprehensive suite of grid-world environments to support the design, testing, and benchmarking of reinforcement learning and multi-agent systems. Users can easily configure grid dimensions, agent start positions, goal locations, obstacles, reward structures, and action spaces. The library includes ready-to-use templates such as classic grid navigation, obstacle avoidance, and cooperative tasks, while also allowing custom scenario definitions via JSON or Python classes. Seamless integration with the OpenAI Gym API means that standard RL algorithms can be applied directly. Additionally, GridWorldEnvs supports single-agent and multi-agent experiments, logging, and visualization utilities for tracking agent performance.

gym-fx is an open-source Python library that implements a simulated Forex trading environment using the OpenAI Gym interface. It offers support for multiple currency pairs, integration of historical price feeds, technical indicators, and fully customizable reward functions. By providing a standardized API, gym-fx simplifies the process of benchmarking and developing reinforcement learning algorithms for algorithmic trading. Users can configure market slippage, transaction costs, and observation spaces to closely mimic live trading scenarios, facilitating robust strategy development and evaluation.

gym-llm extends the OpenAI Gym ecosystem to large language models by defining text-based environments where LLM agents interact through prompts and actions. Each environment follows Gym’s step, reset, and render conventions, emitting observations as text and accepting model-generated responses as actions. Developers can craft custom tasks by specifying prompt templates, reward calculations, and termination conditions, enabling sophisticated decision-making and conversational benchmarks. Integration with popular RL libraries, logging tools, and configurable evaluation metrics facilitates end-to-end experimentation. Whether assessing an LLM’s ability to solve puzzles, manage dialogues, or navigate structured tasks, gym-llm provides a standardized, reproducible framework for research and development of advanced language agents.

gym-multigrid provides a suite of customizable gridworld environments designed for multi-room navigation and exploration tasks in reinforcement learning. Each environment consists of interconnected rooms populated with objects, keys, doors, and obstacles. Users can adjust grid size, room configurations, and object placements programmatically. The library supports both full and partial observation modes, offering RGB or matrix state representations. Actions include movement, object interaction, and door manipulation. By integrating it as a Gym environment, researchers can leverage any Gym-compatible agent, seamlessly training and evaluating algorithms on tasks like key-door puzzles, object retrieval, and hierarchical planning. gym-multigrid’s modular design and minimal dependencies make it ideal for benchmarking new AI strategies.

The mario-ai project offers a comprehensive pipeline for developing AI agents to master Super Mario Bros. using neuroevolution. By integrating a Python-based NEAT implementation with the OpenAI Gym SuperMario environment, it allows users to define custom fitness criteria, mutation rates, and network topologies. During training, the framework evaluates generations of neural networks, selects high-performing genomes, and provides real-time visualization of both gameplay and network evolution. Additionally, it supports saving and loading trained models, exporting champion genomes, and generating detailed performance logs. Researchers, educators, and hobbyists can extend the codebase to other game environments, experiment with evolutionary strategies, and benchmark AI learning progress across different levels.

Multi-Agent Drone Environment is a Python package offering a customizable multi-agent simulation for UAV swarms, built on OpenAI Gym and PyBullet. Users define multiple drone agents with kinematic and dynamic models to explore cooperative tasks such as formation flying, target tracking, and obstacle avoidance. The environment supports modular task configuration, realistic collision detection, and sensor emulation, while allowing custom reward functions and decentralized policies. Developers can integrate their own reinforcement learning algorithms, evaluate performance under varied scenarios, and visualize agent trajectories and metrics in real time. Its open-source design encourages community contributions, making it ideal for research, teaching, and prototyping advanced multi-agent control solutions.

multiagent_envs delivers a modular set of Python-based environments tailored for multi-agent reinforcement learning research and development. It includes scenarios like cooperative navigation, predator-prey, social dilemmas, and competitive arenas. Each environment lets you define the number of agents, observation features, reward functions, and collision dynamics. The framework integrates seamlessly with popular RL libraries such as Stable Baselines and RLlib, allowing vectorized training loops, parallel execution, and easy logging. Users can extend existing scenarios or create new ones by following a simple API, accelerating experimentation with algorithms like MADDPG, QMIX, and PPO in a consistent, reproducible setup.

NavGround Learning provides a comprehensive toolkit for developing and benchmarking reinforcement learning agents in navigation tasks. It supports multi-agent simulation, collision modeling, and customizable sensors and actuators. Users can select from predefined policy templates or implement custom architectures, train with state-of-the-art RL algorithms, and visualize performance metrics. Its integration with OpenAI Gym and Stable Baselines3 simplifies experiment management, while built-in logging and visualization tools allow in-depth analysis of agent behavior and training dynamics.

PyGame Learning Environment (PLE) is an open-source Python framework designed to simplify the development, testing, and benchmarking of reinforcement learning agents within custom game scenarios. It provides a collection of lightweight Pygame-based games with built-in support for agent observations, discrete and continuous action spaces, reward shaping, and environment rendering. PLE features an easy-to-use API compatible with OpenAI Gym wrappers, enabling seamless integration with popular RL libraries such as Stable Baselines and TensorForce. Researchers and developers can customize game parameters, implement new games, and leverage vectorized environments for accelerated training. With active community contributions and extensive documentation, PLE serves as a versatile platform for academic research, education, and real-world RL application prototyping.

MultiAgentModel provides a unified API to define custom environments and agent classes for multi-agent scenarios. Developers can specify observation and action spaces, reward structures, and communication channels. Built-in support for popular RL algorithms like PPO, DQN, and A2C allows training with minimal configuration. Real-time visualization tools help monitor agent interactions and performance metrics. The modular architecture ensures easy integration of new algorithms and custom modules. It also includes a flexible configuration system for hyperparameter tuning, logging utilities for experiment tracking, and compatibility with OpenAI Gym environments for seamless portability. Users can collaborate on shared environments and replay logged sessions for analysis.

DeepMind MAS Environment is a Python library that provides a standardized interface for building and simulating multi-agent reinforcement learning tasks. It allows users to configure number of agents, define observation and action spaces, and customize reward structures. The framework supports agent-to-agent communication channels, performance logging, and rendering capabilities. Researchers can seamlessly integrate DeepMind MAS Environment with popular RL libraries such as TensorFlow and PyTorch to benchmark new algorithms, test communication protocols, and analyze both discrete and continuous control domains.

NKC Multi-Agent Models provides researchers and developers with a comprehensive toolkit for designing, training, and evaluating multi-agent reinforcement learning systems. It features a modular architecture where users define custom agent policies, environment dynamics, and reward structures. Seamless integration with OpenAI Gym allows for rapid prototyping, while support for TensorFlow and PyTorch enables flexibility in selecting learning backends. The framework includes utilities for experience replay, centralized training with decentralized execution, and distributed training across multiple GPUs. Extensive logging and visualization modules capture performance metrics, facilitating benchmarking and hyperparameter tuning. By simplifying the setup of cooperative, competitive, and mixed-motive scenarios, NKC Multi-Agent Models accelerates experimentation in domains such as autonomous vehicles, robotic swarms, and game AI.

Vanilla Agents is a lightweight PyTorch-based framework that delivers modular and extensible implementations of core reinforcement learning agents. It supports algorithms like DQN, Double DQN, PPO, and A2C, with pluggable environment wrappers compatible with OpenAI Gym. Users can configure hyperparameters, log training metrics, save checkpoints, and visualize learning curves. The codebase is organized for clarity, making it ideal for research prototyping, educational use, and benchmarking new ideas in RL.

The YGO-Agent framework allows researchers and enthusiasts to develop AI bots that play the Yu-Gi-Oh card game using reinforcement learning. It wraps the YGOPRO game simulator into an OpenAI Gym-compatible environment, defining state representations such as hand, field, and life points, and action representations including summoning, spell/trap activation, and attacking. Rewards are based on win/loss outcomes, damage dealt, and game progress. The agent architecture uses PyTorch to implement DQN, with options for custom network architectures, experience replay, and epsilon-greedy exploration. Logging modules record training curves, win rates, and detailed move logs for analysis. The framework is modular, enabling users to replace or extend components such as the reward function or action space.

GYM_XPLANE_ML wraps the X-Plane flight simulator as an OpenAI Gym environment, exposing throttle, elevator, aileron and rudder controls as action spaces and flight parameters like altitude, speed, and orientation as observations. Users can script training workflows in Python, select predefined scenarios or customize waypoints, weather conditions, and aircraft models. The library handles low-latency communication with X-Plane, runs episodes in synchronous mode, logs performance metrics, and supports real-time rendering for debugging. It enables iterative development of ML-driven autopilots and experimental RL algorithms in a high-fidelity flight environment.

The Beer Game Environment provides a discrete-time simulation of a four-stage beer supply chain—retailer, wholesaler, distributor, and manufacturer—exposing an OpenAI Gym interface. Agents receive observations including on-hand inventory, pipeline stock, and incoming orders, then output order quantities. The environment computes per-step costs for inventory holding and backorders, and supports customizable demand distributions and lead times. It integrates seamlessly with popular RL libraries like Stable Baselines3, enabling researchers and educators to benchmark and train algorithms on supply chain optimization tasks.

Fast Reinforcement Learning is a specialized Python framework designed to accelerate the development and execution of reinforcement learning agents. It offers out-of-the-box support for popular algorithms such as PPO, A2C, DDPG and SAC, combined with high-throughput vectorized environment management. Users can easily configure policy networks, customize training loops and leverage GPU acceleration for large-scale experiments. The library’s modular design ensures seamless integration with OpenAI Gym environments, enabling researchers and practitioners to prototype, benchmark and deploy agents across a variety of control, game and simulation tasks.

Deep Trading Agent provides a complete pipeline for algorithmic trading: data ingestion, environment simulation compliant with OpenAI Gym, deep RL model training (e.g., DQN, PPO, A2C), performance visualization, backtesting on historical data, and live deployment through broker API connectors. Users can define custom reward metrics, tune hyperparameters, and monitor agent performance in real time. The modular architecture supports stocks, forex, and cryptocurrency markets and allows seamless extension to new asset classes.