D4rl

A collection of reference environments for offline reinforcement learning