A library to train language models with reinforcement learning.