Code accompanying the paper: "DeepAveragers: Offline Reinforcement Learning by Solving Derived Non-Parametric MDPs" Installation pip install -r requirements.txt pip instlal -e .