@inproceedings{
tarasov2023offline,
title={Offline {RL} for generative design of protein binders},
author={Denis Tarasov and Ulrich Armel Mbou Sob and Miguel Arbes{\'u} and Nima H. Siboni and Sebastien Boyer and Andries Petrus Smit and Oliver Bent and Arnu Pretorius and Marcin J. Skwark},
booktitle={NeurIPS 2023 Workshop on New Frontiers of AI for Drug Discovery and Development},
year={2023},
url={https://openreview.net/forum?id=olMBz7gxls}
}
Offline Reinforcement Learning (RL) offers a compelling avenue for solving RL problems without the need for interactions with an environment, which may be expensive or unsafe. While online RL methods have found success in various domains, such as de novo Structure-Based Drug Discovery (SBDD), they struggle when it comes to optimizing essential properties derived from protein-ligand docking. The high computational cost associated with the docking process makes it impractical for online RL, which typically requires hundreds of thousands of interactions during learning. In this study, we propose the application of offline RL to address the bottleneck posed by the docking process, leveraging RL's capability to optimize non-differentiable properties. Our preliminary investigation focuses on using offline RL to conditionally generate drugs with improved docking and chemical properties.
Offline RL for generative design of protein binders
Denis Tarasov Ulrich Armel Mbou Sob Miguel Arbesú Nima H. Siboni Sebastien Boyer Andries Petrus Smit Oliver Bent Arnu Pretorius Marcin J. Skwark