@inproceedings{
maziarz2023reevaluating,
title={Re-evaluating Retrosynthesis Algorithms with Syntheseus},
author={Krzysztof Maziarz and Austin Tripp and Guoqing Liu and Megan Stanley and Shufang Xie and Piotr Gai{\'n}ski and Philipp Seidl and Marwin Segler},
booktitle={NeurIPS 2023 AI for Science Workshop},
year={2023},
url={https://openreview.net/forum?id=W5U18rgtpg}
}
The planning of how to synthesize molecules, also known as retrosynthesis, has been a growing focus of the machine learning and chemistry communities in recent years. Despite the appearance of steady progress, we argue that imperfect benchmarks and inconsistent comparisons mask systematic shortcomings of existing techniques. To remedy this, we present a benchmarking library called syntheseus which promotes best practice by default, enabling consistent meaningful evaluation of single-step and multi-step retrosynthesis algorithms. We use syntheseus to re-evaluate a number of previous retrosynthesis algorithms, and find that the ranking of state-of-the-art models changes when evaluated carefully. We end with guidance for future works in this area.
Re-evaluating Retrosynthesis Algorithms with Syntheseus
Krzysztof Maziarz Austin Tripp Guoqing Liu Megan Stanley Shufang Xie Piotr Gaiński Philipp Seidl Marwin Segler