@inproceedings{
mehta2023towards,
title={Towards {LLM}s as Operational Copilots for Fusion Reactors},
author={Viraj Mehta and Joseph Abbate and Allen Wang and Andrew Rothstein and Ian Char and Jeff Schneider and Egemen Kolemen and Cristina Rea and Darren Garnier},
booktitle={NeurIPS 2023 AI for Science Workshop},
year={2023},
url={https://openreview.net/forum?id=yGVChrbJ4E}
}
The tokamak is one of the most promising approaches for achieving nuclear fusion as an energy source. As such, many tokamaks have been built with rich experimental histories and datasets. While the quantitative data generated by tokamaks is invaluable, tokamaks also generate another, often underutilized data stream: text logs written by experimental operators. In this work, we leverage these extensive text logs by employing Retrieval-Augmented Generation (RAG) with state-of-the-art large language models (LLMs) to create a prototype "copilot". Instances of this copilot were created using text logs from the fusion experiments DIII-D and Alcator C-Mod and deployed for researchers to use. In this paper, we report on the datasets and methodology used to create this ``copilot", along with its performance on three use cases: 1) semantic search of experiments, 2) assisting with device-specific operations, and 3) answering general tokamak questions. Although we found via a survey of researchers that for general tokamak operations questions   RAG doesn't offer a clear advantage over the base GPT-4 model, in the first two use cases, we observe clear advantages that RAG offers over base LLMs and simple keyword search.
Towards LLMs as Operational Copilots for Fusion Reactors
Viraj Mehta Joseph Abbate Allen Wang Andrew Rothstein Ian Char Jeff Schneider Egemen Kolemen Cristina Rea Darren Garnier