Furthermore, researchers have found that "As LLMs progress at a rapid pace, existing datasets usually fail to match the models' ever-evolving capabilities, because the complexity level of existing benchmarks is usually static and fixed" [37]. To address this, work has been done to create dynamic benchmarks that are resistant to simple memorization [38; 37]. Researchers have also explored the idea of generating an entirely synthetic benchmark based on a user's specific environment or use case [14; 27]. While these techniques can help with contamination, decreasing the level of human involvement can pose additional risks regarding correctness and the ability to solve problems.