Some researchers evaluate their agent implementations on the typical LLM benchmarks. Emerging research indicates that there is significant data contamination in the model's training data, supported by the observation that a model's performance significantly worsens when benchmark questions are modified [8; 38; 37]. This raises doubts on the authenticity of benchmark scores for both the language models and language model powered agents.