\(\bullet\)_Claude 2, ChatGPT and Davinci003 perform better on interaction with environment and tool manipulation tasks._ On the two evaluation tasks, Claude 2, ChatGPT and Davinci003, perform better than other models by a large margin, _e.g.,_ 36.40 (Claude 2) _vs._ 26.00 (Davinci002) on HotpotQA, 44.53 (ChatGPT) _vs._ 7.74 (Claude) on Gorilla-TF, and 72.58 (Davinci003) _vs._ 22.04 (Claude) on Gorilla-TH. A possible reason is that these three models have been specially optimized towards these advanced abilities, _e.g.,_ supporting the use of external plugins.