**Model stealing.** As language models become more and more valuable, they are hidden behind increasingly stringent safeguards. Research into'model stealing' aims to explore how models themselves can be replicated via API queries (Tramer et al., 2016). Stealing NLP models has been demonstrated in many domains: linear text-based classification (Lowd and Meek, 2005), language classification (Pal et al., 2019; Krishna et al., 2020), machine translation Wallace et al. (2021), and even text retreival (Dziedzic et al., 2023). Recent work Gudibande et al. (2023) suggests that this form of imitation may create models that replicate surface-level syntax but do not learn more complex attributes like knowledge or factuality. Different than these works, we do not focus on reconstructing model weights from third-party model outputs, but finding a hidden prompt from outputs of a third-party model.