Our research explores the extent to which a pre-trained Transformer-based Large Language Model (LLM) can perform similar multi-hop reasoning when completing a two-hop prompt. Given the complex nature of LLMs, which function through high-dimensional and distributed representations, it's unlikely for a single deterministic algorithm to govern their predictions except for under highly controlled and constrained setup [23, 24]. Instead, LLMs may use aggregations from multiple inference pathways [11], ranging from shallow \(n\)-gram co-occurrence-based matching to deeper rule-based reasoning or even multi-hop reasoning, to make a prediction.