LLMs have many inherent limitations when it comes to reasoning, such as the inability to access external information, arithmetic errors, and inconsistent reasoning. These issues can be cleverly circumvented by entrusting specific responsibilities to dedicated modules or models.