FYI: At the most basic level, the fundamental difference between jail and prison is the length of stay for inmates. Think short-term and long-term. Jails are usually run by local law enforcement and/or local government agencies, and are designed to hold inmates awaiting trial or serving a short sentence.