You can contract it from exposure to the leaves for sure, but you can also get it from touching the dormant stems and even the root system.
Be careful when handling firewood from trees that may have had poison-ivy vines growing up them.