You're exactly right.  I remember Colorado, one of the first state to legalize weed, was also the first two complain about the homeless flocking to THEIR state.  Here is the 2014 article.
https://www.cbsnews.com/news/legal-marijuana-drawing-homeless-to-colorado/