How should I pursue my passion?
vital101: I was lucky enough to find a job doing something that I love.  Have you given much thought to finding a full-time job where you could do 2D/3D real time graphics?  At the very least, you could be satisfied with the work you're doing AND have money to live on.  You could even go to grad school part-time and get started on that research you are so passionate about.  In any case, best of luck.