Framework or no framework 
csuper: I think you should stick with the framework, at least until your requirements exceed the frameworks capabilities.There is always a simpler solution that you can one off.  But is it worth your time to reinvent the wheel?Also, I'm curious - were you able to do the same thing in Python that you did in Scrapy because you tried Scrapy first?