Q:

Scraping javascript rendered HTML page in python

I am scraping a website using python, but the website is being rendered with javascript and all the links are coming from javascript. So when I use request.get(url) it's only giving the source code, not the other links that are generated with javascript. Is there any way to scrape those links automatically?
I also tried something like what's described here: Ultimate guide for scraping JavaScript rendered web pages. But that is too slow to load.
So is there any faster way, using Mechanize, Phantom or some other library?
(Note: I have already tried using PyQ4, but that is too slow - I'm looking for a faster solution).

A:

You can Try PhantomJs or Casperjs

There are more node wrappers written over phantom and casperjs one of the most efficient and scalable is "ghost town"

