In this video we’ll be finishing off our crawler. We’ll be making the crawler follow the links that it finds on each website, then we’ll be piping the output to a JSON file that we can view in our browser.

Full Source Code: http://howco.de/crawler_source

Don’t forget to subscribe for more!