Tag Archives: scrapy

Using Scrapy-GUI In Your Scrapy Shell

I spent my Christmas break working on my first python package – Scrapy-GUI. This package is an addon for the scrapy shell that gives you a graphical user interface for writing and testing scrapy queries and processors. This blog is going to focus on how the tools tab works and how you can utilise it to help build your scrapy web spiders. Continue reading

Posted in Python, scrapy, tutorial, webscraping | Tagged , , , | Leave a comment

Are your selectors not returning expected content when webscraping?

I’ve taken a shine to posting on the /r/learnpython subreddit recently and I have a noticed a trend over the last few days – quite a lot of people seem to be using the Holiday break to learn how to … Continue reading

Posted in General Tips, Python, tutorial, Uncategorized, webscraping | Tagged , , , , , , , | Leave a comment