Tag Archives: scrapy

Using Scrapy-GUI In Your Scrapy Shell

Posted on January 24, 2020 by Roy

I spent my Christmas break working on my first python package – Scrapy-GUI. This package is an addon for the scrapy shell that gives you a graphical user interface for writing and testing scrapy queries and processors. This blog is going to focus on how the tools tab works and how you can utilise it to help build your scrapy web spiders. Continue reading →

Posted in Python, scrapy, tutorial, webscraping | Tagged , , , | Leave a comment

Are your selectors not returning expected content when webscraping?

Posted on December 29, 2019 by Roy

I’ve taken a shine to posting on the /r/learnpython subreddit recently and I have a noticed a trend over the last few days – quite a lot of people seem to be using the Holiday break to learn how to … Continue reading →

Posted in General Tips, Python, tutorial, Uncategorized, webscraping | Tagged , , , , , , , | Leave a comment