My Social Media
Recent Posts: Further Reading
Bots
Tags
Archives
Meta
Donate
Author Archives: Roy
Parsing Javascript and APIs with ChompJS and JMESPath
I just published a new webscraping video – Parsing Javascript and APIs with ChompJS and JMESPath. Check it out below! Continue reading
Posted in Uncategorized
Leave a comment
Scraping Dynamic Websites WITHOUT Selenium
I’ve published a YouTube video to cover troubleshooting tips when dealing with dynamic websites, a topic I covered here before. Check it out below! I’ve been really enjoying making video/streaming content like this, if you want to see more of … Continue reading
Posted in Uncategorized
Leave a comment
Getting Names Of Your Patreon Patrons From The Patreon API
A common Patreon reward is to list patron names in the credits for your creations – on my patreon I have this on any tier more than €3. In order to implement this I used the patreon api python package … Continue reading
Patreon Announcement + Dicecord-CoD Prefix Update
I’m excited to announce that I am on Patreon now! If you want to support any of my current or future projects please pop by! I’m hoping I can use this to offset my Dicecord/blog hosting costs, as well as … Continue reading
Scrapy-GUI updated to version 1.1
Scrapy-GUI updated to version 1.1. Continue reading
Posted in Uncategorized
Leave a comment
Using Scrapy-GUI In Your Scrapy Shell
I spent my Christmas break working on my first python package – Scrapy-GUI. This package is an addon for the scrapy shell that gives you a graphical user interface for writing and testing scrapy queries and processors. This blog is going to focus on how the tools tab works and how you can utilise it to help build your scrapy web spiders. Continue reading
Posted in Python, scrapy, tutorial, webscraping
Tagged Python 3, scrapy, tutorial, webscraping
Leave a comment
Are your selectors not returning expected content when webscraping?
I’ve taken a shine to posting on the /r/learnpython subreddit recently and I have a noticed a trend over the last few days – quite a lot of people seem to be using the Holiday break to learn how to … Continue reading
Posted in General Tips, Python, tutorial, Uncategorized, webscraping
Tagged beautifulsoup, bs4, python, Python 3, scrapy, tips, tutorial, webscraping
Leave a comment
I got a QR Code Tattoo!
I got my first ever tattoo this week. This is something I had been considering for a long while – about 5 years. I wanted something that reflected my obsession with technology, something that looked cool but also had a … Continue reading
ELI5 Tutorial: Unit Testing with unittest
I lied in my last post. I have decided to do one more ELI5, this time for Unit Tests. I decided to do this to help my classmates – Google is running a code retreat tomorrow at my university and … Continue reading
ELI5 Tutorial: Subclassing Objects in Python
So, this ELI5 has been sitting in my drafts folder for a while. Not sure how that happened there! Woops! After some delay, here is the final EL15 for now – how to subclass an object!