Scrapy-GUI updated to version 1.1

I’ve just updated Scrapy-GUI to version 1.1.

Continue reading

Posted in Uncategorized | Leave a comment

Using Scrapy-GUI In Your Scrapy Shell

I spent my Christmas break working on my first python package – Scrapy-GUI. This package is an addon for the scrapy shell that gives you a graphical user interface for writing and testing scrapy queries and processors. This blog is going to focus on how the tools tab works and how you can utilise it to help build your scrapy web spiders.

Continue reading

Posted in Python, scrapy, tutorial, webscraping | Tagged , , , | Leave a comment

Are your selectors not returning expected content when webscraping?

I’ve taken a shine to posting on the /r/learnpython subreddit recently and I have a noticed a trend over the last few days – quite a lot of people seem to be using the Holiday break to learn how to webscrape and are coming upon the same problem: they’ve checked the html of a website in their browser to find the info they want, constructed a perfectly acceptable selector but it isn’t returning anything! I decided to write up a quick tutorial that I can link instead of having to answer the question every time.

Continue reading

Posted in General Tips, Python, tutorial, Uncategorized, webscraping | Tagged , , , , , , , | Leave a comment

I got a QR Code Tattoo!

I got my first ever tattoo this week. This is something I had been considering for a long while – about 5 years. I wanted something that reflected my obsession with technology, something that looked cool but also had a function. If you’ve already read the title, you’ll know that I settled on a QR code.

Continue reading

Posted in Off-Topic | Tagged , , | Leave a comment

ELI5 Tutorial: Unit Testing with unittest

I lied in my last post. I have decided to do one more ELI5, this time for Unit Tests. I decided to do this to help my classmates – Google is running a code retreat tomorrow at my university and advised participants to be prepared to work with unit tests but many of my classmates haven’t worked with them before. I figured I’d help them out by giving a very quick introduction to the package and giving a basic template.

Continue reading

Posted in ELI5, General Tips, Python, tutorial | Tagged , , | Leave a comment

ELI5 Tutorial: Subclassing Objects in Python

So, this ELI5 has been sitting in my drafts folder for a while. Not sure how that happened there! Woops! After some delay, here is the final EL15 for now – how to subclass an object!

Continue reading

Posted in ELI5, Python, tutorial | Tagged , | Leave a comment

Connecting to Eduroam on Linux

Today I returned to university to do a postgrad after an 11 year absence. A lot had changed since my undergrad, mostly on the tech support side. My student webmail is on gmail now, printing costs money and WiFi is managed by something called Eduroam. This last point caused me some trouble on my first day since my work laptop runs Linux (ubuntu 16.04) which meant I had to change some settings to make it connect. Since Eduroam is used in a bunch of institutions the world over there is plenty of random blog posts and help pages filled by students who have been in a similar position. However, as with a lot of software of this nature, updates between blog posts have resulted in out of date advice. After some finagling I was able to get it working and I’ve decided to join in the tradition of giving Eduroam help on blog posts by posting my own advice. Here is how to set up Eduroam on Linux in 2019.

Continue reading

Posted in General Tips, Linux | Tagged | Leave a comment

ELI5: Python @property and setter

For this ELI5 I’m gonna go over the @property and setter decorators. In my objects tutorial I mentioned that you can access and alter the content of attributes directly, but this is not always ideal. In other words, these allow you to create “getter” and “setter” methods that are common in other programming languages.
Continue reading

Posted in ELI5, Python, tutorial | Tagged , | 2 Comments

How To Share Songs Between Devices On Spotify

I recently started using spotify and immediately ran into a very frustrating issue – a bunch of my favourite songs were not available on the platform. While I had my own versions of these songs I needed a way to play them via spotify on any of my devices – my phone, laptop, work laptop and desktop computer. While this is something that isn’t officially supported by the platform, I was able to figure out a system to do so through some digital trickery. If this is a feature you’ve been hoping for to, feel free to read on for instructions!
Continue reading

Posted in General Tips | Tagged , | Leave a comment

ELI5 Tutorial: @classmethod and @staticmethod

In this week’s ELI5 tutorial I am going to combine my last two ELI5s and talk about special decorators in classes. The first two I will deal with are @classmethod and @staticmethod. These decorators can be very powerful and allow you to make a an object that is very easy for a user to interact with.
Continue reading

Posted in ELI5, Python, tutorial | Tagged , | Leave a comment