I’ve just updated Scrapy-GUI to version 1.1.
I spent my Christmas break working on my first python package – Scrapy-GUI. This package is an addon for the scrapy shell that gives you a graphical user interface for writing and testing scrapy queries and processors. This blog is going to focus on how the tools tab works and how you can utilise it to help build your scrapy web spiders.
I’ve taken a shine to posting on the /r/learnpython subreddit recently and I have a noticed a trend over the last few days – quite a lot of people seem to be using the Holiday break to learn how to webscrape and are coming upon the same problem: they’ve checked the html of a website in their browser to find the info they want, constructed a perfectly acceptable selector but it isn’t returning anything! I decided to write up a quick tutorial that I can link instead of having to answer the question every time.
I got my first ever tattoo this week. This is something I had been considering for a long while – about 5 years. I wanted something that reflected my obsession with technology, something that looked cool but also had a function. If you’ve already read the title, you’ll know that I settled on a QR code.
I lied in my last post. I have decided to do one more ELI5, this time for Unit Tests. I decided to do this to help my classmates – Google is running a code retreat tomorrow at my university and advised participants to be prepared to work with unit tests but many of my classmates haven’t worked with them before. I figured I’d help them out by giving a very quick introduction to the package and giving a basic template.
So, this ELI5 has been sitting in my drafts folder for a while. Not sure how that happened there! Woops! After some delay, here is the final EL15 for now – how to subclass an object!
Today I returned to university to do a postgrad after an 11 year absence. A lot had changed since my undergrad, mostly on the tech support side. My student webmail is on gmail now, printing costs money and WiFi is managed by something called Eduroam. This last point caused me some trouble on my first day since my work laptop runs Linux (ubuntu 16.04) which meant I had to change some settings to make it connect. Since Eduroam is used in a bunch of institutions the world over there is plenty of random blog posts and help pages filled by students who have been in a similar position. However, as with a lot of software of this nature, updates between blog posts have resulted in out of date advice. After some finagling I was able to get it working and I’ve decided to join in the tradition of giving Eduroam help on blog posts by posting my own advice. Here is how to set up Eduroam on Linux in 2019.
For this ELI5 I’m gonna go over the @property and setter decorators. In my objects tutorial I mentioned that you can access and alter the content of attributes directly, but this is not always ideal. In other words, these allow you to create “getter” and “setter” methods that are common in other programming languages.
I recently started using spotify and immediately ran into a very frustrating issue – a bunch of my favourite songs were not available on the platform. While I had my own versions of these songs I needed a way to play them via spotify on any of my devices – my phone, laptop, work laptop and desktop computer. While this is something that isn’t officially supported by the platform, I was able to figure out a system to do so through some digital trickery. If this is a feature you’ve been hoping for to, feel free to read on for instructions!
In this week’s ELI5 tutorial I am going to combine my last two ELI5s and talk about special decorators in classes. The first two I will deal with are @classmethod and @staticmethod. These decorators can be very powerful and allow you to make a an object that is very easy for a user to interact with.