history

Analyzing One Million robots.txt Files

Insights gathered from analyzing the robots.txt files of Alexa’s top one million domains.

Continue reading

Running Selenium with Headless Chrome

A guide to setting up Selenium to work with the new headless functionality of Google Chrome.

Continue reading