Back

Arachnid

A command line web crawler that identifies website functionality and accessibility issues.

A screenshot of the web crawler initiation interface

1/4

A screenshot of Arachnid's main menu

2/4

A screenshot of Arachnid's error viewer menu

3/4

A screenshot of Arachnid's 404 error viewer

4/4

Web developers, especially those who work solo, have a very difficult job. They are responsible for keeping track of every aspect of a website, including it's content, design, accessibility, and functionality. Given that web developers are human, and humans make mistakes, it's more than reasonable to expect that some website issues will go unnoticed.

Arachnid is designed help web developers check their work. Arachnid scans entire websites to find broken links, misconfigured permissions, and other issues that a human may miss.

Quick

On a fast internet connection, Arachnid has no problem processing dozens of web pages per second on a typical desktop PC.

Free

Unlike nearly all other website diagnostic tools, Archnid is 100% free, both in terms of cost, and freedom.

Self Hosted

Arachnid isn't a third party service. When you run an Arachnid scan, all of the processing is being done directly between your server and Arachnid instance. You don't have to worry about your site being indexed without your consent, or your personal information being collected.

Versatile

Since Arachnid is written using generic networking libraries, it isn't dependent on any particular configuration. It has no problems being run locally on webservers completely isolated from the internet, or hundreds of miles away on a distant computer.

Accessibility

Arachnid is capable of detecting accessibility issues that normal users might not see. Pages containing images without alt text or improperly configured language data can be logged and addressed.

Command Line Interface

Arachnid is completely command line based, meaning you can run it directly on the webserver you want to test for the best possible performance.

Well Commented

The Arachnid source code is well commented, making it easy to modify it to fit your own needs.

Downloads

Since this program is written in Python, all of the downloads are identical, per version number. They are only seperated by platform for sake of clarity, and to demonstrate which platforms are compatible. The source code download will give the exact same files as the platforms themselves.

0.1

WindowsArachnid 0.1

SourceArachnid 0.1 Source

MacOSArachnid 0.1

LinuxArachnid 0.1