Arachnid
A command line web crawler that identifies website functionality and accessibility issues.
Web developers, especially those who work solo, have a very difficult job. They are responsible for keeping track of every aspect of a website, including it's content, design, accessibility, and functionality. Given that web developers are human, and humans make mistakes, it's more than reasonable to expect that some website issues will go unnoticed.
Arachnid is designed help web developers check their work. Arachnid scans entire websites to find broken links, misconfigured permissions, and other issues that a human may miss.
Quick
On a fast internet connection, Arachnid has no problem processing dozens of web pages per second on a typical desktop PC.
Free
Unlike nearly all other website diagnostic tools, Archnid is 100% free, both in terms of cost, and freedom.
Self Hosted
Arachnid isn't a third party service. When you run an Arachnid scan, all of the processing is being done directly between your server and Arachnid instance. You don't have to worry about your site being indexed without your consent, or your personal information being collected.
Versatile
Since Arachnid is written using generic networking libraries, it isn't dependent on any particular configuration. It has no problems being run locally on webservers completely isolated from the internet, or hundreds of miles away on a distant computer.
Accessibility
Arachnid is capable of detecting accessibility issues that normal users might not see. Pages containing images without alt text or improperly configured language data can be logged and addressed.
Command Line Interface
Arachnid is completely command line based, meaning you can run it directly on the webserver you want to test for the best possible performance.
Well Commented
The Arachnid source code is well commented, making it easy to modify it to fit your own needs.
Downloads
Since this program is written in Python, all of the downloads are identical, per version number. They are only seperated by platform for sake of clarity, and to demonstrate which platforms are compatible. The source code download will give the exact same files as the platforms themselves.
0.1
Arachnid 0.1Arachnid 0.1 Source
Arachnid 0.1
Arachnid 0.1