Crawlie
Crawlie
1.1.3

0.0

Crawlie free download for Mac

Crawlie

1.1.3
19 August 2016

Scan a Web site for errors.

Overview

Crawlie is a Web crawler which allows you to crawl and scan your website for link errors, missing pages, bad CSS/JavaScript URLs, RSS feeds, and more. This tool is perfect for web developers, allowing them to quickly run checks on the integrity of a website before publishing updates, or to simply check periodically for bad links.

Features
  • Detailed statistics updated and shown in real-time
  • Check links of all types: images, scripts, stylesheets, feeds, and more
  • Customisable crawl options, including recursion, external domains, and query-parameter checking
  • Add delays to each request to prevent overloading a webserver
  • See each request's HTTP response code and explanation
  • Response times are logged to millisecond precision
  • Quickly view on which page a bad link was found
  • Export results for further analysis

What's new in Crawlie

Version 1.1.3:
  • Added the ability to prevent upwards traversal, keeping the crawl in a specific sub-folder
  • Improved HTML source scanning

Join over 500,000 subscribers.

Subscribe for our newsletter with best Mac offers from MacUpdate.

0 Crawlie Reviews

Rate this app: