Crawlie free download for Mac


19 August 2016

Scan a Web site for errors.


Crawlie is a Web crawler which allows you to crawl and scan your website for link errors, missing pages, bad CSS/JavaScript URLs, RSS feeds, and more. This tool is perfect for web developers, allowing them to quickly run checks on the integrity of a website before publishing updates, or to simply check periodically for bad links.

  • Detailed statistics updated and shown in real-time
  • Check links of all types: images, scripts, stylesheets, feeds, and more
  • Customisable crawl options, including recursion, external domains, and query-parameter checking
  • Add delays to each request to prevent overloading a webserver
  • See each request's HTTP response code and explanation
  • Response times are logged to millisecond precision
  • Quickly view on which page a bad link was found
  • Export results for further analysis

What's new in Crawlie

Version 1.1.3:
  • Added the ability to prevent upwards traversal, keeping the crawl in a specific sub-folder
  • Improved HTML source scanning

Join over 500,000 subscribers.

Subscribe for our newsletter with best Mac offers from MacUpdate.

How would you rate Crawlie app?

0 Reviews of Crawlie