Thank you for your review
Email me when discounted: 
This script acts as a Web crawler, or spider. Starting with a particular URL it retrieves the Web page, scans it for links, and then attempts to retrieve all files linked to the page. This behavior repeats for each file retrieved and continues until one of several stop criteria is reached.

Stopping tests:

  • Number of hops (links) from the start page.
  • Links go "up" rather than "down".
  • Links go to disallowed servers.

If desired, the application will rewrite absolute URLs relative to the download hierarchy, producing a completely self-sufficient archive.

This software is provided as "postcardware". You may download and use more...

What's New

Version 2.1: Corrected parsing of javascript function references, added php and asp to recognized "html" file extensions, fixed bug that truncated crawls done without the "legal servers" restriction.


Mac OS 9 or later

Similar Software

Open Comparison
Suggest Other Similar Software
Leave a Review

TheArchivist User Discussion

To leave a comment, you need to be logged in.
Sort by: Time | Smiles
There are no Ratings for this App yet.
1 1


Current Version (2.x)


Downloads 2,450
Version Downloads 1,878
License Free
Date 09 Mar 2005
Platform OS Classic / OS X / PPC 32
Price Free
Learn how MacUpdate Desktop makes installing apps from MacUpdate.com one-click easy.
Next time, install TheArchivist with 1-click

Learn how MacUpdate Desktop can install apps on MacUpdate with the simple click of the Install apps with MacUpdate Desktop icon. Plus, keep all your apps updated.

download install