Thank you for your review
0.00 Free
Email me when discounted: 
This script acts as a Web crawler, or spider. Starting with a particular URL it retrieves the Web page, scans it for links, and then attempts to retrieve all files linked to the page. This behavior repeats for each file retrieved and continues until one of several stop criteria is reached.

Stopping tests:

  • Number of hops (links) from the start page.
  • Links go "up" rather than "down".
  • Links go to disallowed servers.

If desired, the application will rewrite absolute URLs relative to the download hierarchy, producing a completely self-sufficient archive.

This software is provided as "postcardware". You may download

What's New

Version 2.1: Corrected parsing of javascript function references, added php and asp to recognized "html" file extensions, fixed bug that truncated crawls done without the "legal servers" restriction.


Mac OS 9 or later

Similar Software

Suggest other similar software
Create a collection and add  to it.
Like this app? Be the first to add it to a collection! Create a Collection by bringing together complementary apps that have a common theme or purpose, then share it and discover new collections!

TheArchivist User Discussion

To leave a comment, you need to be logged in.
Sort by: Time | Smiles
TheArchivist needs a rating. Be the first to rate this app and get the discussion started!
1 1


Current Version (2.x)


Downloads 2,462
Version Downloads 1,890
License Free
Date 09 Mar 2005
Platform OS Classic / OS X / PPC 32
Price Free
download install purchase purchase