1
Thank you for your review
Free
http://www.macupdate.com/download/17433/thearchivist%282.1%29.sit.hqx
Email me when discounted: 
This script acts as a Web crawler, or spider. Starting with a particular URL it retrieves the Web page, scans it for links, and then attempts to retrieve all files linked to the page. This behavior repeats for each file retrieved and continues until one of several stop criteria is reached.

Stopping tests:

  • Number of hops (links) from the start page.
  • Links go "up" rather than "down".
  • Links go to disallowed servers.

If desired, the application will rewrite absolute URLs relative to the download hierarchy, producing a completely self-sufficient archive.

This software is provided as "postcardware". You may download and use more...

What's New

Version 2.1: Corrected parsing of javascript function references, added php and asp to recognized "html" file extensions, fixed bug that truncated crawls done without the "legal servers" restriction.

Requirements

Mac OS 9 or later

Similar Software

Open Comparison
Suggest Other Similar Software
Create a collection and add  to it.
Like this app? Be the first to add it to a collection! Create a Collection by bringing together complementary apps that have a common theme or purpose, then share it and discover new collections!
Leave a Review

TheArchivist User Discussion

To leave a comment, you need to be logged in.
reviews_anchor
Sort by: Time | Smiles
TheArchivist needs a rating. Be the first to rate this app and get the discussion started!
1 1

Ratings

Overall
(1)
Current Version (2.x)
(1)

Details

Downloads 2,458
Version Downloads 1,886
License Free
Date 09 Mar 2005
Platform OS Classic / OS X / PPC 32
Price Free
download install download install purchase purchase