TheArchivist
TheArchivist
2.1

1.0

TheArchivist free download for Mac

TheArchivist

2.1
09 March 2005

Web spider script.

Overview

This script acts as a Web crawler, or spider. Starting with a particular URL it retrieves the Web page, scans it for links, and then attempts to retrieve all files linked to the page. This behavior repeats for each file retrieved and continues until one of several stop criteria is reached.

Stopping tests:

  • Number of hops (links) from the start page.
  • Links go "up" rather than "down".
  • Links go to disallowed servers.

If desired, the application will rewrite absolute URLs relative to the download hierarchy, producing a completely self-sufficient archive.

This software is provided as "postcardware". You may download and use the software without cost so long as you register your use. You may register by email to this address.

[Please Note: At this time files referred to by plug-ins (e.g., Flash), Java and some Javascripts may not be identified. You should review the archive carefully for completeness when TheArchivist is done.]

What's new in TheArchivist

Version 2.1: Corrected parsing of javascript function references, added php and asp to recognized "html" file extensions, fixed bug that truncated crawls done without the "legal servers" restriction.

Join over 500,000 subscribers.

Subscribe for our newsletter with best Mac offers from MacUpdate.

2 TheArchivist Reviews

Rate this app:

Anonymous
10 March 2005

Most helpful

does not work
Like
Version 2.1
Anonymous
10 March 2005
why is this an applescript?? there are many real applications, free, that do the same thing.
Like
Version 2.1
1 answer(s)
Anonymous
Anonymous
25 March 2005
It was a good way to do it at the time (OS-9) and it offered a fine way to learn Applescript Studio. BTW, if you have a problem with it's function, you can write to me.
Like
Version 2.1
Anonymous
10 March 2005
does not work
Like
Version 2.1