Starting with a single URL Blue Crab Lite begins traversing the site by following the links on the textual pages it finds, HTML, CSS, etc. Blue Crab Lite does not stray off the domain of the starting URL, so it won't get lost. It knows how to stop because it never downloads the same URL twice, it knows what has alreadty more...
- Maintenance Update
- OS X 10.6.6 or later