Testing web sites for broken links - Mac software

I was looking for a a mac software product to test a website for broken external links (link checker) that can be run from a remote machine (does not have to run on the server or a copy of the web site), saves results of broken links, and can be scripted to run at pre-set times. I went through all the ones listed in the "Extending WebSTAR" area of StarNine's web site, (makers of WebSTAR server software for the Mac) and the only thing that came close was a funky lil app called Big Brother. My comments on the various products I found are included with each entry below. Many of the programs seem to have changed since the descriptions were written at StarNine. Use this info in any way you like.


Extending WebSTAR: Content Creation

HTML Link Checkers

HTML LinkChecker http://www.calles.pp.se/nisseb/
A shareware utility by Nisseb Softwares which will check your pages for bad links.

- Now free but no longer supported by the author. will not check links on external pages, so it must be run on the server itself. did not test.

SiteCheck
An application from Pacific Coast Software which will check and report on all the links at your site.

- The link led to a page with a screen shot of a program, but no links to any other information, like how to get a copy! going to the site root redirects to Smith Micro, which does not mention any such software in its product list. consider this one dead. There is also a different SiteCheck that works with adult web sites to count access or something.

Big Brother http://pauillac.inria.fr/~fpottier/bb.html.en
Shareware by François Pottier, Big Brother will check through all the hyperlinks on your site and notify you if any are broken. Local links can be checked offline, and it will even try to find the new address of remote documents which are no longer available.

- This is almost exactly what I was looking for. It will recursively check all the links in a site, I used it to check a site w/about 10,000 links. You can ignore local or external links if you want to just check offsite links, for instance. It has some nice Applescripts included, which, when modified appropriately and combined with Cron, can launch Big Brother at a predetermined time. Unfortunately, the author no longer supports it and it does not respond to apple-events for saving results and closing itself. Also, it errors on .pdf files. (keeps going, just counts them as errors) The source code is available if anyone wants to take a whack at adding that functionality to it. Then it would be perfect! (And it is free)

Site Ranger
Actually a complete web site manager, Thomas Reed's Site Ranger performs link checking, simple macro expansion, and auto-correction of links when moving files. It is currently in alpha, and more features are scheduled to be added.

link was gone - "The page that you requested was not found in AOL Hometown" but I found it at http://home.earthlink.net/~thomasareed/shareware/siteranger/ doesn't currently check off-site links

Link Alarm http://www.linkalarm.com/
LinkAlarm automatically and regularly checks every link on every page of any web site. A summary report is emailed showing the type and number of broken links and the online report provides a detailed list of problems so they can be viewed and easily repaired. With the Linkalarm [browser] plug-in, you can zoom straight to your HTML editor to fix the link there and then. The webmaster fixes the links, rechecks the site and waits for their next scheduled report. The service is available on a free 2 month trial. Web sites can receive LinkAlarm from $20 each year.

- Web based, their servers run the checks. you can automate when to have the checks run - this is good! but they have a bizarre system for paying for link checks, different now than described above - you have to buy 'points' and spend one point to check all the links on one page. a little too weird for me.

See Also:

VSE BE Found
VSE Be Found is a Mac-based web site promotion tool which automatically submits web site URLs to hundreds of popular search engines such as AltaVista, Excite, Lycos, etc. VSE Be Found also creates and manages META tags, analyzes the design/content of web pages, and gives tips on how to improve the search engine ranking for each individual web page.

- This program does not check links

SiteWeaver http://www.miracleinc.com/Products/SW/
Miracle Software's SiteWeaver is a complete site outlining and management tool, and will give you an overview of your site, reveal bad links, and allow you to add, delete, and move pages and folders. Works in conjunction with several popular HTML editors, and includes their own visual page editor, World Wide Web Weaver.

- This will check links but only directly on the server or on a copy of the entire web site. it's like a poor-man's Dreamweaver. It is from 1997.

Website Garage http://websitegarage.netscape.com/
Subscription service that checks html and links, allows you to view your site with many different browsers, optimize gifs and more.

- This is now owned by Netscape, and even after the convoluted sign-up process, I could only get it to check one page. Useless for my purposes.


others that were not on the WebSTAR page:

Dreamweaver http://www.macromedia.com/software/dreamweaver/
will check links but you need to run it on the server, or have a copy of the entire site on a local machine.

Webwhacker http://www.bluesquirrel.com/products/whacker/whackermac.html
will download an entire site for you. I used it years ago as a cludge to check links, as it generated errors for any page it couldn't download. It looks like the Windows version will now let you just check links but the Mac version still actually downloads every page. I have not tried it out. $50 for Mac 3.0 or try the 2.0 demo