via Scripting News: Grub

"Grub provides a free for download, free to run, distributed crawling client, which is used to create an infrastructure (database + volunteers) that will eventually provide URL update status information for nearly every web page on the Internet. Grub's distributed crawler network will enable websites, content providers, and individuals to notify others that changes have occurred in their content, all in real time."

I've got to look into this deeper. I'm going to withhold further comment about this until I do.

Written on March 20, 2003