Discuss.userland.com goes off the air. All those discussions and all that knowledge, information Frontier developers relied on, is gone.

Wouldn't a robots.txt file have made the spiders go away? Or, what about doing what Conversant does... don't offer redundant links to spiders so that they only index as much as they need to.

It's unfortunate the site is down. Not only for those who've lost access to the information, but it's a concession that big Manila sites don't scale on the public internet. (I don't believe that, I think UserLand can fix this, but they don't appear to be doing it.)