You are here: Home » blog » stuff » Open Source Web Crawlers Written in Java I was recently quite pleased to learn that the Internet Archive's new crawler is written in Java. Coincindentally, I had in addition to put together a list of open source projects for full-text search engines, I put together a list of crawlers written in Java to complement that list. Here's the list: Heritrix - Heritr

You are here: Home » blog » stuff » The Lean Nature of Google's Development Practices First, a bit of disclaimer, I'm not privy to the details of Google development practices. I'm gathering this information from multiple public sources such as the a set of notes recorded by Evelyn Rodriguez on the subject, Joe Beda's blog and an Newsweek article written by CEO Eric Schmidt. For the uninitiated