I gave a general technical talk on building a distributed web crawler at last Friday’s NUS Hackers meetup. Here are my presentation slides, which I used during the talk.
We are hiring!
If you are interested in joining a fast growing Cloud (80-node EC2 cluster), Mobile (SSH + Screen) and Social (We are all friendly hackers. No ‘ideas’ people.) startup, drop me a mail at varun [at] semantics3.com!