What strategy would you take to build a search engine today?
mbenjaminsmith: Not sure I have an answer, but after writing a niche search engine I have this observation:The more narrowly focused you get, the less keyword rich the data is likely to become. This creates obvious problems. I've been working on a search engine where last.fm is a major source of data, and their data is comprehensive, but keyword poor. How to work around this? There are ways but they're far from trivial or resource friendly.