WWW development
Growth rate too fast to keep up with, so much info and so many services available, so web search engine developers developed “cheats” to stay sub-second
- only index top level pages per site
- pre-compute answers to FAQs
- de-spamming
- 2-level search on small, high quality corpus, fast, narrow plus fuller search on large, but slower
Search sites developing into portals, links to search and other services, personalised
Value-added services like exhaustive search, filtering, mining, summarisation, are emerging