Readings for CSc 450: Web Technologies and Performance (for Nov 5)

Note that some of these are links to Postscript or PDF and you will need the appropriate viewers.

Search Engines

Saraiva et al, 2001. Rank-Preserving Two-Level Caching for Scalable Search Engines. SIGIR 2001. Local copy.
Wagner Meira Jr, Marcio Cesario, Rodrigo Fonseca, and Nivio Ziviani, 1999. Integrating WWW Caches and Search Engines (note, for free access, probably need to be on campus or use Lehigh proxy cache). IEEE 1999 Global Telecommunications Internet Mini-Conference.
Andrei Broder, Ravi Kumar, Farzin Maghoul, Prabhakar Raghavan, Sridhar Rajagopalan, Raymie Stata, Andrew Tomkins, Janet Wiener, 2000. Graph structure in the web. WWW9.

Spiders

J. Cho, H. Garcia-Molina, and L. Page. Efficient Crawling Through URL Ordering. WWW7.
Junhoo Cho and Hector Garcia-Molina, 2001. Parallel Crawlers. Stanford Computer Science Technical Report.
Almeida et al, 2001. Analyzing the Impact of Robots on Performance of Web Caching. Proc. of Sixth Int'l Workshop on Web Caching and Content Distribution.
Talim et al, 2001. Controlling the Robots of Web Search Engines (Again, may need to be at Lehigh or use the proxy for access). SIGMETRICS 2001. (OPTIONAL)