18-845: Internet Services
Carnegie Mellon University, Spring 2003

Syllabus (ps, pdf) | Critiques | Individual Project (IP) | Group Project (GP)

News and notes

Instructors

Reference material

The following books by Stevens are the standard references for Unix network programming:

• W. Richard Stevens, Unix Network Programming: Networking APIs, Volume 1 (2nd Ed), Prentice Hall, 1998.
• W. Richard Stevens, Unix Network Programming: Interprocess Communication, Volume 2 (2nd Ed), Prentice Hall, 1999.

• Randal E. Bryant and David R. O'Hallaron, Computer Systems: A Programmer's Perspective, Prentice Hall, 2003.

Course schedule

Class	Date	Day	Topic	Projects	Discussion Leader(s)
1	01/14	Tue	Welcome		O'Hallaron
2	01/16	Thu	Tour of Internet Services	IP out	O'Hallaron
3	01/21	Tue	End-to-End Arguments		O'Hallaron
4	01/23	Thu	High performance servers		O'Hallaron
5	01/28	Tue	Measuring server performance		James Grace (jgrace)
6	01/30	Thu	Clustering		James Casazza (jcasazza)
7	02/04	Tue	Unstructured overlays - Freenet		Rory O'Neill (rso)
8	02/06	Thu	No class: Google Talk NSH 3305 12-1pm	IP due, 12:30pm
9	02/11	Tue	Unstructured overlays - ESM and RON		Devin Mahoney (dmahoney) and Wei Zhang (weizhang)
10	02/13	Thu	Consistent hashing		Michael Schellhase (mcs2)
11	02/18	Tue	Structured overlays - Chord/Pastry		James Casazza (jcasazza)
12	02/20	Thu	Structured overlays - CAN		James Grace (jgrace)
13	02/25	Tue	Open questions in P2P systems	GP proposals due 12:30pm	Mobeen Bajwa (mzb)
14	02/27	Thu	P2P apps - I3		Michael Schellhase (mcs2)
15	03/4	Tue	P2P apps - Storage I		Noah Hafner (nmh)
16	03/6	Thu	NO CLASS - MIDTERM BREAK
17	03/11	Tue	P2P apps - Storage II		Noah Hafner (nmh)
18	03/13	Thu	P2P apps - Keyword search		Rory O'Neill (rso)
19	03/19	Tue	GP STATUS REPORTS		Becknel, Schellhase, Hafner/Mahoney
20	03/20	Thu	GP STATUS REPORTS		Casazza/Grace/O'Neill, Bajwa, Zhang
21	03/25	Tue	NO CLASS - SPRING BREAK
22	03/27	Thu	NO CLASS - SPRING BREAK
23	04/1	Tue	Geographic mapping		Damon Becknel (dbecknel)
24	04/3	Thu	Global network positioning		Damon Becknel (dbecknel)
25	04/8	Tue	Content delivery systems		Mobeen Bajwa (mzb)
26	04/10	Thu	P2P security		Devin Mahoney (dmahoney)
27	04/15	Tue	Network measurement		Wei Zhang (weizhang)
28	04/17	Thu	WAN emulation		Kay Sripanidkulchai (kunwadee)
29	04/22	Tue	NO CLASS - GP PREP
30	04/24	Thu	NO CLASS - GP PREP	GP reports due (5:00pm)
31	04/29	Tue	NO CLASS - GP PREP	GP reviews due (5:00pm)
32	05/1	Thu	GP Poster Session (Hamburg Hall 1510)
	05/4	Sun		Final GP reports due (11:59pm)

Detailed course schedule

Students who are not leading the discussion for a particular class should prepare
a 1-page critique for each paper denoted by a "*".

Bring a hardcopy (no email) of your critique with you to class and give it to Kay before class.
She will grade it and return it to you next class.

Class 1: Welcome (Tue 1/14)

• Welcome and overview of course organization.

Class 2: A tour of Internet services (Thu 1/16)

• (no critique due today) Committee on Research Horizons in Networking, National Research Council, Looking Over the Fence at Networks, 2001. (pdf)

Class 3: End-to-end arguments (Tue 1/21)

• *J. Saltzer, D. Reed, and D. Clark, End-to-End Arguments in System Design, ACM Transactions on Computer Systems, Vol 2, No 4, Nov, 1984. (pdf) Note: Your critique should list three other examples (not discussed by the authors) of end-to-end arguments in system design.
• M. Blumenthal and D. Clark, Rethinking the Design of the Internet: The End to End Arguments vs. the Brave New World, ACM Transactions on Internet Technology, Vol 1, No 1, Aug, 2001. (pdf)
• D. Clark, J. Wroclawski, K. Sollins, and R. Braden, Tussle in Cyberspace: Defining Tomorrow's Internet SIGCOMM'02, August, 2002, Pittsburgh, PA. (pdf)

Class 04: High-performance servers (Thu 1/23)

• NOTE: You can handin a single critique covering both papers...droh
• *V. Pai, P. Druschel, and W. Zwaenepoel, Flash: An efficient and portable Web server, Proceedings of the USENIX 1999 Annual Technical Conference, Monterey, CA, June 1999 (html)
• *Gaurav Banga, Jeff Mogul and Peter Druschel, A scalable and explicit event delivery mechanism for UNIX, in the Proceedings of the USENIX 1999 Technical Conference, Monterey, CA, June 1999. Winner of Outstanding Paper Award (ps)

Class 5: Measuring server performance (Tue 1/28)

• *G. Banga and P. Druschel, Measuring the capacity of a Web server, Usenix Symposium on Internet Technologies and Systems, Monterrey, CA, Dec, 1997 (html).

Class 6: Clustering (Thu 1/30)

• *V. Pai, M. Aron, G. Banga, M. Svendsen, P. Drushel, W. Zwaenepoel, E. Nahum, Locality-aware request distribution in cluster-based network services. In Proceedings of the Eighth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-VIII). San Jose, California, October 1998 (html)

Class 7: Unstructured overlays - Freenet (Tue 2/4)

• *I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong, Freenet: A Distributed Anonymous Information Storage and Retrieval System,ICSI Workshop on Design Issues in Anonymity and Unobservability, LNCS 2009, July 2001. (pdf)

Class 8: No class: Gobioff Google Talk NSH 3305 12-1pm (Thu 2/6)

Class 8: Unstructured overlays - ESM and RON (Tue 2/11)

• NOTE: You can handin a single critique covering both papers...droh
• *Yang-hua Chu, Sanjay G. Rao, Srinivasan Seshan and Hui Zhang, A Case for End System Multicast, IEEE Journal on Selected Areas in Communication (JSAC), Special Issue on Networking Support for Multicast, to appear. (pdf)
• *David G. Andersen, Hari Balakrishnan, M. Frans Kaashoek and Robert Morris, Resilient Overlay Networks, SOSP 2001, Banff, Canada, October 2001. (pdf)

Class 10: Consistent hashing (Thu 2/13)

• *David Karger, Eric Lehman, Tom Leighton, Mathhew Levine, Daniel Lewin, Rina Panigrahy, Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web, ACM Symposium on Theory of Computing", May 1997. (html)

Class 11: Structured overlays - Chord and Pastry (Tue 2/18)

• NOTE: You can handin a single critique covering both papers...droh
• *I. Stoica, R. Morris, D. Karger, M. Kaashoek, H. Balakrishnan, Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications, Proc. ACM SIGCOMM, San Diego, CA, August 2001. (pdf)
• *Antony Rowston and Peter Druschel, Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems, in Proceedings of the 18th IFIP/ACM International Conference on Distributed Systems Platforms (Middleware 2001), Heidelberg, Germany, November 2001. (pdf)

Class 12: Structured overlays - CAN (Tue 2/20)

• *Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp, Scott Shenker, A Scalable Content-Addressable Network, ACM SIGCOMM, 2001. (pdf)

Class 13: Open questions in P2P systems (Tue 2/25)

• *Sylvia Ratnasamy, Scott Shenker and Ion Stoica, Routing Algorithms for DHTs: Some Open Questions, First International Workshop on Peer-to-Peer Systems IPTPS02, 2002. (pdf)
• Sean Rhea, Timothy Roscoe, and John Kubiatowicz, Structured Peer-to-Peer Overlays Need Application-Driven Benchmarks, Second International Workshop on Peer-to-Peer Systems IPTPS03, 2003. (ps)

Class 14: P2P applications - I3 (Thu 2/27)

• *Ion Stoica, Daniel Adkins, Shelley Zhaung, Scott Shenker, and Sonesh Surana, Internet Indirection Infrastructure, in Proceedings of ACM SIGCOMM'02, Pittsburgh, PA, August 2002, pp. 73-86. (pdf)

Class 15: P2P applications - Storage I (Tue 3/4)

• *John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels, Ramakrishna Gummadi, Sean Rhea, Hakim Weatherspoon, Westley Weimer, Chris Wells, and Ben Zhao, Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2000), November 2000. (pdf)

Class 16: NO CLASS - MIDTERM BREAK (Thu 3/6)

Class 17: P2P applications - Storage II (Tue 3/11)

• *L. P. Cox, C. Murray, and B. D. Noble, Pastiche: making backup cheap and easy, USENIX Symposium on Operating Systems Design and Implementation, December, 2002, Boston, MA. (pdf)

Class 18: P2P applications - Keyword search (Thu 3/13)

• NOTE: You can handin a single critique covering both papers...droh
• *S. Brin and L. Page, The Anatomy of a Large-Scale Hypertextual Web Search Engine, Seventh International World Wide Web Conference / Computer Networks 30(1-7): 107-117. 1998. ( ps, pdf )
• *Patrick Reynolds and Amin Vahdat, Efficient Peer-to-Peer Keyword Searching, unpublished manuscript. (html)
• Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd, The PageRank Citation Ranking: Bringing Order to the Web, 1998. ( html )

Class 19: GP STATUS REPORTS (Tue 3/18)

• Damon Becknel
• Michael Schellhase
• Noah Hafner and Devin Mahoney

Class 20: GP STATUS REPORTS (Thu 3/20)

• James Casazza, James Grace, and Rory O'Neill
• Mobeen Bajwa
• Wei Zhang

Class 21: NO CLASS - SPRING BREAK (Tue 3/25)

Class 22: NO CLASS - SPRING BREAK (Thu 3/27)

Class 23: Geographic mapping (Tue 4/1)

• *Venkata N. Padmanabhan, Lakshminarayanan Subramanian An Investigation of Geographic Mapping Techniques for Internet Hosts, Proc. ACM SIGCOMM Conf., San Diego, CA, September 2001. (pdf)

Class 24: Global network positioning (Thu 4/3)

• *T. S. Eugene Ng and Hui Zhang, Predicting Internet Network Distance with Coordinates-Based Approaches, INFOCOM'02, New York, NY, June 2002 (pdf)

Class 25: Content delivery systems (Tue 4/8)

• *Stefan Saroiu, Krishna P. Gummadi, Richard J. Dunn, Steven D. Gribble, Henry M. Levy, An Analysis of Internet Content Delivery Systems, Proceedings of 5th Symposium on Operating Systems Design and Implementation (OSDI) 2002, Boston, MA, USA, December 2002. (pdf)

Class 26: P2P security (Thu 4/10)

• *Miguel Castro, Peter Druschel, Ayalvadi Ganesh, Antony Rowstron, and Dan S. Wallach, Secure routing for structured peer-to-peer overlay networks, In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI'02), Boston, MA, December 2002. (pdf)

Class 27: Network measurement (Tue 4/15)

• *Stefan Savage, Sting: a TCP-based Network Measurement Tool, Proceedings of the 1999 USENIX Symposium on Internet Technologies and Systems, pp. 71-79, Boulder, CO, October 1999. ( ps, pdf )

Class 28: WAN emulation (Thu 4/17)

• NOTE: You can handin a single critique covering both papers...droh
• *Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad Mac Newbold, Mike Hibler, Chad Barb, Abhijeet Joglekar, An Integrated Experimental Environment for Distributed Systems and Networks, 5th Symposium on Operating Systems Design & Implementation, pp. 255-270, December 2002 (html)
• *Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase, and David Becker, Scalability and Accuracy in a Large-Scale Network Emulator, Proceedings of 5th Symposium on Operating Systems Design and Implementation (OSDI), December 2002. (pdf)

Class 29: NO CLASS - GP PREP (Tue 4/22)

Class 30: NO CLASS - GP PREP (Thu 4/24)

Class 31: NO CLASS - GP PREP (Tue 4/29)

Class 32: Poster Session (Thu 5/1)