HY-559 Fall 2019-20

Computer Science Department, University of Crete
HY-559 Infrastructure Technologies for Large-Scale Service-Oriented Systems

info | readings | syllabus | other resources

Course Staff

Name	Email	Office Hours
Instructor: Kostas Magoutis	hy559@csd	By appt./H-311
Teaching Assistant: Antonis Papaioannou	hy559@csd	By appt.

General Information

The course meets on Tuesdays 12-2pm and Thursdays 2-4pm in H-206. See schedule for exact dates.

Announcements

30.09.2019 10:00: You are encouraged to attend a talk on compiling distributed systems models into implementations

26.09.2019 10:00: There will be no class on Tuesday 1/10 and Thursday 3/10

13.09.2019 10:00: The first lecture will take place on Thursday 26/9 (no class on Tuesday 24/9!)

09.06.2019 10:00: You are welcome to get in touch with the instructor to discuss course-related issues.

Course Description

The explosive growth of e-services in recent years has created the need to design, implement, and manage infrastructures that support large-scale service-oriented systems. The course offers an introduction to the scalable infrastructure technologies designed to support large-scale e-services. In the course we will examine existing design techniques and research problems in the design and implementation of these systems as well as their possible solutions.

The course focuses on large-scale service-oriented systems and their architectures (Web services, service-oriented architectures, service mashups, etc.); design principles for scalable high performance; management of infrastructural service-level agreements (SLAs); information lifecycle management; configuration and change management databases and ITIL processes; design optimization to meet application requirements; the role of the human factor in service engagements; service delivery models; and several case studies (Amazon, Google, Yahoo, Facebook).

This course is targeted for graduate students and advanced undergraduates and requires the undertaking of a research project. The topics of the research projects will be chosen with the help and guidance of the course staff. Other requirements include two homework assignments, two short in-class quizzes, a midterm exam, and a final exam.

Coursework

Reading and discussing classic and current papers
In-class quizzes
A research project of your choice

Prerequisites

Introductory operating systems and database courses such as HY-345 and HY-360

Grading

The final grade depends on class participation and a research project.

Readings

There are a number of paper readings that are available online. You are expected to read the papers before the beginning of each class.

There is no required textbook for this class. The following textbooks, however, are recommended readings:

Alonso, Casati, Kuno, Machiraju: Web Services: Concepts, Architectures, and Applications, Springer Verlag.
Chou (Editor): Web Site Infrastructure Considerations, IEEE Tutorial

Syllabus

Date	Notes	Readings
Thu 26/9	Course overview, Paxos	Lecture notes
Tue 1/10	Instructor out of town - no class	-
Thu 3/10	Instructor out of town - no class	-
Tue 8/10	Paxos	Lecture notes
Thu 10/10	Distributed data stores 1	Lecture notes, DeCandia: Dynamo: Amazon's highly-available key-value store
Tue 15/10	Distributed data stores 1	Lecture notes, DeCandia: Dynamo: Amazon's highly-available key-value store
Thu 17/10	Distributed data stores 2	Lecture notes, Gribble: Scalable, Distributed Data Structures for Internet Service Construction
Tue 22/10 & Thu 24/10	Investigate project topics & prepare reports	-
Tue 29/10	Application specific designs & status reports	Bronson: Facebook's distributed data store for the social graph
Thu 31/10	Application specific designs	Lecture notes, Bronson: Facebook's distributed data store for the social graph
Tue 5/11	Scalable messaging 1	Lecture notes, Kreps: A distributed Messaging System for Log Processing
Thu 7/11	Instructor out of town - no class	-
Tue 12/11	Scalable messaging 2	Lecture notes, Kreps: A distributed Messaging System for Log Processing
Thu 14/11	Project reports	-
Tue 19/11	Scalable network services 1	Lecture notes, Fox: Extensible Cluster-Based Scalable Network Services
Thu 21/11	Scalable network services 2	Lecture notes, Fox: Extensible Cluster-Based Scalable Network Services
Tue 26/11	Scalable network services 3	Lecture notes, Elson: Handling Flash Crowds from your Garage
Thu 28/11	Related work presentations	paper 1, paper 2
Tue 3/12	Related work presentations	paper 3, paper 4
Thu 5/12	Related work presentations	paper 5, paper 6
Tue 10/12, Thu 12/12	Instructor out of town, no class	-
Tue 17/12	Related work presentations	paper 7, paper 8
Thu 19/12	Related work presentations	paper 9, paper 10

Projects HOWTO

Please note the following project guidelines:

Discuss project ideas with course staff
Write a short abstract (plain text) describing your goals and deliverables
In preparing your abstract, describe
- The problem you are solving and what the research questions are
- A list of deliverables (code, analysis results, etc.) and estimated effort
Project papers (in the ACM paper formatting template) are due TBD
Prepare a short (15-20min) presentation of your results
Presentations will be delivered during the last two class meetings
Please use this presentation template.

Other Resources

Interesting readings
- Ken Birman's Like it or Not, Web Services are Distributed Objects!
- Marvin Theimer's (Amazon) keynote speech at LADIS'09
- Jim Gray discusses lessons learned from the Amazon technology platform with Werner Vogels
- Jeff Dean's (Google) keynote speech at LADIS'09
- Kirk McKusick discusses the Google File System origins and evolution with Sean Quinlan (Google).
- ACM Queue magazine articles on Web services and Virtualization.
Open-source scalable infrastructure:
- Apache Hadoop
- Apache Zookeeper
- Apache Cassandra and paper
- SmartFrog tutorial, reference manual (pdf), user guide (pdf), quick reference, workflow (pdf), Eclipse plugin
- Chord
Links
- LADIS workshops