Welcome to the graduate course on Cloud Computing

Cloud computing serves many large-scale applications ranging from search engines like Google to social networking websites like Facebook to online stores like Amazon. More recently, cloud computing has emerged as an essential technology to enable emerging fields such as Artificial Intelligence (AI), the Internet of Things (IoT), and Machine Learning. The exponential growth of data availability and demands for security and speed has made the cloud computing paradigm necessary for reliable, financially economical, and scalable computation. The dynamicity and flexibility of Cloud computing have opened up many new forms of deploying applications on infrastructure that cloud service providers offer, such as renting of computation resources and serverless computing.

This course will cover the fundamentals of cloud services management and cloud software development, including but not limited to design patterns, application programming interfaces, and underlying middleware technologies. More specifically, we will cover the topics of cloud computing service models, data centers resource management, task scheduling, resource virtualization, SLAs, cloud security, software defined networks and storage, cloud storage, and programming models. We will also discuss data center design and management strategies, which enable the economic and technological benefits of cloud computing. Lastly, we will study cloud storage concepts like data distribution, durability, consistency, and redundancy. 

 

Lecture Info

Prerequisite

Undergraduate-level Operating System or a similar course is preferred. This course assumes familiarity with systems, including how operating systems work and how networks work. If you don’t have this background, you should be in communication with me (the instructor) at the beginning of the semester.

 

Who is this course for?

This course is primarily intended for graduate students and motivated seniors who want to learn the latest research advances in distributed systems and cloud computing areas, and are interested in building cloud-based distributed systems used/demanded by existing/emerging data-intensive applications.

 

Grading policy

Your grade will be calculated as follows:

 

Grading rules

The final grade is computed according to the following rules:

 

Late Days

Each student will be granted 5 late days to use for the homework. After all free late days are used up, the penalty is 10% for each additional late day. Late days can not be used for the mid-way and final research presentation.

 

Student Integrity

Cheating in this course will result in a grade of F for the course and the University policies will be followed.

 

Students with Disabilities

If you need any accommodation, you are highly encouraged to contact both your instructor and Disability Resources Center (DRC).

 

Office hours

Course Schedule

The course schedule is tentative and subject to change. Topics to be covered are available here.

 

Lecture Date Topic Required Readings Optional Readings Announcements
1

Tue: Sept 3

Introduction and Logistics

Armbrust2010, Vaquero11

Rackspace2012, Shafii2012, DeanSOSP2015, Cano2016, Vieira2012, Vogels2016, reiss2012, Ferguson2012, Rajagopalan2013, Das2013 Assignment 1: student info
Thu: Sept 5 Introduction to Cloud Computing // //  
Tue: Sept 10 Virtualization I

Links to an external siteXen2005 ,

VMware

Xen2003,

Xen2005

 
Thu: Sept 12 Virtualization II // //
Tue: Sept 17 Containers I Namespaces in operation, Links to an external site.
CGroups documentation
VM lighter than container Links to an external site.,
Slacker
Thu: Sept 19 Containers II Docker docs, Links to an external site.
Docker architecture
Improving Docker registry
Tue: Sept 24 Project Ideas Discussion Project Proposal and Literature Review Due Sep 26.
Thu: Sept 26 Cloud Storage GFS Paper,
HDFS Paper
Hadoop Architecture Guide
Tue: Oct 1 Consistency Models Visual Guide to NoSQL Systems,
Delta Store (Meta,
BespoKV paper
Chain Replication Links to an external site.,
CRAQ
Thu: Oct 3 Key Value Stores Scaling Memcached at Facebook, Links to an external site.
DynamoDB
//
Tue: Oct 8 Programming Model I MapReduce, Links to an external site.
Spark
Hadoop vs Spark Links to an external site.,
MapReduce Architecture, Links to an external site.
Replex
Thu: Oct 10 Programming Model II
Pocket paper A Berkeley View on Serverless Computing Links to an external site.,
A Berkeley View of Cloud Computing Links to an external site.,
The Wukong paper
Mid Project discussions and presentations start next week.
Tue: Oct 15

Serverless Caching

InfiniCache Links to an external site.
InfiniStore Links to an external site.

Pocket Links to an external site.
AWS Lambda
Thu: Oct 17

 

Mid-Term Project Presentation and Discussion

Tue: Oct 22

 

Mid-Term Project Presentation and Discussion

Thu: Oct 24 Mid-Term Project Presentation and Discussion
Tue: Oct 29 Serverless Storage InfiniCache, Links to an external site.
InfiniStore
Pocket, Links to an external site.
AWS Lambda
Thu: Oct 31 Serverless Parallel Processing Wukong Hacker News, Links to an external site.
Review
Tue: Nov 5 MapReduce Scheduling SPARK, Links to an external site.
hatS
MapReduce, Heterogeneity
Thu: Nov 7 Coding Assignment 2 design discussion + Demo +
Cloud Resource Management I
Mesos,

Links to an external sMOS

Mesos Video
Tue: Nov 12 Cloud Resource Management II Google Borg Links to an external site.,
Borg: the next generation Links to an external site.,
Alibaba Trace Analysis Links to an external site.,
Borg to Kubernetes
Alibaba Microservice Trace Analysis Links to an external site.,
Borg Video
Discussion about demo for coding assignment 2 and 3. Introducing leader board.
Thu: Nov 14 Deep Learning in Cloud I Horvod, Links to an external site.
Ray
Why Ray? Links to an external site.,
Spark Summit,

Links to an external siteParameter Server

Tue: Nov 19 Deep Learning in Cloud II Alpa, Links to an external site.
IBM FL, Links to an external site.
TiFL
AlpaServe
Thu: Nov 21 Deep Learning in Cloud II FedAT OORT
Tue: Nov 26 Final Project Discussion + Coding Assignment 3 Demos
Thu: Nov 28

 

 

Tue: Dec 3

Federated Learning + Coding Assignment 3 Demos

Project Presentations

Thu: Dec 5

Project Presentations

Tue: Dec 10 Final Report Discussion

Project Presentations

 

Group Members Throughput 3 KV Stores Average Latency Ranking

Anas, Ahmad, Suchithra


28500 0.003 1stimage.png
Pravallika Kambhampati, Sireesha Pothumudi 4150 0.02 2nd           image.png
Thomas Knickerbocker, Owen Ratgen 3800 0.007 3rd             image.png
Weichao Huang 2450 0.004
Samuel Nelson, Daniel Tran, Bernie Nnadi 2450 0.02
Chinmayee 2250 0.01
Giang To, Henry Olig 2050 0.004
Azal Khan
1975 0.01
Leo Conforti 1950 0.01
Matthew, Lavanya
1900 0.01
Eric Watson 1800 0.02
Julia, Yashasvi, Hse Wah 1800 0.02