Welcome to the graduate course on Cloud Computing
Cloud computing serves many large-scale applications ranging from search engines like Google to social networking websites like Facebook to online stores like Amazon. More recently, cloud computing has emerged as an essential technology to enable emerging fields such as Artificial Intelligence (AI), the Internet of Things (IoT), and Machine Learning. The exponential growth of data availability and demands for security and speed has made the cloud computing paradigm necessary for reliable, financially economical, and scalable computation. The dynamicity and flexibility of Cloud computing have opened up many new forms of deploying applications on infrastructure that cloud service providers offer, such as renting of computation resources and serverless computing.
This course will cover the fundamentals of cloud services management and cloud software development, including but not limited to design patterns, application programming interfaces, and underlying middleware technologies. More specifically, we will cover the topics of cloud computing service models, data centers resource management, task scheduling, resource virtualization, SLAs, cloud security, software defined networks and storage, cloud storage, and programming models. We will also discuss data center design and management strategies, which enable the economic and technological benefits of cloud computing. Lastly, we will study cloud storage concepts like data distribution, durability, consistency, and redundancy.
Lecture Info
- Instructor: Ali Anwar
- Meeting time: T,Th 09:45 AM - 11:00 AM
- Location: Vincent Hall 364
- Email: aanwar_AT_umn.edu
Prerequisite
Undergraduate-level Operating System or a similar course is preferred. This course assumes familiarity with systems, including how operating systems work and how networks work. If you don’t have this background, you should be in communication with me (the instructor) at the beginning of the semester.
Who is this course for?
This course is primarily intended for graduate students and motivated seniors who want to learn the latest research advances in distributed systems and cloud computing areas, and are interested in building cloud-based distributed systems used/demanded by existing/emerging data-intensive applications.
Grading policy
Your grade will be calculated as follows:
- 10% homework assignments (potential bonus points as well)
- 10% class participation (potential bonus points as well)
- 40% coding assignments
- 40% research project
Grading rules
The final grade is computed according to the following rules:
- A+: A: [90%, 95%); A-: [85%, 90%)
- B+: [80%, 85%); B: [75%, 80%); B-: [70%, 75%)
- C+: [66%, 70%); C: [63%, 66%); C-: [60%, 63%)
- D+: [56%, 60%); D:[53%, 56%); D-: [50%, 53%)
- F: < 50%
Late Days
Each student will be granted 5 late days to use for the homework. After all free late days are used up, the penalty is 10% for each additional late day. Late days can not be used for the mid-way and final research presentation.
Student Integrity
Cheating in this course will result in a grade of F for the course and the University policies will be followed.
Students with Disabilities
If you need any accommodation, you are highly encouraged to contact both your instructor and Disability Resources Center (DRC).
Office hours
- Where: 4-205 Keller hall or Zoom
- When: Wednesday 10 -12 pm
- Additional office hours can be requested via Slack
Course Schedule
The course schedule is tentative and subject to change. Topics to be covered are available here.
Lecture |
Date |
Topic |
Required Readings |
Optional Readings |
Announcements |
1 |
Tue: Sept 3
|
Introduction and Logistics |
Armbrust2010, Vaquero11
|
Rackspace2012, Shafii2012, DeanSOSP2015, Cano2016, Vieira2012, Vogels2016, reiss2012, Ferguson2012, Rajagopalan2013, Das2013 |
Assignment 1: student info |
|
Thu: Sept 5 |
Introduction to Cloud Computing |
// |
// |
|
|
Tue: Sept 10 |
Virtualization I |
Links to an external siteXen2005 ,
VMware
|
Xen2003,
Xen2005
|
|
|
Thu: Sept 12 |
Virtualization II |
// |
// |
|
|
Tue: Sept 17 |
Containers I |
Namespaces in operation, Links to an external site. CGroups documentation |
VM lighter than container Links to an external site., Slacker |
|
|
Thu: Sept 19 |
Containers II |
Docker docs, Links to an external site. Docker architecture |
Improving Docker registry |
|
|
Tue: Sept 24 |
Project Ideas Discussion |
|
|
Project Proposal and Literature Review Due Sep 26. |
|
Thu: Sept 26 |
Cloud Storage |
GFS Paper, HDFS Paper |
Hadoop Architecture Guide |
|
|
Tue: Oct 1 |
Consistency Models |
Visual Guide to NoSQL Systems, Delta Store (Meta, BespoKV paper |
Chain Replication Links to an external site., CRAQ |
|
|
Thu: Oct 3 |
Key Value Stores |
Scaling Memcached at Facebook, Links to an external site. DynamoDB |
// |
|
|
Tue: Oct 8 |
Programming Model I |
MapReduce, Links to an external site. Spark |
Hadoop vs Spark Links to an external site., MapReduce Architecture, Links to an external site. Replex |
|
|
Thu: Oct 10 |
Programming Model II |
Pocket paper |
A Berkeley View on Serverless Computing Links to an external site., A Berkeley View of Cloud Computing Links to an external site., The Wukong paper |
Mid Project discussions and presentations start next week.
|
|
Tue: Oct 15 |
Serverless Caching
|
InfiniCache Links to an external site. InfiniStore Links to an external site.
|
Pocket Links to an external site. AWS Lambda |
|
|
Thu: Oct 17 |
|
Mid-Term Project Presentation and Discussion
|
|
|
|
Tue: Oct 22 |
|
Mid-Term Project Presentation and Discussion
|
|
|
|
Thu: Oct 24 |
|
Mid-Term Project Presentation and Discussion |
|
|
|
Tue: Oct 29 |
Serverless Storage |
InfiniCache, Links to an external site. InfiniStore |
Pocket, Links to an external site. AWS Lambda |
|
|
Thu: Oct 31 |
Serverless Parallel Processing |
Wukong |
Hacker News, Links to an external site. Review |
|
|
Tue: Nov 5 |
MapReduce Scheduling |
SPARK, Links to an external site. hatS |
MapReduce, Heterogeneity |
|
|
Thu: Nov 7 |
Coding Assignment 2 design discussion + Demo + Cloud Resource Management I |
Mesos,
Links to an external sMOS
|
Mesos Video |
|
|
Tue: Nov 12 |
Cloud Resource Management II |
Google Borg Links to an external site., Borg: the next generation Links to an external site., Alibaba Trace Analysis Links to an external site., Borg to Kubernetes |
Alibaba Microservice Trace Analysis Links to an external site., Borg Video |
Discussion about demo for coding assignment 2 and 3. Introducing leader board. |
|
Thu: Nov 14 |
Deep Learning in Cloud I |
Horvod, Links to an external site. Ray |
Why Ray? Links to an external site., Spark Summit,
Links to an external siteParameter Server
|
|
|
Tue: Nov 19 |
Deep Learning in Cloud II |
Alpa, Links to an external site. IBM FL, Links to an external site. TiFL |
AlpaServe |
|
|
Thu: Nov 21 |
Deep Learning in Cloud II |
FedAT |
OORT |
|
|
Tue: Nov 26 |
Final Project Discussion + Coding Assignment 3 Demos |
|
|
|
|
Thu: Nov 28 |
|
|
|
|
|
Tue: Dec 3 |
Federated Learning + Coding Assignment 3 Demos
|
Project Presentations
|
|
|
|
Thu: Dec 5 |
|
Project Presentations
|
|
|
|
Tue: Dec 10 |
Final Report Discussion |
Project Presentations
|
|
|
Group Members |
Throughput 3 KV Stores |
Average Latency |
Ranking |
Anas, Ahmad, Suchithra
|
28500 |
0.003 |
1st |
Pravallika Kambhampati, Sireesha Pothumudi |
4150 |
0.02 |
2nd  |
Thomas Knickerbocker, Owen Ratgen |
3800 |
0.007 |
3rd  |
Weichao Huang |
2450 |
0.004 |
|
Samuel Nelson, Daniel Tran, Bernie Nnadi |
2450 |
0.02 |
|
Chinmayee |
2250 |
0.01 |
|
Giang To, Henry Olig |
2050 |
0.004 |
|
Azal Khan
|
1975 |
0.01 |
|
Leo Conforti |
1950 |
0.01 |
|
Matthew, Lavanya
|
1900 |
0.01 |
|
Eric Watson |
1800 |
0.02 |
|
Julia, Yashasvi, Hse Wah |
1800 |
0.02 |
|