Informações sobre o curso: This course teaches learners (industry professionals and students) the fundamental concepts of Distributed Programming in the context of Java 8. Distributed programming enables developers to use multiple nodes in a data center to increase throughput and/or reduce latency of selected applications. By the end of this course, you will learn how to use popular distributed programming frameworks for Java programs, including Hadoop, Spark, Sockets, Remote Method Invocation (RMI), Multicast Sockets, Kafka, Message Passing Interface (MPI), as well as different approaches to combine distribution with multithreading. Why take this course? • All data center servers are organized as collections of distributed servers, and it is important for you to also learn how to use multiple servers for increased bandwidth and reduced latency. • In addition to learning specific frameworks for distributed programming, this course will teach you how to integrate multicore and distributed parallelism in a unified approach. • Each of the four modules in the course includes an assigned mini-project that will provide you with the necessary hands-on experience to use the concepts learned in the course on your own, after the course ends. • During the course, you will have online access to the instructor and the mentors to get individualized answers to your questions posted on forums. The desired learning outcomes of this course are as follows: • Distributed map-reduce programming in Java using the Hadoop and Spark frameworks • Client-server programming using Java's Socket and Remote Method Invocation (RMI) interfaces • Message-passing programming in Java using the Message Passing Interface (MPI) • Approaches to combine distribution with multithreading, including processes and threads, distributed actors, and reactive programming Mastery of these concepts will enable you to immediately apply them in the context of distributed Java programs, and will also provide the foundation for mastering other distributed programming frameworks that you may encounter in the future (e.g., in Scala or C++).
Para quem é direcionado este curso: The course is targeted at an audience that is already familiar with sequential programming in Java, including a basic knowledge of Java 8 lambdas. In addition, we assume that each student has access to a laptop/desktop computer with a recent installation of Java 8. The course site includes instructions on how to obtain this installation, if needed.
Desenvolvido por: Rice University
Ministrado por: Vivek Sarkar, Professor
Department of Computer Science
| Informações básicas | |
| Nível | Intermediário |
| Compromisso | Four weeks of study, 4-8 hours/week depending on past experience with sequential programming in Java |
| Idioma | English |
| Requisitos de hardware | Access to a computer that can run Java 8 programs for optional course projects |
| Como ser aprovado | Seja aprovado em todas as tarefas para concluir o curso. |
| Classificação do usuário |
Programa
SEMANA 1
Welcome to the Course!
Welcome to Distributed Programming in Java! This course is designed as a three-part series and covers a theme or body of knowledge through various video lectures, demonstrations, and coding projects.
1 vídeos, 5 leituras
- Lecture: General Course Info
- Lecture: Course Icon Legend
- Lecture: Discussion Forum Guidelines
- Demande de discussion: Get to Know Your Classmates!
- Lecture: Pre-Course Survey
- Lecture: Mini Project 0: Setup
- Programmation non notée: Mini Project 0 Submission
DISTRIBUTED MAP REDUCE
In this module, we will learn about the MapReduce paradigm, and how it can be used to write distributed programs that analyze data represented as key-value pairs. A MapReduce program is defined via user-specified map and reduce functions, and we will learn how to write such programs in the Apache Hadoop and Spark projects. TheMapReduce paradigm can be used to express a wide range of parallel algorithms. One example that we will study is computation of the TermFrequency – Inverse Document Frequency (TF-IDF) statistic used in document mining; this algorithm uses a fixed (non-iterative) number of map and reduce operations. Another MapReduce example that we will study is parallelization of the PageRank algorithm. This algorithm is an example of iterative MapReduce computations, and is also the focus of the mini-project associated with this module.
6 videos, 6 leituras
- Lecture: 1.1 Lecture Summary
- Vídeo: 1.2 Hadoop Framework
- Lecture: 1.2 Lecture Summary
- Vídeo: 1.3 Spark Framework
- Lecture: 1.3 Lecture Summary
- Vídeo: 1.4 TF-IDF Example
- Lecture: 1.4 Lecture Summary
- Vídeo: 1.5 Page Rank Example
- Lecture: 1.5 Lecture Summary
- Lecture: Mini Project 1: Page Rank with Spark
- Vídeo: Demonstration: Page Rank Algorithm in Spark
Nota atribuída: Mini Project 1 Submission
Nota atribuída: Module 1 Quiz
SEMANA 2
CLIENT-SERVER PROGRAMMING
In this module, we will learn about client-server programming, and how distributed Java applications can communicate with each other using sockets. Since communication via sockets occurs at the level of bytes, we will learn how to serialize objects into bytes in the sender process and to deserialize bytes into objects in the receiver process. Sockets and serialization provide the necessary background for theFile Server mini-project associated with this module. We will also learn about Remote Method Invocation (RMI), which extends the notion of method invocation in a sequential program to a distributed programming setting. Likewise, we will learn about multicast sockets,which generalize the standard socket interface to enable a sender to send the same message to a specified set of receivers; this capability can be very useful for a number of applications, including news feeds,video conferencing, and multi-player games. Finally, we will learn about distributed publish-subscribe applications, and how they can be implemented using the Apache Kafka framework.
6 videos, 6 leituras
- Lecture: 2.1 Lecture Summary
- Vídeo: 2.2 Serialization/Deserialization
- Lecture: 2.2 Lecture Summary
- Vídeo: 2.3 Remote Method Invocation
- Lecture: 2.3 Lecture Summary
- Vídeo: 2.4 Multicast Sockets
- Lecture: 2.4 Lecture Summary
- Vídeo: 2.5 Publish-Subscribe Model
- Lecture: 2.5 Lecture Summary
- Lecture: Mini Project 2: File Server
- Vídeo: Demonstration: File Server using Sockets
Nota atribuída: Mini Project 2 Submission
Nota atribuída: Module 2 Quiz
Talking to Two Sigma: Using it in the Field
Join Professor Vivek Sarkar as he talks with Two Sigma Managing Director, Jim Ward, and Senior Vice President, Dr. Eric Allen at their downtown Houston, Texas office about the importance of distributed programming.
2 videos, 1 leituras
- Lecture: About these Talks
- Vídeo: Industry Professional on Distribution - Dr. Eric Allen, Senior Vice President
SEMANA 3
MESSAGE PASSING
In this module, we will learn how to write distributed applications in the Single Program Multiple Data (SPMD) model, specifically by using the Message Passing Interface (MPI) library. MPI processes can send and receive messages using primitives for point-to-point communication, which are different in structure and semantics from message-passing with sockets. We will also learn about the message ordering and deadlock properties of MPI programs. Non-blocking communications are an interesting extension of point-to-point communications, since they can be used to avoid delays due to blocking and to also avoid deadlock-related errors. Finally, we will study collective communication, which can involve multiple processes in a manner that is more powerful than multicast and publish-subscribe operations. The knowledge of MPI gained in this module will be put to practice in the mini-project associated with this module on implementing a distributed matrix multiplication program in MPI.
6 videos, 6 leituras
- Lecture: 3.1 Lecture Summary
- Vídeo: 3.2 Point-to-Point Communication
- Lecture: 3.2 Lecture Summary
- Vídeo: 3.3 Message Ordering and Deadlock
- Lecture: 3.3 Lecture Summary
- Vídeo: 3.4 Non-Blocking Communications
- Lecture: 3.4 Lecture Summary
- Vídeo: 3.5 Collective Communication
- Lecture: 3.5 Lecture Summary
- Lecture: Mini Project 3: Matrix Multiply in MPI
- Vídeo: Demonstration: Distributed Matrix Multiply using Message Passing
Nota atribuída: Mini Project 3 Submission
Nota atribuída: Module 3 Quiz
SEMANA 4
COMBINING DISTRIBUTION AND MULTITHREADING
In this module, we will study the roles of processes and threads as basic building blocks of parallel, concurrent, and distributed Java programs. With this background, we will then learn how to implement multithreaded servers for increased responsiveness in distributed applications written using sockets, and apply this knowledge in the mini-project on implementing a parallel file server using both multithreading and sockets. An analogous approach can also be used to combine MPI and multithreading, so as to improve the performance of distributed MPI applications. Distributed actors serve as yet another example of combining distribution and multithreading. A notable property of the actor model is that the same high-level constructs can be used to communicate among actors running in the same process and among actors in different processes; the difference between the two cases depends on the application configuration, rather the application code. Finally, we will learn about the reactive programming model,and its suitability for implementing distributed service oriented architectures using asynchronous events.
6 videos, 7 leituras
- Lecture: 4.1 Lecture Summary
- Vídeo: 4.2 Multithreaded Servers
- Lecture: 4.2 Lecture Summary
- Vídeo: 4.3 MPI and Threading
- Lecture: 4.3 Lecture Summary
- Vídeo: 4.4 Distributed Actors
- Lecture: 4.4 Lecture Summary
- Vídeo: 4.5 Distributed Reactive Programming
- Lecture: 4.5 Lecture Summary
- Lecture: Mini Project 4: Multi-Threaded File Server
- Vídeo: Demonstration: Parallel File Server using Multithreading and Sockets
- Lecture: Exit Survey
Nota atribuída: Mini Project 4 Submission
Nota atribuída: Module 4 Quiz
Continue Your Journey with the Specialization "Parallel, Concurrent, and Distributed Programming in Java"
The next two videos will showcase the importance of learning about Parallel Programming and Concurrent Programming in Java. Professor Vivek Sarkar will speak with industry professionals at Two Sigma about how the topics of our other two courses are utilized in the field.
2 videos, 1 leituras
- Lecture: Our Other Course Offerings
- Vídeo: Industry Professional on Concurrency - Dr. Shams Imam, Software Engineer, Two Sigma
Perguntas frequentes
Como funciona
Travail en cours
Chaque cours fonctionne comme un manuel interactif en proposant des vidéos préenregistrées, des quiz et des projets.
Aide de la part de vos pairs
Connectez-vous à des milliers d'autres étudiants et débattez sur des idées, discutez le contenu du cours et obtenez de l'aide pour en maîtriser les concepts.
Certificats
Obtenez une reconnaissance officielle pour votre travail et partagez votre réussite avec vos amis, vos collègues et vos employeurs.
Desenvolvedores
Rice University
Rice University is consistently ranked among the top 20 universities in the U.S. and the top 100 in the world. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy.
Custo
| Comprar curso | |
|---|---|
| Acesso aos materiais do curso | Disponível |
| Acesso a materiais valendo nota | Disponível |
| Receba uma nota final | Disponível |
| Obtenha um Certificado de Curso compartilhável | Disponível |
Classificações e avaliações
Frustrating at times but overall good.
Great surface level coverage of basic theories and Java frameworks for Distributed Programming. Projects are very simple and quizzes can feel a bit too specific to the lectures, but those two things just make it easier than it is in the real world. I took a similar class back in college but this was a nice refresher on thinking about first principles and modern new libraries.
First two courses are better. This one is quick and a little vague
O Coursera proporciona acesso universal à melhor educação do mundo fazendo parcerias com as melhores universidades e organizações para oferecer cursos on-line.
© 2018 Coursera Inc. Todos os direitos reservados.
Solidly worth the money!
The lectures and references are perfect, and the perspective is super helpful. The exercises still need work, but they still provide a good foundation for learning this material.
For the maintainers, a good model for compound assignments of graduated difficulty is the sbt-moderated grading for the scala sequence. I think you did a very good job within the (maybe self-imposed?) constraint of single file upload, but this is the only major area allowing any improvement in this excellent course!