Informações sobre o curso: Interested in increasing your knowledge of the Big Data landscape? This course is for those new to data science and interested in understanding why the Big Data Era has come to be. It is for those who want to become conversant with the terminology and the core concepts behind big data problems, applications, and systems. It is for those who want to start thinking about how Big Data might be useful in their business or career. It provides an introduction to one of the most common frameworks, Hadoop, that has made big data analysis easier and more accessible -- increasing the potential for data to transform our world! At the end of this course, you will be able to: * Describe the Big Data landscape including examples of real world big data problems including the three key sources of Big Data: people, organizations, and sensors. * Explain the V’s of Big Data (volume, velocity, variety, veracity, valence, and value) and why each impacts data collection, monitoring, storage, analysis and reporting. * Get value out of Big Data by using a 5-step process to structure your analysis. * Identify what are and what are not big data problems and be able to recast big data problems as data science questions. * Provide an explanation of the architectural components and programming models used for scalable big data analysis. * Summarize the features and value of core Hadoop stack components including the YARN resource and job management system, the HDFS file system and the MapReduce programming model. * Install and run a program using Hadoop! This course is for those new to data science. No prior programming experience is needed, although the ability to install applications and utilize a virtual machine is necessary to complete the hands-on assignments. Hardware Requirements: (A) Quad Core Processor (VT-x or AMD-V support recommended), 64-bit; (B) 8 GB RAM; (C) 20 GB disk free. How to find your hardware information: (Windows): Open System by clicking the Start button, right-clicking Computer, and then clicking Properties; (Mac): Open Overview by clicking on the Apple menu and clicking “About This Mac.” Most computers with 8 GB RAM purchased in the last 3 years will meet the minimum requirements.You will need a high speed internet connection because you will be downloading files up to 4 Gb in size. Software Requirements: This course relies on several open-source software tools, including Apache Hadoop. All required software can be downloaded and installed free of charge. Software requirements include: Windows 7+, Mac OS X 10.10+, Ubuntu 14.04+ or CentOS 6+ VirtualBox 5+.
Desenvolvido por: University of California San Diego
Ministrado por: Ilkay Altintas, Chief Data Science Officer
San Diego Supercomputer Center
Ministrado por: Amarnath Gupta, Director, Advanced Query Processing Lab
San Diego Supercomputer Center (SDSC)
| Informações básicas | Curso 1 de 6 no Big Data Specialization |
| Compromisso | 3 weeks of study, 5-6 hours/week |
| Idioma | English, Legendas: Persian |
| Como ser aprovado | Seja aprovado em todas as tarefas para concluir o curso. |
| Classificação do usuário |
Programa
SEMANA 1
Welcome
Welcome to the Big Data Specialization! We're excited for you to get to know us and we're looking forward to learning about you!
2 vídeos, 2 leituras
- Reading: By the end of this course you will be able to...
- Reading: Optional: Watch this fun video about the San Diego Supercomputer Center!
- Vídeo: Tell us about yourself and learn about your classmates
- Discussion Prompt: Let's Discuss: Why are you taking this class?
Big Data: Why and Where
Data -- it's been around (even digitally) for a while. What makes data "big" and where does this big data come from?
13 vídeos, 13 leituras
- Vídeo: Applications: What makes big data valuable
- Discussion Prompt: Let's Discuss: What application area interests you?
- Vídeo: Example: Saving lives with Big Data
- Vídeo: Example: Using Big Data to Help Patients
- Vídeo: A Sentiment Analysis Success Story: Meltwater helping Danone
- Reading: Did you know?: 25 facts about big data
- Reading: Slides: What Launched the Big Data Era?
- Reading: Slides: Applications: What Makes Big Data Valuable?
- Reading: Slides: Saving Lives With Big Data
- Reading: Slides: Using Big Data to Help Patients
- Vídeo: Getting Started: Where Does Big Data Come From?
- Vídeo: Machine-Generated Data: It's Everywhere and There's a Lot!
- Vídeo: Machine-Generated Data: Advantages
- Vídeo: Big Data Generated By People: The Unstructured Challenge
- Vídeo: Big Data Generated By People: How Is It Being Used?
- Vídeo: Organization-Generated Data: Structured but often siloed
- Vídeo: Organization-Generated Data: Benefits Come From Combining With Other Data Types
- Vídeo: The Key: Integrating Diverse Data
- Discussion Prompt: Let's discuss: Who are you providing data to?
- Reading: Extra Resources
- Reading: Slides: Machine-Generated Data: It's Everywhere and There's a Lot!
- Reading: Slides: Machine-Generated Data: Advantages
- Reading: Slides: Big Data Generated By People: The Unstructured Challenge
- Reading: Slides: Big Data Generated By People: How is it Being Used?
- Reading: Slides: Organization-Generated Big Data: Structured But Often Siloed
- Reading: Slides: Organizaton-Generated Big Data: Benefits
- Reading: Slides: The Key - Integrating Diverse Data
Nota atribuída: Why Big Data and Where Did it Come From?
SEMANA 2
Characteristics of Big Data and Dimensions of Scalability
You may have heard of the "Big Vs". We'll give examples and descriptions of the commonly discussed 5. But, we want to propose a 6th V and we'll ask you to practice writing Big Data questions targeting this V -- value.
7 vídeos, 9 leituras
- Vídeo: Characteristics of Big Data - Volume
- Reading: What does astronomical scale mean?
- Vídeo: Characteristics of Big Data - Variety
- Vídeo: Characteristics of Big Data - Velocity
- Vídeo: Characteristics of Big Data - Veracity
- Vídeo: Characteristics of Big Data - Valence
- Vídeo: The Sixth V: Value
- Reading: A Small Definition of Big Data
- Discussion Prompt: Practice: Writing Big Data questions
- Discussion Prompt: Let's Discuss: Improving the Flamingo Game
- Reading: Slides: Getting Started - Characteristics of Big Data
- Reading: Slides: Characteristics of Big Data - Volume
- Reading: Slides: Characteristics of Big Data - Variety
- Reading: Slides: Characteristics of Big Data - Velocity
- Reading: Slides: Characteristics of Big Data - Veracity
- Reading: Slides: Characteristics of Big Data - Value
- Reading: Slides: Characteristics of Big Data - Valence
Nota atribuída: V for the V's of Big Data
Data Science: Getting Value out of Big Data
We love science and we love computing, don't get us wrong. But the reality is we care about Big Data because it can bring value to our companies, our lives, and the world. In this module we'll introduce a 5 step process for approaching data science problems.
11 vídeos, 12 leituras
- Vídeo: Building a Big Data Strategy
- Vídeo: How does big data science happen?: Five Components of Data Science
- Reading: Five P's of Data Science
- Discussion Prompt: Let's Discuss: Thinking more deeply about the Ps
- Vídeo: Asking the Right Questions
- Vídeo: Steps in the Data Science Process
- Vídeo: Step 1: Acquiring Data
- Vídeo: Step 2-A: Exploring Data
- Vídeo: Step 2-B: Pre-Processing Data
- Vídeo: Step 3: Analyzing Data
- Vídeo: Step 4: Communicating Results
- Vídeo: Step 5: Turning Insights into Action
- Discussion Prompt: Let's Discuss: Building a Team
- Reading: Slides: Getting Value Out of Big Data
- Reading: Slides: Building a Big Data Strategy
- Reading: Slides: The Five P's of Data Science
- Reading: Slides: Asking the Right Questions
- Reading: Slides: Steps in the Data Science Process
- Reading: Slides: Step 1 - Acquiring Data
- Reading: Slides: Step 2A-Exploring Data
- Reading: Slides: Step 2B-Preprocessing Data
- Reading: Slides: Step 3-Data Analysis
- Reading: Slides: Step 4-Communicating Results
- Reading: Slides: Step 5-Turning Insights Into Action
Nota atribuída: Data Science 101
SEMANA 3
Foundations for Big Data Systems and Programming
Big Data requires new programming frameworks and systems. For this course, we don't programming knowledge or experience -- but we do want to give you a grounding in some of the key concepts.
4 vídeos, 4 leituras
- Vídeo: What is a Distributed File System?
- Vídeo: Scalable Computing over the Internet
- Vídeo: Programming Models for Big Data
- Reading: Slides: Getting Started-Why Worry About Foundations?
- Reading: Slides: What is a Distributed File System?
- Reading: Slides: Scalable Computing Over the Internet
- Reading: Slides: Programming Models for Big Data
Nota atribuída: Foundations for Big Data
Systems: Getting Started with Hadoop
Let's look at some details of Hadoop and MapReduce. Then we'll go "hands on" and actually perform a simple MapReduce task in the Cloudera VM. Pay attention - as we'll guide you in "learning by doing" in diagramming a MapReduce task as a Peer Review.
11 vídeos, 8 leituras
- Vídeo: The Hadoop Ecosystem: Welcome to the zoo!
- Vídeo: The Hadoop Distributed File System: A Storage System for Big Data
- Vídeo: YARN: A Resource Manager for Hadoop
- Vídeo: MapReduce: Simple Programming for Big Results
- Reading: MapReduce in the Pasta Sauce Example
- Vídeo: When to Reconsider Hadoop?
- Vídeo: Cloud Computing: An Important Big Data Enabler
- Vídeo: Cloud Service Models: An Exploration of Choices
- Vídeo: Value From Hadoop and Pre-built Hadoop Images
- Reading: Slides for Getting Started With Hadoop
- Reading: Downloading and Installing the Cloudera VM Instructions (Mac)
- Reading: Downloading and Installing the Cloudera VM Instructions (Windows)
- Reading: FAQ
- Reading: Copy your data into the Hadoop Distributed File System (HDFS) Instructions
- Vídeo: Copy your data into the Hadoop Distributed File System (HDFS)
- Reading: Run the WordCount program Instructions
- Vídeo: Run the WordCount program
- Discussion Prompt: Let's Discuss: Map Reduce in your life
- Reading: How do I figure out how to run Hadoop MapReduce programs?
Nota atribuída: Intro to Hadoop
Nota atribuída: Understand by Doing: MapReduce
Nota atribuída: Running Hadoop MapReduce Programs Quiz
Perguntas frequentes
Como funciona
Coursework
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Help from Your Peers
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Certificates
Earn official recognition for your work, and share your success with friends, colleagues, and employers.
Desenvolvedores
University of California San Diego
UC San Diego is an academic powerhouse and economic engine, recognized as one of the top 10 public universities by U.S. News and World Report. Innovation is central to who we are and what we do. Here, students learn that knowledge isn't just acquired in the classroom—life is their laboratory.
Custo
| Comprar curso | |
|---|---|
| Acesso aos materiais do curso | Disponível |
| Acesso a materiais valendo nota | Disponível |
| Receba uma nota final | Disponível |
| Obtenha um Certificado de Curso compartilhável | Disponível |
Classificações e avaliações
Good Introduction and overview, especially if you are very new. If you already new a little bit you can do fast orward the course and fill your gaps.
The only negative part is that the course it´s bit long and the last Quiz it´s really complex to a non IT person as me. The conceps and the knowledge I get has been very great
Very Systematic Learning. I am doing any online course for first time and it has really impressed me.
O Coursera proporciona acesso universal à melhor educação do mundo fazendo parcerias com as melhores universidades e organizações para oferecer cursos on-line.
© 2018 Coursera Inc. Todos os direitos reservados.
Ha
it was my first experience of an online course . the course was very suitable for the beginners as describes and was very easy to learn . Just had a little problem in starting the cloudera virtual machine by following the given steps in the course . coursera is very good learning platform . Thank You.