Voltar para Fundamentals of Reinforcement Learning

4.8

estrelas

1,051 classificações

•

268 avaliações

Reinforcement Learning is a subfield of Machine Learning, but is also a general purpose formalism for automated decision-making and AI. This course introduces you to statistical learning techniques where an agent explicitly takes actions and interacts with the world. Understanding the importance and challenges of learning agents that make decisions is of vital importance today, with more and more companies interested in interactive agents and intelligent decision-making.
This course introduces you to the fundamentals of Reinforcement Learning. When you finish this course, you will:
- Formalize problems as Markov Decision Processes
- Understand basic exploration methods and the exploration/exploitation tradeoff
- Understand value functions, as a general-purpose tool for optimal decision-making
- Know how to implement dynamic programming as an efficient solution approach to an industrial control problem
This course teaches you the key concepts of Reinforcement Learning, underlying classic and modern algorithms in RL. After completing this course, you will be able to start using RL for real problems, where you have or can specify the MDP.
This is the first course of the Reinforcement Learning Specialization....

Apr 08, 2020

This course is one of the best I've learned so far in coursera. The explanations are clear and concise enough. It took a while for me to understand Bellman equation but when I did, it felt amazing!

Nov 10, 2019

I understood all the necessary concepts of RL. I've been working on RL for some time now, but thanks to this course, now I have more basic knowledge about RL and can't wait to watch other courses

Filtrar por:

por Муратов А В

•Feb 24, 2020

Too much history and talks about who we are. Not efficient time spent.

Poor explanations with count on book. Not suitable for listening or on the go study.

Easy things made so complicated. (First you forced to get into math and other roots in the book and then video with some explanations when already not needed.) And could be explained better, not in 3 minutes. This is red, this is green and here we go - Malevich.

Got some insights but not happy about time spent.

por Ekaterina R

•Feb 13, 2020

Not recommended

por Jonathan

•May 01, 2020

Very well put together course. It does a good job of walking you through concepts in a way that's direct and accessible, while not dumbing things down. I had bought the Intro to RL textbook some months back but ran into problems getting its material to 'stick', but the ideas in chapters 1-4 are much more concrete now.

Assignments were reasonably difficult, but not overwhelmingly so. Homeworks are designed to make sure you understand key concepts moreso than being vigilantly 'rigorous' for their own sake. Emphasis of the class is making sure you understand fundamental concepts moreso than hacking your way into a working prototype of something.

While the class is designed to be easily digested, the material assumes a working knowledge of programming and mathematical formalism, so people without some background knowledge you might struggle to keep pace, even if the material is well designed.

Also, like others have mentioned.......this class follows the book pretty carefully. Don't expect anything to be covered that's not in the RL textbook the course is based off of. By the end of the class the book material will be more vivid and concrete in your mind, but you will not have branched into a direction not covered within it.

por Mukund C

•Mar 08, 2020

Phenomenal Course. Very nicely done. Wish there were more active mentor engagement, however, since the student community for this course is not as large as at the time of this writing, so not much material to search through in the discussion forums. It will be good if some of the videos are consistent with the book - e.g. the notion of "control" is not in the text, but is introduced in Week4 for DP. Also, it'd be great to have some more lectures that dig deeper into "alternate" representation of Bellman equations (we are thrown this question in the quiz, but some working professionals, like myself can be quite rusty in English<=>Notation mindset, but that's a "very" small nitpick item.

por Maximiliano B

•Jan 30, 2020

This course is excellent and it is a great introduction to reinforcement learning. I really liked that an electronic version of the book from Sutton and Barto is available for download as part of the course. However, it is fundamental to read the book in advance before watching the videos every week to have a better understanding of the concepts. Mr. and Mrs. White explain the content very well and it helped me a lot because the book is sometimes quite abstract if you are dealing with this subject for the first time. I definitely recommend this course to have a solid foundation in Reinforcement Learning and I am looking forward to start the next course of the specialization.

por Everest L

•May 07, 2020

I've taken a few Coursera courses on machine learning/AI, and this is by far my favorite one. I love how the course is theoretically rigorous while still providing you with hands-on practice. Note: the short lecture videos don't contain all useful details, reading the (free) recommended textbook is a wise thing to do. Sometimes the quiz questions are drawn from the textbook, with slight modifications, and you'd be glad that you've worked through them prior.

No need to fret over reading every page of the textbook either, because recommended page ranges are given and they help.

por Mateo

•Sep 17, 2019

I found the course really helpful. I have been learning RL for some time and it was hear that almost finally i can say that a lot of the concepts that were vague in my head became clearer. Also it made me look at the book of Sutton and Barto and found that it was a good experience. Maybe more examples and questions in between videos as in deeplearning.ai of Andrew NG could be good for keeping with the attention could be nice. Also maybe doing more programming exercises in between the ones we did in order to implement each step would be great. Thank you very much!!!!

por Saraj s

•Aug 29, 2019

This is the best RL course I have ever attended. Even before starting this course I had brought the textbook (the one which course instructors also recommend) and was through the first 4 chapters. I understood most of the material but when I attended the class, everything was crystal clear. I hope instructors follow up and create the remaining courses as well. Please increase prgramming assignments in number as well. Thumbs up. Thanks for this course, very grateful.

por Kaylee Z

•Oct 03, 2019

I really like this course. This course introduces the basic mathematical background needed in RL, as well as provided algorithms and hands-on programming practices in translating algorithms into actual code, which is a well-blended material for students to learn! The quizzes are very helpful as well, which helps me understand the concepts better. All the methods discussed here are quite practical and intuitive. Thanks Martha and Adam making this course fun!

por Mohamed S R I

•Dec 22, 2019

The material in this course is of interest or me. It combines both theories and practical aspects of RL. The course follows the standard book in RL (Sutton & Barto Book).

One improvement may be needed is to add more "modern" examples and programming assignments/modules to explain the concepts. Also, it would be nice if the instructors can sometimes reflect on their own experiences with RL, rather than exactly following the book.

por Karel V

•Dec 16, 2019

The course is very well organised and professionally made. Although it follows the first four chapters of the Reinforcement Learning textbook, it provides a little bit different narrative and thus serves as a very nice complement to the textbook. Most importantly, interactive quizzes, programming exercises in Python and plenty of visualisations help to strengthen understanding of the concepts.

por 李谨杰

•Apr 26, 2020

This course is the best course I have taken in Coursera! As a learner of RL in a non-English-speaking country, Sutton's book is too hard for me to accept a new idea very quickly. However, after watching the short videos in this course that summarize the core concepts explicitly, I can understand the contents of that book easily. Recommend for anyone who wants to study reinforcement learning！

por Christian C C

•Aug 04, 2019

Exceptional course, the fundamental of RL explanations are excellent! I in particular I found it insightful the focus on thinking about examples in real-life that can be modeled as Markov Decision process. Additionally, great quizzes questions and assignments all helped in deepening my understanding of topics such as Dynamic Programing, Bellman Optimality, and Generalized Policy Iteration.

por Justin S

•Aug 23, 2019

Excellent Course! The level of difficulty is perfect. It is difficult but not impossible if you do the readings in the textbook and understand the lectures. I strongly suggest reading the book before watching the lectures. This helped my understanding significantly. The material and assignments are very interesting and informative.

Highly recommend this course to anyone interested in RL.

por Thomas G

•Apr 01, 2020

Fundamentals of Reinforcement Learning is one of the best Online Courses I did on Coursera. I like that the course is based on a text book (Reinforcement Learning by Sutton), so you can really dig into the theory. Also the exercises are very helpful and ambitious which I like. I haven't found much advanced online courses which are so well explained like this one.

por David R

•Dec 03, 2019

I really liked this course. I think it was challenging and high quality. I don't understand complaints about it following the book - I found the videos, quizzes and exercises insightful and thought provoking. And besides courses are meant to follow some material and not re-invent the wheel. Am really excited for the rest of the specialization.

por Nicolas

•Nov 20, 2019

The course was great. Very clearly explained, with meaningful examples and backup material, such as the recommended book.

My only comment will be on the case study given on the final programming assignment. The parking scenario was not very intuitive or clear for me. It took me quite a bit to understand what it was we were trying to optimize.

por Jesse W

•May 10, 2020

Excellent course. Covers all the basics at just the right challenge level, assuming you've had some Python programming experience and know a thing or two about probabilities and expectation values. They provide a PDF for a course textbook which is extremely well-written, and the videos are high-quality and complement the readings well.

por Mouafek A

•Apr 13, 2020

After studying Classical Machine Learning and Deep Learning, and applying them in real-life cases with some startups and companies, some aspects of day to day problems did not seem to be fit while trying to use the previous methods, thus I dived into Reinforcement Learning looking for answers, and so far it's been very promising!

por LUIS M G M

•Oct 25, 2019

I started to read Sutton & Barto book this summer, and although I find it fantastic, some concepts were not 100% clear to me. This course has changed it dramatically. Now every concept is clear to me. This book is like reading a book with the support of very good explanations.

Let's go for the 2nd course in the specialitation!!!

por Zhuang J

•Mar 24, 2020

You really need to understand fundamentals before kick start for any real world reinforcement learning problem. That's why this course is very essential. Plus it also provides programming tasks and multi-choice question sheet to deepen your understanding about theories. Great! Looking forward to move on for next series!

por Shashank S

•Apr 13, 2020

This course was a great first introduction to reinforcement learning! The course instructors make the material very accessible and the course follows the textbook very closely. I'd definitely recommend it to anyone trying to understand reinforcement learning and I personally plan to complete the entire specialization.

por Stelios S

•May 11, 2020

This is the BEST course I've taken from Coursera, period. The level of explanation, the usage of mathematically precise terminology, the walking through of the algorithms, the summaries were all top-notch. This course will be my reference when I forget something in the future. I can't thank the creators enough.

por Ali N

•Apr 01, 2020

It was a very good course, I had read Sutton's book first. But I must say that after completing this course, I learned the concepts of the book well. Although the exercises were a bit tough, they covered the topics well and increased learning at a faster rate.

For anyone interested, I recommend this course.

por Иванов К С

•Aug 29, 2019

It's difficult to estimate this course because it's based on the book. I mean, 90% of materials i've seen on videos were on the book. That's very unusual, but effective. However, i've learned necessary information and python tasks were useful and interesting. I'll take the next course and will see.

- IA para todos
- Introdução ao TensorFlow
- Redes neurais e aprendizagem profunda
- Algoritmos, parte 1
- Algoritmos, parte 2
- Aprendizagem Automática
- Aprendizagem automática com Python
- Aprendizagem automática usando o Sas Viya
- Linguagem R
- Introdução à programação com Matlab
- Análise de dados com Python
- Fundamentos da AWS: Going Cloud Native
- Fundamentos da Google Cloud Platform
- Engenharia de confiabilidade do site
- Fale inglês profissionalmente
- A ciência do bem-estar
- Aprendendo a Aprender
- Mercados Financeiros
- Testes de hipóteses em saúde pública
- Princípios da liderança no cotidiano

- Aprendizagem profunda
- Python para todosPython para todos
- Ciência de Dados
- Ciência de dados aplicada com Python
- Fundamentos de negóciosFundamentos dos Negócios
- Arquitetura com o Google Cloud Platform
- Engenharia de dados em Google Cloud Platform
- Excel para MySQL
- Aprendizagem de máquina avançada
- Matemática para aprendizagem automática
- Carros autoguiáveis
- Revolução do Blockchain para a empresa
- Análises empresariaisAnálises Empresariais
- Habilidades em Excel para negócios
- Marketing digitalMarketing Digital
- Análise estatística com R para saúde pública
- Fundamentos da imunologia
- Anatomia
- Gestão da inovação e Design Thinking
- Princípios da psicologia positiva