Polynomial Regression and Pipelines

Loading...

Do curso por IBM

Data Analysis with Python

545 classificações

IBM

Data Analysis with Python

545 classificações

Curso 6 de 9 em Specialization IBM Data Science Professional Certificate

Learn how to analyze data using Python. This course will take you from the basics of Python to exploring many different types of data. You will learn how to prepare data for analysis, perform simple statistical analyses, create meaningful data visualizations, predict future trends from data, and more! Topics covered: 1) Importing Data sets 2) Cleaning the Data 3) Data frame manipulation 4) Summarizing the Data 5) Building machine learning Regression models 6) Building data pipelines Data Analysis with Python will be delivered through lecture, lab, and assignments. It includes following parts: Data Analysis libraries: will learn to use Pandas, Numpy and Scipy libraries to work with a sample dataset. We will introduce you to pandas, an open-source library, and we will use it to load, manipulate, analyze, and visualize cool datasets. Then we will introduce you to another open-source library, scikit-learn, and we will use some of its machine learning algorithms to build smart models and make cool predictions. If you choose to take this course and earn the Coursera course certificate, you will also earn an IBM digital badge. LIMITED TIME OFFER: Subscription is only $39 USD per month for access to graded materials and a certificate.

Na lição

Model Development

Model Development1:44

Linear Regression and Multiple Linear Regression6:34

Model Evaluation using Visualization4:44

Polynomial Regression and Pipelines4:25

Measures for In-Sample Evaluation3:37

Prediction and Decision Making5:03

Conheça os instrutores

Joseph Santarcangelo
Ph.D., Data Scientist at IBM
IBM Developer Skills Network

In this video, we will cover polynomial regression and pipelines.

What do we do when a linear model is not the best fit for our data?

Let's look into another type of regression model.

The polynomial regression.

We transform our data into a polynomial,

then use linear regression to fit the parameter.

Then we will discuss pipelines.

Pipelines are a way to simplify your code.

Polynomial regression is a special case of the general linear regression.

This method is beneficial for describing curvilinear relationships.

What is a curvilinear relationship?

It's what you get by squaring or setting higher order terms of

the predictor variables in the model transforming the data.

The model can be quadratic,

which means that the predictor variable in the model is squared.

We use a bracket to indicate it as an exponent.

This is a second order polynomial regression,

with a figure representing the function.

The model can be cubic,

which means that the predictor variable is cubed.

This is the third order polynomial regression.

We see by examining the figure that the function has more variation.

There also exists higher order polynomial regressions.

When a good fit hasn't been achieved by second or third order.

We can see in figures how much the graphs change,

when we change the order of the polynomial regression.

The degree of the regression makes

a big difference and can result in a better fit If you pick the right value.

In all cases, the relationship between the variable and the parameter is always linear.

Let's look at an example from our data where we generate a polynomial regression model.

In Python we do this by using the polyfit function.

In this example, we develop a third order polynomial regression model base.

We can print out the model.

Symbolic form for the model is given by the following expression,

negative 1.557 x1 cubed plus 204.8 x one

squared plus 8965 x1 plus 1.37 times 10 to the power of five.

We could also have multi-dimensional polynomial linear regression.

The expression can get complicated.

Here are just some of the terms for a two dimensional second order polynomial.

Numpy polyfit function cannot perform this type of regression.

We use the preprocessing library in scikit-learn to create a polynomial feature object.

The constructor takes the degree of the polynomial as a parameter.

Then we transform the features into

a polynomial feature with the fit underscore transform method.

Let's do a more intuitive example.

Consider the features shown here.

Applying the method we transform the data,

we now have a new set of features that are

a transformed version of our original features.

As the dimension of the data gets larger,

we may want to normalize multiple features in scikit-learn.

Instead we can use the preprocessing module to simplify many tasks.

For example, we can standardize each feature simultaneously.

We import StandardScaler. We train the object,

fit the scale object,

then transform the data into a new data frame on array x_scale.

There are more normalization methods available in

the preprocessing library as well as other transformations.

We can simplify our code by using a pipeline library.

There are many steps to getting a prediction.

For example, normalization, polynomial transform, and linear regression.

We simplify the process using a pipeline.

Pipeline sequentially perform a series of transformations.

The last step carries out a prediction.

First we import all the modules we need,

then we import the library pipeline.

We create a list of tuples,

the first element in the tuple contains the name of the estimator model.

The second element contains model constructor.

We input the list in the pipeline constructor.

We now have a pipeline object.

We can train the pipeline by applying the train method to the pipeline object.

We can also produce a prediction as well.

The method normalizes the data,

performs a polynomial transform,

then outputs a prediction.

Explore nosso catálogo

Registre-se gratuitamente e obtenha recomendações, atualizações e ofertas personalizadas.

O Coursera proporciona acesso universal à melhor educação do mundo fazendo parcerias com as melhores universidades e organizações para oferecer cursos on-line.

© 2018 Coursera Inc. Todos os direitos reservados.

Baixar na App Store

Baixar no Google Play