Chapter 13 Simple Regression
Chapter 13 Simple Regression
Chapter 13 Simple Regression
Correlation
GOALS
2
History of Regression
Some examples.
⚫ Is there a relationship between the amount Healthtex
spends per month on advertising and its sales in
the month?
⚫ Can we base an estimate of the cost to heat a home
in January on the number of square feet in the
home?
⚫ Is there a relationship between the miles per gallon
achieved by large pickup trucks and the size of
the engine?
⚫ Is there a relationship between the number of hours
that students studied for an exam and the score
earned?
6
Correlation Analysis
7
Fundamental difference between
correlation and regression
10
Scatter Diagram
11
The Coefficient of Correlation, r/R
12
Perfect Correlation
13
Minitab Scatter Plots
14
Correlation Coefficient - Interpretation
15
Correlation Coefficient - Formula
16
Coefficient of Determination
18
Correlation Coefficient - Example
19
Correlation Coefficient – Excel Example
20
Correlation Coefficient - Example
However, does this mean that more sales calls cause more sales?
No, we have not demonstrated cause and effect here, only that the
two variables—sales calls and copiers sold—are related.
21
Coefficient of Determination (r2) - Example
22
Linear Regression Model
23
Computing the Slope of the Line
24
Computing the Y-Intercept
25
Regression Analysis
26
Regression Analysis – Least Squares
Principle
27
Illustration of the Least Squares
Regression Principle
28
Regression Equation - Example
29
Finding the Regression Equation - Example
32
The Standard Error of Estimate
Y 2 − aY − bXY
^
(Y − Y ) 2
s y. x = s y. x =
n−2 n−2
33
Standard Error of the Estimate - Example
34
Graphical Illustration of the Differences between Actual ^
Y – Estimated Y (Y − Y )
35
Standard Error of the Estimate - Excel
36
Testing the Significance of
the Correlation Coefficient
37
38
Testing the Significance of
the Correlation Coefficient - Example
T hit = 3,40
T hit = -5,1
T hit = 1.23
39
Testing the Significance of
the Correlation Coefficient - Example
The computed t (3.297) is within the rejection region, therefore, we will reject H0. This means
the correlation in the population is not zero. From a practical standpoint, it indicates to the
sales manager that there is correlation with respect to the number of sales calls made
and the number of copiers sold in the population of salespeople.
40
Minitab
41
Dua Pihak 1 pihak kanan 1 pihak kiri
Formulasi Hipotesis
Ho : 𝛃i = 0 (Xi secara parsial tidak berpengaruh signifikan terhadap Y)
Ha/1 : 𝛃i > 0 (Xi secara parsial berpengaruh positif signifikan terhadap Y) → 1 pihak kanan
42
End of Chapter
43
Assumptions Underlying Linear
Regression
For each value of X, there is a group of Y values, and these
⚫ Y values are normally distributed. The means of these normal
distributions of Y values all lie on the straight line of regression.
⚫ The standard deviations of these normal distributions are equal.
⚫ The Y values are statistically independent. This means that in
the selection of a sample, the Y values chosen for a particular X
value do not depend on the Y values for any other X values.
44