Correlation and Regression
Correlation and Regression
Analysis
CHRISTIAN BENEDICT, RN
Correlation
• Correlation mainly focuses on the relationship between
variables
Correlation
Different types of correlation
• Positive
• Negative
• Curvelinear
• Perfect negative relationships
• Perfect positive relationships
Types of Correlation
• Pearson R Correlation Coefficient
• Spearman Rank
• Kendel Tau
• Point Biserial Correlation
• Partial correlation
• Part correlation
Pearson R Correlation
• Is used to establish relationship between or among several
quantitative variables
• E.g., age, years of education, blood pressure,
Coefficient Strength
• Correlation coefficient always between -1 and+1
• The strength increases as coefficient moves away from zero
toward whether -1 or +1
• The extreme values +1 and -1 indicate perfect linear
relationship (points lie exactly along a straight line)
Strength of relationship
• Statistical significance is not the same as strength of relationship.
• Strength is indexed by square of the correlation coefficient. This is
called coefficient of determination
• Assessing relationship strength: Cohen principles
– .1 = small
– .3 = moderate
– .5 = large
Scedasticity
• Scedasticity refers to how close the scatter plot has its points
closer to the line drawn (line of best fit)
• When the points plotted are all close to the line of best fit
drawn ie. are of a high score as expressed in cohen’s
principle, this is termed as homoscedasticity
• In the same way when points plotted are farther apart from
the line of best fit and have little or no correlation as
expressed by Cohen’s principle it is termed as
heteroscedasticity
Regression Analysis
• Regression analysis predicts a quantitative dependent
variable from one or more independent variables
Uses of Regression
• Determine whether the independent variables explain a
significant variation in the dependent variable: whether a
relationship exists.
• Determine how much of the variation in the dependent
variable can be explained by the independent variables:
strength of the relationship.
• Determine the structure or form of the relationship: the
mathematical equation relating the independent and
dependent variables.
Uses of Regression
• Predict the values of the dependent variable.
• Control for other independent variables when evaluating the
contributions of a specific variable or set of variables.
Intercept and Gradient