Correlation and Regression

Why Correlation and Regression Matter for Your Psychology Career

Let's be honest – statistics can feel like the least interesting part of psychology. You're probably more excited about helping people than calculating coefficients. But here's the reality: understanding correlation and regression is essential for being a competent psychologist. These tools help you evaluate whether a new therapy actually works, determine if a psychological test is worth using, and understand research that guides your clinical decisions. On the EPPP, this material shows up repeatedly, and in your career, it helps you distinguish between solid evidence and empty claims.

Think of correlation and regression as your research detective toolkit. They help you answer questions like: Does therapy attendance predict symptom improvement? Can childhood trauma scores help estimate adult anxiety levels? Do personality test results relate to job performance? These aren't just academic exercises – they're the foundation of evidence-based practice.

The Foundation: What Correlation Actually Tells Us

Correlation measures the relationship between two or more variables. In simple terms, it tells us whether two things tend to move together, move in opposite directions, or have no pattern at all.

Here's the key terminology shift: instead of calling something an "independent variable" like we do in experiments, correlation research uses the term predictor (or X variable). Instead of "dependent variable," we say criterion (or Y variable). {{M}}Think of it like using your current stress levels (predictor) to estimate how well you'll sleep tonight (criterion){{/M}}.

Most correlation coefficients range from -1.0 to +1.0, and they're usually symbolized with the letter "r."

• A perfect positive correlation (+1.0) means as one variable increases, the other increases in perfect lockstep
• A perfect negative correlation (-1.0) means as one variable increases, the other decreases in perfect lockstep
• Zero correlation (0.0) means there's no systematic relationship between the variables

{{M}}Imagine tracking your coffee consumption and your productivity. A positive correlation would mean more coffee = more productivity. A negative correlation would mean more coffee = less productivity (maybe you get too jittery). Zero correlation would mean coffee intake tells you nothing about your productivity{{/M}}.

Reading the Subscripts: A Critical Detail

Here's something students often miss: the subscript on a correlation coefficient tells you what you're looking at.

When you see two different letters or numbers (like r_xy), you're looking at the relationship between two different variables. This could be:

• A simple correlation between variables
• A criterion-related validity coefficient
• A factor loading

When you see two of the same letters or numbers (like r_xx), you're looking at a reliability coefficient – which is a different topic entirely.

The Three Critical Assumptions

Before you use correlation coefficients, three assumptions need to be met. When these assumptions are violated, your results can be misleading.

Assumption 1: Linear Relationships

The relationship between your variables needs to be linear – meaning when you plot the data points, they roughly form a straight line rather than a curve.

{{M}}Consider the relationship between anxiety and performance. At very low anxiety, performance might be poor (you're not motivated). At moderate anxiety, performance peaks (you're engaged). At very high anxiety, performance drops again (you're overwhelmed). This creates a curved, inverted-U relationship{{/M}}. If you calculate a standard correlation coefficient on this curved relationship, you'll underestimate how strongly anxiety and performance are actually related.

Assumption 2: Unrestricted Range

You need the full range of scores on your variables, not just a narrow slice.

{{M}}Imagine you're studying the relationship between therapy experience and treatment effectiveness, but you only survey therapists with 15-20 years of experience. You've restricted your range – you're missing the beginners and the true veterans. Your correlation might show almost no relationship between experience and effectiveness, but that's only because you're looking at a narrow window where everyone has similar experience{{/M}}.

This is crucial for employment testing. If you validate a test only on people who were hired (and thus likely scored well), you're missing the lower range of scores, and your correlation will underestimate the test's true predictive power.

Assumption 3: Homoscedasticity

This intimidating term simply means that the variability in your criterion scores should be similar across all levels of your predictor scores.

{{M}}Suppose you're predicting client satisfaction scores from number of therapy sessions. If clients who attend few sessions have wildly varying satisfaction (some love it, some hate it), but clients who attend many sessions all have consistently high satisfaction, you've violated homoscedasticity. Your prediction accuracy will be different depending on whether you're predicting for low-attendance or high-attendance clients{{/M}}.

Choosing the Right Correlation Coefficient

Not all correlation coefficients are created equal. You choose based on your measurement scales:

Understanding Dichotomies

The distinction between true and artificial dichotomies trips up many students.

A true dichotomy is a variable that naturally exists in only two categories. {{M}}Pregnancy status is truly binary – you either are or aren't pregnant. There's no underlying continuum being artificially split{{/M}}.

An artificial dichotomy happens when you take a continuous variable and split it into two groups. {{M}}Exam scores are continuous (0-100), but when you apply a cutoff and create "pass" versus "fail" categories, you've artificially dichotomized a continuous variable{{/M}}.

Why does this matter? The biserial coefficient attempts to estimate what the correlation would have been if you hadn't artificially split that continuous variable. The point biserial coefficient treats the dichotomy as naturally occurring.

The Coefficient of Determination: Understanding Shared Variance

Here's where correlation gets practical. You can square any correlation coefficient to get the coefficient of determination, which tells you the percentage of variability in one variable that's explained by the other variable.

Let's make this concrete: Suppose you find that the correlation between therapeutic alliance scores and symptom improvement is r = .70. Square that (.70 × .70 = .49), and you discover that 49% of the variability in symptom improvement is explained by differences in therapeutic alliance quality. The remaining 51% is due to other factors – client motivation, life stressors, treatment type, medication, social support, and countless other influences.

This is incredibly useful for setting realistic expectations. {{M}}When a colleague tells you they found a "significant" correlation between a new assessment tool and treatment outcomes, ask for the coefficient. If r = .30, that means only 9% of the variance is explained (.30 × .30 = .09). That's statistically significant perhaps, but clinically, 91% of the variance is still unexplained{{/M}}.

Regression Analysis: From Correlation to Prediction

Once you've established that two variables are correlated, regression analysis lets you make predictions. The correlational study produces a regression equation – essentially a formula that takes someone's predictor score and estimates their criterion score.

{{M}}If you know that therapy attendance correlates with symptom reduction, regression lets you estimate: "A client who attends 12 sessions will likely show approximately X improvement in their depression scores"{{/M}}.

The crucial point: accuracy of prediction increases as the correlation increases. With r = .90, your predictions will be quite accurate. With r = .30, your predictions will be rough estimates at best.

This is why employment tests with low validity coefficients can still be problematic – they're not giving you much predictive power, even if they're "statistically significant."

Going Multivariate: Using Multiple Predictors

Real-world outcomes rarely depend on just one factor. Multivariate techniques let you use multiple predictors simultaneously, which mirrors the complexity of actual psychological phenomena.

Multiple Regression: Multiple Predictors, One Outcome

Multiple regression is used when you have two or more predictors and one continuous criterion variable.

{{M}}You might want to predict therapy outcome (criterion) using initial symptom severity, therapeutic alliance quality, homework completion rate, and social support level (four predictors). Multiple regression creates an equation that weighs each predictor optimally{{/M}}.

There are two main approaches:

Simultaneous (standard) multiple regression enters all predictors into the equation at once. This approach asks: "Considering everything together, what's the best prediction?"

Stepwise multiple regression adds predictors one at a time, identifying which ones add meaningful predictive power. This approach asks: "What's the minimum set of predictors I need for good prediction?"

The Multicollinearity Problem

Here's an important concept: ideally, each predictor should correlate highly with the criterion but show low correlations with other predictors. This ensures each predictor provides unique information.

{{M}}Imagine you're trying to predict client engagement, and your predictors include "sessions attended," "appointments kept," and "no-shows." These predictors are measuring almost the same thing – they're highly intercorrelated. This is called multicollinearity, and it creates problems because the predictors aren't giving you unique information{{/M}}.

Good multiple regression uses predictors that each capture something different about the criterion.

Other Multivariate Techniques

Canonical correlation extends multiple regression to situations with multiple continuous predictors AND multiple continuous criteria. {{M}}You might use several personality measures to predict multiple indicators of job performance simultaneously{{/M}}.

Discriminant function analysis is used when your criterion is categorical (nominal) rather than continuous. {{M}}You might use therapy engagement variables, symptom measures, and demographic information to predict which treatment group a client should be assigned to: brief therapy, standard therapy, or intensive therapy{{/M}}.

Logistic regression serves the same purpose as discriminant function analysis but works when the statistical assumptions for discriminant function analysis aren't met (like when your predictor variables aren't normally distributed).

Structural Equation Modeling: The Advanced Toolkit

Structural Equation Modeling (SEM) represents the sophisticated end of correlational techniques. While you won't need to perform SEM for the EPPP, you should understand what it does because you'll encounter it in research articles.

SEM combines factor analysis with multiple regression to test complex theories about how variables relate to each other. It's particularly powerful because it handles both observed variables (things you directly measure) and latent variables (underlying constructs you can't directly observe).

Observed variables (also called manifest variables or indicators) are the actual measurements you collect. {{M}}If you're studying depression, observed variables might include specific items from a depression scale: "I felt sad most days," "I had trouble sleeping," "I lost interest in activities"{{/M}}.

Latent variables (also called factors or constructs) are the underlying psychological constructs these measurements represent. {{M}}Depression itself is a latent variable – you can't directly observe "depression," but you infer it from the observed symptoms{{/M}}.

Exogenous and Endogenous Variables

Variables in SEM are classified as either exogenous or endogenous:

Exogenous variables aren't predicted or explained by other variables in your model. {{M}}They're like the starting points in your theoretical map – maybe childhood trauma or genetic predisposition{{/M}}.

Endogenous variables are predicted or explained by other variables in the model. {{M}}These are the outcomes or mediators – maybe current anxiety symptoms or coping strategies{{/M}}.

The Five Steps of SEM

While you won't perform these steps yourself, understanding the process helps you evaluate SEM research:

Step 1: Model Specification – Researchers specify their theoretical model, drawing a path diagram showing how variables relate. Observed variables appear in squares/rectangles, latent variables appear in circles/ovals, and arrows show relationships.

Step 2 & 3: Model Identification and Estimation – These are mathematically complex steps that you don't need to understand in detail for the EPPP.

Step 4: Model Evaluation – Researchers use statistics like the goodness-of-fit index (GFI) to determine whether their theoretical model fits the actual data well.

Step 5: Model Modification – If the fit is poor, researchers revise their model and test again.

{{M}}Think of SEM like testing whether your theory's roadmap matches the actual terrain. You propose how various psychological factors connect (your map), collect data (observe the terrain), and see whether your map accurately represents reality{{/M}}.

Common Misconceptions to Avoid

Misconception 1: "Correlation Equals Causation"

This is the classic error, but it bears repeating because it's so pervasive. A correlation between X and Y could mean:

• X causes Y
• Y causes X
• Some third variable Z causes both X and Y
• The relationship is coincidental

{{M}}If ice cream sales correlate with drowning deaths, that doesn't mean ice cream causes drowning. Both increase in summer due to a third variable: hot weather{{/M}}.

Misconception 2: "Low Correlation Means No Relationship"

A low Pearson r might mean no relationship, OR it might mean the relationship is nonlinear and you're using the wrong statistical tool. Always consider whether a curved relationship might exist.

Misconception 3: "Statistical Significance Means Practical Importance"

With large sample sizes, you can find statistically significant correlations that are practically meaningless. An r = .10 might be statistically significant with 1,000 participants, but it only explains 1% of the variance. Always look at effect size, not just significance.

Misconception 4: "Higher Correlations Are Always Better"

For predictors, yes – higher correlations with the criterion are better. But you want low correlations between your predictors to avoid multicollinearity. The best scenario is predictors that each capture something unique.

Practice Tips for Remembering

Memory Device for Choosing Coefficients

Create a simple decision tree:

1. Are both variables continuous? → Check if linear → Yes: Pearson r / Maybe not: Eta
2. Are both variables ranks? → Spearman rho
3. Is one continuous and one dichotomous? → Is the dichotomy natural (true)? → Yes: Point biserial / No: Biserial
4. Are both variables nominal? → Contingency coefficient

Remember the Assumptions with "LRH"

Linear relationships Range must be unrestricted
Homoscedasticity required

Squaring to Get Variance Explained

Practice this mental math:

• r = .70 → .49 (about half)
• r = .50 → .25 (one quarter)
• r = .30 → .09 (less than 10%)
• r = .80 → .64 (about two-thirds)

Multivariate Techniques Quick Reference

Key Takeaways

• Correlation measures relationships between variables, ranging from -1.0 to +1.0, with predictors (X) and criteria (Y) instead of independent and dependent variables

• Three critical assumptions must be met: linear relationships, unrestricted range, and homoscedasticity (equal variability)

• Choose the right coefficient based on your measurement scales – Pearson r for continuous variables, Spearman rho for ranks, point biserial for true dichotomies, biserial for artificial dichotomies, contingency for nominal

• Coefficient of determination (r²) tells you the percentage of variance explained – always square the correlation to understand practical significance

• Regression analysis creates equations for prediction, with accuracy depending on the strength of the correlation

• Multiple regression uses multiple predictors for one continuous criterion; multicollinearity (high intercorrelation among predictors) should be avoided

• Other multivariate techniques include canonical correlation (multiple predictors and criteria), discriminant function analysis (categorical criterion), and logistic regression (categorical criterion with violated assumptions)

• Structural Equation Modeling tests complex theories using observed and latent variables, involving model specification, evaluation, and modification

• Never confuse correlation with causation – relationships don't establish directionality or rule out third variables

• Statistical significance doesn't equal practical importance – always examine effect sizes and variance explained, not just p-values

Understanding correlation and regression isn't just about passing the EPPP – it's about becoming a psychologist who can critically evaluate research, make informed clinical decisions, and distinguish solid evidence from marketing claims. These tools help you be the evidence-based practitioner your clients deserve.