MODULE 16: INDPENDENT T-TEST

A. Assumptions
B. Running Independent T-test using SPSS
C. Interpreting Result of Independent T-test

OBJECTIVES/ LEARNING OUTCOMES:

By the end of this module, the students shall be able to:
1. Identify and check assumptions required for independent t-test;
2. Use SPSS in running independent t-test; and
3. Interpret results of independent t-test.

LEARNING CONTENT:
INDEPENDENT T-TEST
INTRODUCTION:

The independent-samples t-test (or independent t-test, for short) compares the means between two
unrelated groups on the same continuous, dependent variable. For example, you could use an independent
t-test to understand whether first year graduate salaries differed based on gender (i.e., your dependent
variable would be "first year graduate salaries" and your independent variable would be "gender", which
has two groups: "male" and "female"). Alternately, you could use an independent t-test to understand
whether there is a difference in test anxiety based on educational level (i.e., your dependent variable would
be "test anxiety" and your independent variable would be "educational level", which has two groups:
"undergraduates" and "postgraduates").

This module shows you how to carry out an independent t-test using SPSS Statistics, as well as
interpret and report the results from this test. However, before we introduce you to this procedure, you
need to understand the different assumptions that your data must meet in order for an independent t-test
to give you a valid result.

DISCUSSION:
A. ASSUMPTIONS

When you choose to analyse your data using an independent t-test, part of the process involves checking
to make sure that the data you want to analyse can actually be analysed using an independent t-test. You
need to do this because it is only appropriate to use an independent t-test if your data "passes" six
assumptions that are required for an independent t-test to give you a valid result. In practice, checking for
these six assumptions just adds a little bit more time to your analysis, requiring you to click a few more
buttons in SPSS Statistics when performing your analysis, as well as think a little bit more about your data,
but it is not a difficult task.

Before we introduce you to these six assumptions, do not be surprised if, when analysing your own data
using SPSS Statistics, one or more of these assumptions is violated (i.e., is not met). This is not uncommon
when working with real-world data rather than textbook examples, which often only show you how to carry
out an independent t-test when everything goes well! However, don't worry. Even when your data fails
certain assumptions, there is often a solution to overcome this. First, let's take a look at these six
assumptions:

o Assumption #1: Your dependent variable should be measured on a continuous scale (i.e., it is
measured at the interval or ratio level). Examples of variables that meet this criterion include
revision time (measured in hours), intelligence (measured using IQ score), exam performance
(measured from 0 to 100), weight (measured in kg), and so forth.
o Assumption #2: Your independent variable should consist of two categorical, independent
groups. Example independent variables that meet this criterion include gender (2 groups: male or
female), employment status (2 groups: employed or unemployed), smoker (2 groups: yes or no),
and so forth.
o Assumption #3: You should have independence of observations, which means that there is no
relationship between the observations in each group or between the groups themselves. For example,
there must be different participants in each group with no participant being in more than one group.
This is more of a study design issue than something you can test for, but it is an important assumption
of the independent t-test. If your study fails this assumption, you will need to use another statistical
test instead of the independent t-test (e.g., a paired-samples t-test).
o Assumption #4: There should be no significant outliers. Outliers are simply single data points
within your data that do not follow the usual pattern. The problem with outliers is that they can have
a negative effect on the independent t-test, reducing the validity of your results.
o Assumption #5: Your dependent variable should be approximately normally distributed for
each group of the independent variable. We talk about the independent t-test only
requiring approximately normal data because it is quite "robust" to violations of normality, meaning
that this assumption can be a little violated and still provide valid results. You can test for normality
using the Shapiro-Wilk test of normality, which is easily tested for using SPSS Statistics.
o Assumption #6: There needs to be homogeneity of variances. You can test this assumption in
SPSS Statistics using Levene’s test for homogeneity of variances.

B. Running Independent T-test using SPSS

In the section, we illustrate the SPSS Statistics procedure required to perform an independent t-test
assuming that no assumptions have been violated.

Problem Statement: The concentration of cholesterol (a type of fat) in the blood is associated with the
risk of developing heart disease, such that higher concentrations of cholesterol indicate a higher level of
risk, and lower concentrations indicate a lower level of risk. If you lower the concentration of cholesterol in
the blood, your risk of developing heart disease can be reduced. Being overweight and/or physically inactive
increases the concentration of cholesterol in your blood. Both exercise and weight loss can reduce cholesterol
concentration. However, it is not known whether exercise or weight loss is best for lowering cholesterol
concentration. Therefore, a researcher decided to investigate whether an exercise or weight loss intervention
is more effective in lowering cholesterol levels. To this end, the researcher recruited a random sample of
inactive males that were classified as overweight. This sample was then randomly split into two groups:
Group 1 underwent a calorie-controlled diet and Group 2 undertook the exercise-training program. In order
to determine which treatment program was more effective, the mean cholesterol concentrations were
compared between the two groups at the end of the treatment programs.

In SPSS Statistics, we separated the groups for analysis by creating a grouping variable
called Treatment (i.e., the independent variable), and gave the "diet group" a value of "1" and the

"exercise group" a value of "2" (i.e., the two groups of the independent variable). Cholesterol concentrations
were entered under the variable name Cholesterol (i.e., the dependent variable).

Step #1. Click Analyze > Compare Means > Independent-Samples T Test... on the top menu. You
will be presented with the Independent-Samples T Test dialogue box

Step #2. Transfer the dependent variable, Cholesterol , into the Test Variable(s): box, and transfer the
independent variable, Treatment , into the Grouping Variable: box, by highlighting the relevant variables

and pressing the buttons. You will end up with the following screen:
Step #3. You then need to define the groups (treatments). Click on the button. You will be
presented with the Define Groups dialogue box, as shown below:

Step #4. Enter "0" into the Group 1: box and enter "0" into the Group 2: box. Remember that we labelled
the Non-Athlete group as 1 and the Athlete group as 2.

Step #5. Click the button.

Step #6. If you need to change the confidence level limits or change how to exclude cases, click the

button.

Step #7. Click the button. You will be returned to the Independent-Samples T Test dialogue box.

Step #6. Click the button.

Output of the Dependent T-Test in SPSS Statistics

Two sections (boxes) appear in the output: Group Statistics and Independent Samples Test.
The first section, Group Statistics, provides basic information about the group comparisons, including the
sample size (n), mean, standard deviation, and standard error for mile times by group.

Group Statistics
Std. Std. Error
Treatment Program N Mean Deviation Mean
Cholesterol Calorie-Controlled Diet 20 6.1450 .51959 .11618
Concentration
Exercise-Training Program 20 5.7950 .38179 .08537

The second section, Independent Samples Test, displays the results most relevant to the
Independent Samples t Test. There are two parts that provide different pieces of information: (A) Levene’s
Test for Equality of Variances and (B) t-test for Equality of Means.
 Independent Samples Test

Levene's Test for

Equality of
Variances t-test for Equality of Means
95% Confidence
Interval of the
Difference
Sig.
(2- Mean Std. Error
F Sig. t df tailed) Difference Difference Lower Upper
Cholesterol Equal variances .314 .579 2.428 38 .020 .35000 .14418 .05813 .64187
Concentration assumed

Equal variances 2.428 34.886 .021 .35000 .14418 .05727 .64273

not assumed

In addition to reporting the statistical significance of the results of a t-test, it is also essential to
report the effect size. The effect size measures the strength of the relationship between the two
variables being tested. It provides a way to quantify the difference between the means of the two groups. It
can help readers better understand the practical significance of the results.

Cohen’s d is a standardized measure of effect size, representing the difference between the
means of the two groups in terms of standard deviations. To calculate Cohen’s d, you will need to know
each group’s mean and standard deviation. Here is the formula for Cohen’s d:

𝑀𝑒𝑎𝑛 1 − 𝑀𝑒𝑎𝑛 2
𝒅 = || ||
(𝑆𝐷 1) 2 + (𝑆𝐷 2)2
√
2

6.1450 − 5.7950
𝒅 = || ||
(0.51959)2 + (0.38179)2
√
2

𝒅 = 1.41

Once you have calculated Cohen’s d, you can use the following guidelines to interpret the results:
0.00-0.19 Very small
0.20-0.49 Small
0.50-0.79 Medium
0.80+ Large

C. Interpreting Result of Paired Sample T-test

Table 1. Mean Comparison of Cholesterol Concentration of Respondents under Calorie-Controlled Diet and
Exercise-Training Program

Calorie-Controlled Diet Exercise-Training Program

t (38) p Cohen’s d
M SD M SD

Cholesterol
6.15 0.52 5.80 0.38 2.428 0.020 1.41
Concentration
 Table 1 presents the mean comparison of cholesterol concentration of respondents under calorie-
controlled diet and exercise-training program. Results revealed that there is a significant difference
(t(38)=2.428, p=.020) in the cholesterol concentration of respondents under calorie-controlled diet and
exercise-training program. Hence, null hypothesis was rejected.

Findings also showed that the mean cholesterol concentration of respondents who underwent Calorie-
Controlled Diet (M=6.15, SD=0.52) is higher than those who undertook exercise-training program (M=5.80,
SD=0.38). The value of the Cohen’s d was 1.41 which indicated large effect size. This means that exercise-
training program is more effective for lowering cholesterol concentration

Prepared by:

MELVIN U. ESTOLERO, LPT

Instructor