Sign Test - Marketing Research
Sign Test - Marketing Research
Introduction
Many statistical tests require that your data follow a normal distribution. Sometimes
this is not the case. In some instances it is possible to transform the data to make them
follow a normal distribution; in others this is not possible or the sample size might be so
small that it is difficult to ascertain whether or not the data a normally distributed. In
such cases it is necessary to use a statistical test that does not require the data to follow
a particular distribution. Such a test is called a non-parametric or distribution free
test. The sign test is an example of one of these.
The sign test is used to test the null hypothesis that the median of a distribution is equal
to some value. It can be used a) in place of a one-sample t-test b) in place of a paired
t-test or c) for ordered categorial data where a numerical scale is inappropriate but where
it is possible to rank the observations. (Note that the Wilcoxon Signed Rank Sum Test
is also appropriate in these situations and is a more powerful test than the sign test.)
Example:
The table below shows the hours of relief provided by two analgesic drugs in 12 patients
suffering from arthritis. Is there any evidence that one drug provides longer relief than
the other?
Case Drug A Drug B Case Drug A Drug B
1
2.0
3.5
7
14.9
16.7
2
3.6
5.7
8
6.6
6.0
3
2.6
2.9
9
2.3
3.8
4
2.6
2.4
10
2.0
4.0
5
7.3
9.9
11
6.8
9.1
6
3.4
3.3
12
8.5
20.9
Solution:
In this case our null hypothesis is that the median difference is zero. Our actual differences (Drug B - Drug A) are:
+1.5, +2.1, +0.3, 0.2, +2.6, 0.1, +1.8, 0.6, +1.5, +2.0, +2.3, +12.4
Our actual median difference is 1.65 hours. We have r+ = 9, r = 3, n = 12, r =
max(r , r+ ) = 9. Therefore our two-sided p-value (from binomial tables) is p = 0.146.
We would conclude that there is no evidence for a difference between the two treatments.
Note that the Wilcoxon Signed Rank Sum Test would also be appropriate in this case
and is a more powerful test because it takes account of the magnitude of the differences
as well as the sign.
Negative Differences
Positive Differencesb
Tiesc
Total
N
3
9
0
12
Test Statisticsb
DRUGB - DRUGA
Exact Sig. (2-tailed) 0.146
a. Binomial distribution used.
b. Sign Test
If you were carrying out a one-sided test, you would need to divide the p-value by 2.
Case 2: Single set of observations
Note that in this case SPSS includes values that are exactly equal to the median it
takes r+ = the number of observations that are greater than M and r = the number
of observations that are less than or equal to M. Any ties should therefore be excluded
manually as follows: choose Data then Select Cases; choose If condition is satisfied
and click on If ; in the box type in your variable name then 6= M , where M is the median
value specified in your null hypothesis; click on Continue then OK and proceed as
detailed below.
Choose Analyze
Select Nonparametric Tests
Select Binomial
Choose the relevant variable as the Test Variable
Under Define Dichotomy in the lower left hand corner of the pop-up screen, choose
Cut Point and specify your null value (i.e. 0 in the case of paired data, etc.)
Click on OK
The output will look like this:
Binomial Test
Category
Drug B - Drug A
Group 1
Group 2
Total
0
>0
If you were carrying out a one-sided test, you would need to divide the p-value by 2.