Multiple Paired Binary Variables
3c. Effect size measure
For the omnibus test (the Cochran's Q test) there are two effect size measures that are sometimes used. The first is a maximum-corrected version, known as eta-squared (η2) (Serlin, Carr, & Marascuilo, 1982), while the other is a chance-corrected version with symbol R (Berry, Johnston, & Mielke, 2007). The chance corrected version seems to be the one that is preferred, but is also more difficult to calculate.
The less prefered eta-squared can be calculated by subtracting one from the number of variables. In the example we had four variables so this would be 4 - 1 = 3. Then multiply this by the number of cases. In the example we had 150 respondents, so 3 x 150 = 450. Then divide the test statistic (Q) by this result. In the example Q was 19.385, so we get η2 = 19.385 / 450 ≈ .043.
In the example the chance-corrected measure was R = .026 which is very weak. We can add this to our report.
Cochran's Q test indicated that there are differences between the proportions among the four options of visited cinemas, χ2(3, N = 150) = 19.38, p < .001. The overall effect of the cinema on the results is relatively weak,R = .03.
A pairwise post-hoc Dunn test with Bonferroni adjustments was only significant for Munt vs. Arena (p = .024) and Munt vs. Movies (p < .001).
Click here to see how to obtain the effect size measures with SPSS (needs also a calculator), R (Studio), Excel, or Python.
with SPSS
with R (Studio)
with Excel
with Python
Jupyter Notebook from video, available here.
FAQ:
Q: How do I get that strange R in MS Word?
A: Type in a regular capital R, select it and change the font to 'Monotype Corsiva'.
Google adds