The differential item functioning and structural equivalence of a nonverbal cognitive ability test for five language groups
Loading...
Date
Authors
Schaap, Pieter
Journal Title
Journal ISSN
Volume Title
Publisher
OpenJournals Publishing
Abstract
ORIENTATION: For a number of years, eliminating a language component in testing by using
nonverbal cognitive tests has been proposed as a possible solution to the effect of groups’
languages (mother tongues or first languages) on test performance. This is particularly relevant
in South Africa with its 11 official languages.
RESEARCH PURPOSE: The aim of the study was to determine the differential item functioning (DIF)
and structural equivalence of a nonverbal cognitive ability test (the PiB/SpEEx Observance test
[401]) for five South African language groups.
MOTIVATION FOR STUDY: Cultural and language group sensitive tests can lead to unfair
discrimination and is a contentious workplace issue in South Africa today. Misconceptions
about psychometric testing in industry can cause tests to lose credibility if industries do not use
a scientifically sound test-by-test evaluation approach.
RESEARCH DESIGN, APPROACH AND METHOD: The researcher used a quasi-experimental design and
factor analytic and logistic regression techniques to meet the research aims. The study used a
convenience sample drawn from industry and an educational institution.
MAIN FINDINGS: The main findings of the study show structural equivalence of the test at a
holistic level and nonsignificant DIF effect sizes for most of the comparisons that the researcher
made.
PRACTICAL/MANAGERIAL IMPLICATIONS: This research shows that the PIB/SpEEx Observance Test
(401) is not completely language insensitive. One should see it rather as a language-reduced
test when people from different language groups need testing.
CONTRIBUTION/VALUE-ADD: The findings provide supporting evidence that nonverbal cognitive
tests are plausible alternatives to verbal tests when one compares people from different
language groups.
Description
Keywords
Five language groups, Differential item functioning, Structural equivalence
Sustainable Development Goals
Citation
Schaap, P. (2011). The differential item functioning and structural equivalence of a nonverbal cognitive ability test for five language groups. SA Journal of Industrial Psychology/SA Tydskrif vir Bedryfsielkunde, 37(1) Art. #881, 16 pages. DOI: 10.4102/sajip.v37i1.881