Doctoral Degrees (Industrial Psychology)

Permanent URI for this collection

https://scholar.sun.ac.za/handle/10019.1/718

Browse

Browsing Doctoral Degrees (Industrial Psychology) by browse.metadata.advisor "Augustyn, J. C. D."

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Psychometric implications of corrections for attenuation and restriction of range for selection validation research
    (Stellenbosch : Stellenbosch University, 1999-03) Theron, Carl Christiaan; Augustyn, J. C. D.; Stellenbosch University. Faculty of Arts and Social Sciences. Dept. of Psychology.
    ENGLISH ABSTRACT: The conditions under which selection procedures are typically validated and those prevailing at the eventual use of a selection procedure normally differ to a sufficient extent to challenge the relevance of the validation research evidence. Statistical corrections to the validity coefficient are generally available. The remainder of the argument in terms of which a selection procedure is developed and justified could, however, also be biased by any discrepancy between the conditions under which the selection procedure is simulated and those prevailing at the eventual use of the selection procedure. Relatively little concern, however, seem to exist for the transportability of the decision function derived from the selection simulation or the descriptions/ assessments of selection decision utility and fairness. This seems to be a somewhat strange state of affairs. The external validity problems with validation designs are reasonably well documented. It is thus not as if the psychometric literature is unaware of the problem of generalizing validation study research fmdings to the eventual area of application. The decision function is probably the pivot of the selection procedure in that it firstly captures the underlying performance theory, but more importantly from a practical perspective, because it guides the actual accept and reject choices of applicants. Restricting the statistical corrections to the validity coefficient would leave the decision function unaltered even though it might also be distorted by the same factors affecting the validity coefficient. Basically the same logic also applies to the evaluation of the decision rule in terms of selection utility and fairness. Correcting only the validity coefficient would leave the "bottom-line" evaluation of the selection procedure unaltered. Restricting the statistical corrections to the validity coefficient basically means that practically speaking nothing really changes. The fundamental research objective is to determine whether any discrepancy between the conditions under which the selection procedure is simulated and those prevailing at the eventual use of the selection procedure produces bias in estimates required to specify and justify the procedure; to delineate appropriate statistical corrections of the validity coefficient, decision rule and descriptions/ assessments of selection decision utility and -1< fairness, required to align the contexts of evaluation/validation and application; and to determine whether the corrections should be applied in validation research. The study provides no unqualified answers to the question whether corrections for various forms of range restriction and/ or criterion unreliability should be applied to the validity coefficient, the standard error of the validity coefficient or the parameters of the regression of the criterion on the predictor. Under specific conditions the corrections do affect decisions on the validity of performance hypotheses due to its effect on decisions on the significance of the uncorrected versus the corrected validity coefficient. Under specific conditions the corrections do affect decisions on applicants, especially when selection decisions are not restricted by selection quotas, due to its effect on the slope and intercept parameters of the regression of Y on X, and/ or due to its effect on the standard error of estimate.