Statistical Analysis in Evaluation Research: Tools for Investigating Problems in VR Performance

This report reviews the ways in which statistical analysis can be used as a tool by vocational rehabilitation program managers to investigate the causes of problematic performance and generate strategies for corrective action. Two types of data collection are noted: operational studies and statistical data studies. Descriptions follow of two levels of analysis: client level (micro level) and site or agency level (macro level). Two functions fulfilled by client-level analyses are discussed: (1) checking the validity, reliability, and accuracy of the information used in standards and informational data elements and (2) following up the program managers' investigations and the results of the agency-level analysis to explore the detailed interaction between client characteristics, service interventions, and observed client outcomes. Each description of an approach is followed by a case example. Two questions for evaluative research on the standards that are addressed by agency-level analyses are then considered: (1) how is attainment on the various standards data elements related across the state vocational rehabilitation agencies and (2) what explains the differences among state vocational rehabilitation agencies in attainment on specific standards data elements? A case example follows each description of an approach. (YLB)