Skip Navigation Linkstest-validation-n-analysis-software


​ ​
​​​Test Validation & Analysis Software 試驗驗證和分析軟體 ​​​​testvalidationnanalysissoftware0.jpg​​

The Test Validation & Analysis Program 包含了二個 Excel 工作簿是設計來被人事的專業人員使用來協助開發和驗證筆試的標準。

The Test Validation & Analysis Program (TVAP) includes two Excel Workbooks that are designed to be used by personnel professionals to aid in developing and validating written tests that address professional standards, the Uniform Guidelines on Employee Selection Procedures (1978), and relevant court cases. The Workbooks include macros, surveys, and formulas that address the standards applied in Contreras v. City of Los Angeles (656 F.2d 1267. 9th Cir. 1981) and U.S. v. South Carolina (434 US 1026, 1978). The Test Validation & Analysis Program includes:
  • 50-page Instruction Manual including directions, references, and appendices(including a Manual for writing better test items and for conducting effective Angoff Panels).
  • Test Item Survey that can be completed by subject-matter experts to gather validation evidence for written tests (14 questions are included that are designed to address testing standards, the Uniform Guidelines, and concepts derived from test litigation).
  • Test Item Survey Workbook (Excel workbook with over 10 programmed sheets) that can be used to input data from the Test Item Survey, tabulate the results, and screen test items for addressing specified test validation criteria.
  • Test Analysis Workbook which is used for inputting item Angoff ratings, setting a "critical score," conducting rater reliability and rater panel reliability analyses (and "outlier" raters), importing test score data, conducting item analysis (including point-biserial, item difficulty, and differential item functioning analyses to analyze test item bias), and test-level analyses (including Cronbach's Alpha, Kuder Richardson or KR-21 reliability, mean, standard deviation, classical standard error of measurement, and conditional standard error of measurement), setting a modified Angoff cutoff score using the procedure followed in the U.S. v. South Carolina case, and analyzing the cutoffs for adverse impact using the Fisher Exact (with mid-P correction) statistic and practical significance tests.​