Is the script concordance test a valid instrument for assessment of intraoperative decision-making skills?
GROUND: Intraoperative decision making requires both knowledge and experience. The script concordance test (SCT), based on cognitive psychology script theory, is a new tool of clinical-reasoning assessment that may be used to evaluate a candidate’s approach to ill-defined problems encountered in the operating room. METHODS: To develop and validate an SCT for assessment of intraoperative decision making. One hundred questions were prepared based on the objectives for residency training of the American Board of Surgery. These questions were reviewed for face and content validity by 3 board-certified general surgeons. The SCT was administered to 36 general surgical residents ranging from R1 to R5. The scoring grid was obtained by giving the test to 10 board-certified general surgeons who completed the test independently. Aggregate scoring was used. After question optimization, the final test used for statistical analysis was composed of 62 questions. RESULTS: The test had excellent reliab