The University of Health Sciences (UHS) has formulated new policy guidelines and standard operating procedures for question bank development for MBBS and BDS professional examinations.
Examiners Toolkit, prepared by the UHS Committee for Conduct of Examinations (CCE), will be implemented this year after the approval of the university’s statutory bodies.
According to the policy, predefined difficulty levels for questions in all professional exams have been established, with each paper comprising 20% hard questions, 20% easy questions, and 60% moderate questions. The papers will encompass a mix of multiple-choice and short essay questions, evaluating knowledge, application, and problem-solving abilities.
Paper setters will be selected based on their subject matter expertise, a foundational understanding of medical education (e.g., certification in health profession education), and prior experience in evaluating medical students.
The assessment process will be conducted consistently, adhering to a predefined format to maintain uniformity in question styles, difficulty levels, and grading criteria.
Easy questions may be positioned at the beginning of the assessment to boost examinee confidence, while challenging items must be placed toward the end to differentiate candidates’ competencies.
The policy further ensures that paper setters align their question-creation process with Bloom’s Taxonomy of Cognition to ensure a comprehensive assessment of students’ understanding and capabilities. They will use resource books recommended in the curriculum to draw questions, ensuring alignment with prescribed content.
The Examiners Toolkit outlines that after a paper is finalized by the initial paper setter, it will undergo an internal review by another subject expert to assess its structure, difficulty level, alignment with learning objectives, and assessed domains.
The feedback will be shared with the paper setter to facilitate revisions and improvements, enhancing question quality.
Once the feedback is incorporated and revisions are made, the final version of the question paper will be made available for examination.
Questions selected after undergoing a review process will be stored in the Question Bank using software that can categorize items based on discipline, organ system/clinical presentation, question type (e.g., MCQ, SEQ, OSPE/OSCE), years of first and subsequent uses, difficulty index, and discrimination index on first and subsequent uses.
The cybersecurity of the Question Bank will be maintained through cloud computing, document encryption with physical keys, strong and regularly changed passwords, two-factor authentication (2FA), and biometric security.
To implement these SOPs, 56 committees of head examiners will be constituted for both MBBS and BDS programs, each comprising five senior faculty members, including three from the public sector and two from private sector colleges.
Three sets of question papers will be prepared for each subject, with only one set randomly selected for each examination. These papers will be prepared using approved resources and reference books, and efforts will be made to avoid repeating questions consecutively in two exams.
The standardization protocols decided by the CCE will ensure standards of difficulty levels, cognitive levels and integrative approaches for basic and clinical subjects.
