Overview The Director of Workplace Based Assessment will work under the supervision of the Assistant Dean of Assessment and Evaluation (A&E) to provide assessment and psychometric support and services for the University of Minnesota Medical School faculty and staff in the clinical environment. The Director will assist in assessment development for workplace based assessment in the clinical environment. This person will apply necessary knowledge for best practices in development, design and implementation of direct observations of skills, checklists, rating scales, case presentations, Multi-source feedback and other direct observation protocols. This person will have thorough knowledge of assessment methods (reliability, generalizability, protocol analyses, validity theories, etc.) to work independently on most aspects of clinical assessment and evaluation initiatives.
This position is a term-limited position (1-year) contingent on funding.
Essential Job Functions
Collaborates with clerkship directors and coordinators to develop instructional objectives and assessment procedures.
Ensures quality control of data compilation and analysis, results interpretation, and reporting.
Assists in developing and implementing Objective Structured Clinical Exams (OSCEs)
Works independently to meet timelines/deadlines by applying the principles of project management.
Takes responsibility for specific aspects of assessment project work, as identified by the Assistant Dean of A&E, including writing project materials and the design of research /assessment instruments.
Leads basic statistical/psychometric analyses of assessment instruments and directs identified research projects
Runs assessment workshops for faculty and others on protocol development and use
Develops methods to automate routine evaluation and assessment data analysis procedures, with a focus on dynamic dashboards
Delivers presentations and potential workshops to share best practices in data analysis and interpretation in medical education.
Job Description 60% - Conducts all aspects of operational work related to workplace based assessment tool development, data cleaning, calibration, scoring, quality control, and reporting. Uses various psychometric models to analyze assessment data. Produces analyses and summary data tables for use in data interpretation. 15% - Prepare technical reports and related documents as required 15% - Other duties to support the research and psychometric activities of the Assessment and Program Evaluation group 10% - Present to various audiences as required (e.g. at national meetings, local faculty development workshops, etc.)
PhD (educational measurement, psychometrics, or other closely related field), or advanced degree plus six years experience in development and implementation of workplace based assessments.
Experience with quantitative analysis in more than one statistical application (e.g., SPSS, SAS, EQS), including experience writing scripts for analysis
Effective oral and written communication skills for technical audiences
Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes
Additional Preferred Qualifications
PhD in educational measurement, psychometrics, or other related field
Experience writing technical reports including results of quantitative / qualitative analyses
Experience with an ongoing assessment program (e.g., NBME boards exams, shelf exams, MCAT, national assessment programs (Graduation Questionnaire, etc.)
Experience communicating quantitative information to non-technical audiences
Experience working with medical teachers (PhDs, MDs) in assessment of clinical performance
Internal Number: 334316
About University of Minnesota, Twin Cities
The University of Minnesota, founded in the belief that all people are enriched by understanding, is dedicated to the advancement of learning and the search for truth; to the sharing of this knowledge through education for a diverse community; and to the application of this knowledge to benefit the people of the state, the nation, and the world.