The Director of Workplace Based Assessment will work under the supervision of the Assistant Dean of Assessment and Evaluation (A&E) to provide assessment and psychometric support and services for the University of Minnesota Medical School faculty and staff in the clinical environment.
The Director will assist in assessment development for workplace based assessment in the clinical environment. This person will apply necessary knowledge for best practices in development, design and implementation of direct observations of skills, checklists, rating scales, case presentations, Multi-source feedback and other direct observation protocols. This person will have thorough knowledge of assessment methods (reliability, generalizability, protocol analyses, validity theories, etc.) to work independently on most aspects of clinical assessment and evaluation initiatives.
This position is a term-limited position (1-year) contingent on funding.
Essential Job Functions
Collaborates with clerkship directors, clerkship coordinators and the Office of Curriculum to develop instructional objectives and assessment procedures.
Collaborates with faculty to ensure timely completion of clerkship assessments
Develops methods to automate routine evaluation and assessment data analysis procedures, with a focus on dynamic dashboards
Leads basic statistical/psychometric analyses of assessment instruments and directs identified research projectsAssists in developing and implementing Objective Structured Clinical Exams (OSCEs)
Ensures quality control of data compilation and analysis, results interpretation, and reporting.
Runs assessment workshops for faculty and others on protocol development and use
Takes responsibility for specific aspects of assessment project work, as identified by the Assistant Dean of A&E, including writing project materials and the design of research /assessment instruments.
Delivers presentations and potential workshops to share best practices in data analysis and interpretation in medical education.
Works independently to meet timelines/deadlines by applying the principles of project management.
60% - Conducts all aspects of operational work related to workplace based assessment tool development, data cleaning, calibration, scoring, quality control, and reporting. Uses various psychometric models to analyze assessment data. Produces analyses and summary data tables for use in data interpretation.
15% - Prepare technical reports and related documents as required
15% - Other duties to support the research and psychometric activities of the Assessment and Program Evaluation group
10% - Present to various audiences as required (e.g. at national meetings, local faculty development workshops, etc.)
Advanced degree in relevant field, and at least 6 years of experience
Experience with quantitative analysis in one or more statistical application (e.g., SPSS, SAS, EQS), including experience writing scripts for analysis
Effective oral and written communication skills for technical audiences
Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes
PhD in educational measurement, psychometrics, or other related field
Experience writing technical reports including results of quantitative / qualitative analyses
Experience with an ongoing assessment program (e.g., NBME boards exams, shelf exams, MCAT, national assessment programs, AAMC Graduation Questionnaire, AAMC DES etc.)
Experience communicating quantitative information to non-technical audiences
Experience working with medical teachers (PhDs, MDs) in assessment of clinical performance
Internal Number: 338406
About University of Minnesota, Twin Cities
The University of Minnesota, founded in the belief that all people are enriched by understanding, is dedicated to the advancement of learning and the search for truth; to the sharing of this knowledge through education for a diverse community; and to the application of this knowledge to benefit the people of the state, the nation, and the world.