National Board of Medical Examiners
  • Philadelphia, PA, USA
  • Salary
  • Full Time

National Board of Medical Examiners (NBME) Overview:

The NBME is an independent, not-for-profit organization that provides high-quality examinations for the health professions. Protection of the health of the public through state-of-the-art assessment of health professionals is the mission of the NBME, along with a major commitment to research and development in evaluation and measurement. The NBME was founded in 1915 because of the need for a voluntary, nationwide examination that medical licensing authorities could accept as the standard by which to judge candidates for medical licensure. Since that time, it has continued without interruption to provide high-quality examinations for this purpose and has become a model and a resource of international stature in testing methodologies and evaluation in medicine. Although the NBME's mission is centered on assessment of physicians, it encompasses the spectrum of health professionals along the continuum of education, training, and practice and includes research in evaluation as well as development of assessment instruments.


The NBME has 500 employees and is located in Philadelphia's University City neighborhood, home to some of the country's most esteemed universities, nonprofit research institutes, and research and teaching hospitals.



The Vice President, Test Development Services (TDS), will lead the operational development of health professions assessments at the NBME, including the United States Medical Licensing Exam (USMLE).  The Vice President will be responsible for leading the department forward to achieve NBME long-term goals, including removing barriers and optimizing institutional integration, fostering and delivering effective and efficient communication, and implementing transformative process improvements. Duties include managing staff, fostering cross-organizational communication, leading innovation and change, ensuring operational excellence, and interacting with health professions volunteers and other stakeholders. 




Lead and manage a large group (100+) of test developers, including editors and technical staff.

  • Be an active steward of TDS, Professional Services, USMLE program, and NBME human and financial resources.
  • Provide leadership and oversight for workforce planning and creative staffing solutions for workload changes due to new and/or revised programs and processes.
  • Facilitate the development of professional development opportunities for managerial and non-managerial staff members.
  • Develop, monitor and oversee budget and make adjustments with appropriate consultation.
  • Demonstrate a deep understanding of and foster an atmosphere of collaboration and a positive working environment; provide strong support for the organizational culture statements


Manage cross-functional communication and decision-making in a matrixed organization, including building relationships with leadership in other internal groups.

  • Establish strong communication channels within Professional Services and with other groups that interact with TDS.
  • Work with other organizational leaders to ensure strategic alignment and cross-functional decision protocols for new and existing projects.
  • Provide advocacy for Test Development contributions to product planning and development discussions.


Oversee test development operations in an environment of continuous improvement.

  • Support staff-led process improvement efforts with quality (validity and reliability), efficiency, reduction in errors, maintenance of security, and cost as driving forces.
  • Provide consultation as requested to improve test development practices on individual exam programs.
  • Provide leadership, oversight, and subject matter expertise on initiatives related to new content formats, changes in content presentations, or uses of multimedia or other stimuli to enhance content.
  • Work collaboratively within the organization to provide strategies to increase test and pool security.
  • Leverage own or others' subject matter expertise in the review of exam materials, content outlines and other metadata used to code items as needed, based on outside inquiries, stakeholder questions, or staff requests for review.
  • Contribute to NBME strategic planning. Identify changes needed in TDS to operationalize NBME strategy.

 Establish and manage relationships with external NBME test development volunteers and stakeholders, including medical boards, governance committees, health professions clients, universities and other organizations.

  • Ensure that NBME maintains strong connections with the health professions community by maintaining existing and establishing new collaborations.
  • Be alert to the emergence of new domains in healthcare in which the measurement of professional performance may add value for healthcare professionals. Provide a vision for volunteer relationship management to achieve and maintain a capable and diverse volunteer faculty.
  • Represent NBME and TDS at meetings with USMLE committees, MSS committees, and health professions clients (existing and prospective), including international delegations.
  • Represent NBME at meetings of professional organizations and actively support NBME participation in national discussions through membership in various organizations, professional committee work, conference presentations, and preparation of articles for scholarly journals.
  • Facilitate the delivery of workshops or educationally-related presentations to medical schools and other health care-related educational programs both in the United States and internationally and professional organizations or societies as appropriate.
  • Provide support within the organization for relevant health professions assessment research and outreach, including research and development efforts in areas related to content and test development, new formats and item types.


Lead the conceptualization and implementation of technology solutions that expand online assessment capabilities and/or improve processes.

  • Identify emerging technologies that could benefit TDS by continuous environmental and market scanning in both medicine and assessment.
  • Lead TDS staff to anticipate, design, and implement appropriate technologies and process changes, and oversee the enhancement/transition of existing products to new technologies.
  • Provide sponsorship and oversight of new TDS-related systems. and improvements to existing systems
  • Represent TDS internally and TDS/NBME externally when working with consultants and external vendors who provide technology-related services.
  • Provide leadership support within TDS during the identification, planning, and implementation of new technologies.
  • Champion the change management process with TDS staff and volunteers adopting new technologies



  • High-quality, timely, and efficient operational delivery of test development services and products.
  • Effective, efficient and appropriate processes for collaboration, decision-making, and communication among Test Development Services and other units within Professional Services and NBME.
  • Thorough and efficient evaluation and effective and timely implementation of innovations in assessment, including new content formats, new content presentations, new uses of multimedia and new technology systems.
  • Systematic implementation of meaningful continuous quality improvement to existing systems, processes, practices, and services, including departmental best practices.
  • Comprehensive and effective budget planning and monitoring processes.
  • Regular and as-needed effective communications with members of USMLE, client and international test development and policy groups, volunteers, and other external stakeholders.



  • Excellent and demonstrated leadership skills including experience leading a test development organization, motivating and developing staff, overseeing an operational unit, and building and fostering relationships with internal and external stakeholders.
  • Ability to employ a systems-based approach to support optimal use and integration of resources, teams, volunteers and stakeholders.
  • Direct background in educational assessment or related testing, including knowledge of current issues in assessment, item development and test construction.
  • Proven ability to analyze and propose solutions to evaluation issues in the health professions and measurement problems in support of testing programs.
  • Demonstrated ability to work collaboratively across organizational divisions and with external stakeholders and the ability to influence others without direct authority.
  • Familiarity with health professions education generally and medical education specifically, including experience in medical education or educational testing with administrative responsibility for staff and project management.
  • Excellent oral, written, and presentation communication skills, including the ability to interact effectively with technical and non-technical audiences.
  • Excellent interpersonal skills, including the ability to work closely and well with people from a variety of professional backgrounds.



  • 10 + years of related work experience in medical education assessment or test development.
  • 8+ years of senior management experience of large teams with minimum of 4 direct reports and 100 employees.
  • Experience with organizational transformation, including the development and implementation of effective operating models in complex organizations with an emphasis on continuous improvement.
  • Strong desire for experience within healthcare, measurement, and operations.
  • Demonstrated ability to develop strategic relationships, influence, motivate, and lead/execute highly visible projects across organizational boundaries.
  • Demonstrated experience within technology-based solutions that expand on-line assessment and/or improve processes (conceptualization to Implementation).


  • Doctoral degree (Ph.D., M.D., J.D., Ed.D.) or equivalent experience.


The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. 

NBME is an equal opportunity employer as defined by the EEOE.



National Board of Medical Examiners
  • Apply Now

  • * Fields Are Required

    What is your full name?

    How can we contact you?

    I agree to ApplicantPro's Applicant Information Use Policy.*
  • Sign Up For Job Alerts!

  • Share This Page
  • Facebook Twitter LinkedIn Email
Home NBME Logo