Director of Exam Development

Job Description:

Director of Exam Development

Description

Job Description

Office of Admissions

Annual Salary Range for Program Director II: $176,169 - $234,887

Annual Salary Range for Program Director III: $193,783 - $258,375

FLSA Exempt / Non-Union Represented

This position allows for up to four days of remote work per week

Summary

The Director of Exam Development (Program Director II or III) is a member of the State Bar's Executive Management Team and creates the mission and long-term vision of the Exam Development team within the Office of Admissions. The Director provides strategic leadership and operational oversight for development of the California Bar Exam, the First Year Law Students' Exam, and legal specialization exams. The role is responsible for managing all phases of exam content creation-including drafting, review, content validation, and standard validation-with a focus on fairness, validity, reliability, and compliance with psychometric and legal licensure standards. The Exam Development Director also oversees robust stakeholder engagement. This role is responsible for developing recommendations for examination content for the short- and long-term based on best practices for law licensure and other high stakes exams, while at the same time exploring innovations for California exams. The ideal candidate is an experienced assessment professional with a deep understanding of high-stakes licensure testing, content development methodologies, and psychometric principles.

Key Responsibilities

Strategic Leadership & Oversight

• Develop and implement strategic goals for exam development for exams within the Office of Admissions
• Set the strategic direction for the Exam Development team in alignment with the State Bar's mission to protect the public; lead the exam development team in the timely implementation of program goals and policies while effectively managing the allocation of resources.
• Lead initiatives to evaluate and apply innovative and emerging trends, best practices, and research to inform the development of the bar exam, the First Year Law Students' Exam, and legal specialization exams in accordance with State Bar strategic goals and objectives.
• Advise Executive Leadership, the Committee of Bar Examiners (CBE), Board of Trustees, and the California Supreme Court through regular reports and presentations.
• Promote an organizational culture focused on integrity, service excellence, and continuous improvement.
• In the short-term, set processes for and oversee the development of clear, accurate, and legally sound essay, performance test, and multiple-choice questions for State Bar exams which meet the appropriate criteria for each exam type.
• For the long-term, develop the future California Bar Exam based on the principles and direction from the Supreme Court, and designed to be the best assessment of minimum competence of entry-level lawyers.
• Evaluate and as necessary develop new first year law student and legal specialization exams.
• Ensure accurate, effective, and efficient processes for exam development, question drafting, validation, and final approval of exam content.
• Manage vendors, exam developers, content validation panelists, subject matter experts and others to ensure appropriate exam content.
• Collaborate with psychometric experts to ensure exams meet reliability, validity, and other exam content standards.
• Implement rigorous quality assurance protocols to eliminate bias and ensure accessibility and fairness.
• Maintain strict confidentiality to safeguard exam integrity and security.
• Use psychometric tools to evaluate and improve exam content.
• Oversee the development and implementation of operational systems, policies, and workflows.
• Manage exam content development and review schedules to meet critical deadlines.
• Develop and document procedures that support continuous improvement, transparency, and compliance.
• Coordinate timelines and workflows for content production and review cycles, meeting critical deadlines and ensuring timely delivery exam content.
• Keep abreast of best practices and emerging trends in legal licensure and assessment fields.
• Recommend and adopt new approaches when appropriate.
• Foster a culture of continuous learning, innovation, and process improvement within the team.
• Provide subject-matter expertise and staff support to the Committee of Bar Examiners (CBE) and its relevant subcommittees on matters related to exam development
• Develop and implement strategies for engaging key stakeholders, including legal education institutions, deans, and faculty, law students, licensees, disability rights advocates, and examinee advocacy groups, to inform exam development policies and practices, to enhance clarity, transparency, trust, buy-in, and alignment with organizational goals and public protection priorities.
• Deliver presentations and reports to internal and external stakeholders, including as part of public meetings.

Exam Design & Content Development

• In the short-term, set processes for and oversee the development of clear, accurate, and legally sound essay, performance test, and multiple-choice questions for State Bar exams which meet the appropriate criteria for each exam type.
• For the long-term, develop the future California Bar Exam based on the principles and direction from the Supreme Court, and designed to be the best assessment of minimum competence of entry-level lawyers.
• Evaluate and as necessary develop new first year law student and legal specialization exams.
• Ensure accurate, effective, and efficient processes for exam development, question drafting, validation, and final approval of exam content.
• Manage vendors, exam developers, content validation panelists, subject matter experts and others to ensure appropriate exam content.

Quality Assurance

• Collaborate with psychometric experts to ensure exams meet reliability, validity, and other exam content standards.
• Implement rigorous quality assurance protocols to eliminate bias and ensure accessibility and fairness.
• Maintain strict confidentiality to safeguard exam integrity and security.
• Use psychometric tools to evaluate and improve exam content.

Operations & Project Management

• Oversee the development and implementation of operational systems, policies, and workflows.
• Manage exam content development and review schedules to meet critical deadlines.
• Develop and document procedures that support continuous improvement, transparency, and compliance.
• Coordinate timelines and workflows for content production and review cycles, meeting critical deadlines and ensuring timely delivery exam content.

Innovation & Continuous Improvement

• Keep abreast of best practices and emerging trends in legal licensure and assessment fields.
• Recommend and adopt new approaches when appropriate.
• Foster a culture of continuous learning, innovation, and process improvement within the team.

Stakeholder Engagement and Communication

• Provide subject-matter expertise and staff support to the Committee of Bar Examiners (CBE) and its relevant subcommittees on matters related to exam development
• Develop and implement strategies for engaging key stakeholders, including legal education institutions, deans, and faculty, law students, licensees, disability rights advocates, and examinee advocacy groups, to inform exam development policies and practices, to enhance clarity, transparency, trust, buy-in, and alignment with organizational goals and public protection priorities.
• Deliver presentations and reports to internal and external stakeholders, including as part of public meetings.

Minimum Qualifications

Education:

• Bachelor's degree in a field that develops skills related to essential duties, or equivalent academic achievement.
• Master's degree is preferred and may substitute for up to two years of experience.

Experience:

• Minimum eight (8) years' progressively responsible experience in related program administration.
• Minimum four (4) years' senior management/supervisory experience in administering personnel and budget requirements.

License, Certificate, Registration Requirements:

• Juris Doctorate and/or special Qualifications including specialized knowledge, abilities, education, experience, or license may be established for individual positions.

Applicants meet who the Minimum Qualifications will be required to successfully complete the State Bar's selection process for this classification.

Preferred Qualifications

• Demonstrated experience developing content for high-stakes licensing or certification exams.
• Strong understanding of psychometric concepts, including content development, validity, reliability, and standard setting.
• Excellent project management, communication, and organizational skills.
• Strong ability to analyze assessment data to inform decision-making and improve test quality and effectiveness.
• Experience in designing and delivering training programs for item writers, reviewers, and other stakeholders involved in the assessment process.
• Knowledge of or experience with in-person and remote, testing platforms and exam security protocols.
• Experience communicating complex operational or policy issues to external stakeholders and members of the public in a clear, professional, and responsive manner.
• Commitment to carrying out the State Bar's values, including advancing diversity, equity, and inclusion in operational practices and team composition.

About the State Bar

The State Bar of California's mission is to protect the public and includes the primary functions of licensing, regulation, and discipline of attorneys; the advancement of the ethical and competent practice of law; and support of efforts for greater access to, and inclusion in, the legal system.

Our Values

Clarity | Investing in Our People | Excellence | Respect | Growth Mindset

Learn more about our values.

DEI Statement

We are a diverse, equitable, and inclusive workplace where all of our employees and prospective employees experience fairness, dignity, and respect.

Learn more about our commitment to DEI.