Test Developer I

American Board of Obstetrics and Gynecology, INC.; Dallas (TX); Hybrid; USD 70,000 - 95,000; Full time

Benefits offered by this job

Health, Dental, Vision benefits

HSA

employer-match 401(k)

Job summary

The American Board of Obstetrics and Gynecology (ABOG) in Dallas, TX, is seeking a Test Developer I – Continuing Certification. Hybrid schedule with 60% in-office presence, coordinating content and SME activities within the item bank and supporting editorial workflows.

Responsibilities include coordinating content, vendor relations, quality-control reviews, and preparing materials for meetings, with opportunities to contribute to process improvements and publishing activities.

Qualifications

• Bachelor’s degree preferred in Education, Health Sciences, English, or Communications.
• 1+ year of experience in test development, assessment coordination, or related field.
• Knowledge of psychometric principles and large-scale exam operations.
• Familiarity with copyright and permissions for assessment content.

Responsibilities

• Coordinate content and SMEs within the item bank for Continuing Certification assessments.
• Coordinate vendor relations for item-bank activities and issue escalation.
• Organize files/records for assessment development, including media assets.
• Support gap analysis and communication of risks to leadership.
• Edit content for grammar, punctuation, and format per style guidelines.
• Perform quality-control reviews of assessment content and materials.

Skills

Proficiency in assessment development

Strong organizational skills

Project management

Workflow optimization

Interpersonal communication

Written and verbal communication

Analytical and problem-solving

Ability to synthesize data for SMEs

Adaptability to changing priorities

Experience with web-based programs (MS

Education

Bachelor’s degree in Education, Health Sciences, English, or Communications

Tools

MS Word

MS Excel

MS PowerPoint

MS Office 365

MS Teams

Zoom

SharePoint

Item-bank platforms

Test delivery systems

Job description

Job Description

Job Description

** Department:** Office of Medical Standards and Assessments
** Reports To:** Director of Psychometrics and Assessment Science
** Location:** Dallas, TX – ABOG National Center for Certification and Continuing Education (Uptown); Hybrid Work environment with expectation for 60%

** Travel:** Meeting Travel Required (up to 10%) as needed.
** FLSA Status:** Exempt

Summary: The Test Developer I – Continuing Certification (CC) is responsible for coordinating and supporting logistics within and across the development team to ensure smooth workflows. The Test Developer I – CC is also responsible for coordinating and maintaining assigned Continuing Certification content and Subject Matter Expertise (SME) activities within the item bank and supporting vendor coordination. In addition, the Test Developer I – CC will support the content editorial team with editing.

Working within established assessment-development standards and under general direction, this role supports Continuing Certification assessment-development workflows, item-bank content readiness, SME coordination, quality-control activities, and assessment publishing. The Test Developer I – CC exercises professional judgment within established procedures when identifying content issues, coordinating assigned workflows, resolving routine operational matters, and escalating higher-risk or policy-level issues to senior staff or leadership.

** ESSENTIAL DUTIES AND RESPONSIBILITIES:**

• Coordinates and maintains content and Subject Matter Experts (SMEs) within the item bank, including assignments for SMEs, specifically for Continuing Certification assessments.
• Coordinates vendor relations (item bank), as needed, including routine communications, deliverable tracking, and escalation of service or system issues as appropriate.
• Organizes and maintains files/records related to assessment development, including images and video clips.
• Supports and maintains gap analysis for items within the item bank, identifying content needs and communicating gaps or potential risks to senior staff or leadership.
• Reviews and edits content for grammar, punctuation, spelling, and format, ensuring clarity, accuracy, and consistency according to ABOG and AMA style guidelines and psychometric standards.
• Performs assigned quality-control reviews of assessment content and materials in accordance with established standards and procedures.
• Identifies potential efficiencies and workflow improvements in the content-development process and provides recommendations to senior staff or leadership, while performing quality-control checks, as needed.
• Assists in developing, updating, and maintaining guides and procedures specific to item writing and editing for initial and continuing certification.
• Prepares content for assessment meetings, as needed.
• Supports meeting readiness by confirming content status, SME assignments, item/case materials, supporting documentation, and required follow-up items, and escalates identified issues as appropriate.
• Works with the Psychometrics and Research team on form layout/item reviews.
• Supports item and form review activities by coordinating materials, documentation, content updates, and follow-up requirements in accordance with established assessment-development processes.
• Supports assessment publishing activities with test delivery platforms in coordinating with senior staff, Psychometrics and Research, vendors, and other internal stakeholders.
• Interfaces with ABOG committees, Board of Directors, Subspecialty Divisions, and societies, as needed, to support assigned assessment-development activities and facilitate timely information flow.
• Assists the Director of Psychometrics and Assessment Science, and other assessment department members with office operations as requested.
• Participates in assessment development meetings, including participating in writing, editing, and review sessions.
• Tracks assigned assessment-development activities, stakeholder follow-up items, and deliverables to support established timelines and program requirements.
• Exercises professional judgment within established assessment-development standards when coordinating assigned workflows, identifying content or operational issues, resolving routine matters, and escalating higher-risk or policy-level matters as appropriate.
• Performs other duties as needed to support departmental and organizational goals.

** SKILLS AND QUALIFICATIONS:**

• Demonstrable Proficiency: Candidates may be required to demonstrate proficiency in essential skills during the interview process (e.g., work samples, analysis exercise, communication brief).
• Bachelor’s degree in a related field (e.g., Education, Health Sciences, English, Communications) preferred, or equivalent combination of education and experience.
• One or more years of experience in test development, assessment coordination, certification programs, content development, editing, project coordination, or a related field preferred.
• Knowledge and familiarity with basic psychometric principles (e.g., blueprinting, item performance analysis, standard setting concepts).
• Understanding of large-scale exam operations and vendor coordination (e.g., Pearson VUE or other test delivery providers) preferred.
• Familiarity with copyright and permissions processes for assessment content.
• Strong organizational, project management, and workflow optimization skills.
• Exceptional interpersonal, written communication, verbal communication , and collaboration skills.
• Ability to synthesize data into actionable feedback for SMEs (e.g., report cards) with appropriate guidance.
• Detail-oriented with strong analytical and problem-solving capabilities.
• Ability to exercise professional judgment within established standards, identify routine operational or content issues, and appropriately elevate matters requiring broader assessment-development decisions.
• Ability to maintain confidentiality and exercise discretion when working with secure assessment content, SME materials, candidate-related information, psychometric materials, and internal assessment records.
• Experience with web-based programs and software applications, including MS Word, MS Excel, MS PowerPoint, MS Office 365, MS Teams, Zoom, SharePoint, item-bank platforms, test delivery systems, and assessment-related systems.
• Ability to adapt to changing priorities and organizational needs.

** PHYSICAL REQUIREMENTS**

The following essential functions describe what must be accomplished and may be performed with or without reasonable accommodation:

• Primarily sedentary computer-based work; frequent keyboard/mouse use and on-screen analysis.
• Regular verbal and written communication in meetings and documentation; ability to present findings.
• Occasional standing/walking/meeting facilitation; occasional lifting/carrying of typical office items (up to 20 lbs.).
• Periodic travel (up to 10%) for meetings or conferences.

ABOG engages in an interactive process and provides reasonable accommodations to qualified individuals with disabilities.

** WORKING CONDITIONS**

Typical professional office/administrative environment with low noise levels; hybrid schedule with 60% in-office presence (role‑specific positions that align with the nature of their work) and periodic travel for meetings/conferences. Work involves handling sensitive information under strict confidentiality, data governance, and security protocols. ABOG provides reasonable accommodation throughout the application and employment process upon request.

COMPENSATION

Salary commensurate with experience and qualifications.

BENEFITS

Comprehensive benefits including Health, Dental, Vision, HSA, employer-match 401(k), Basic Life/AD&D, and LTD. Additional benefits and eligibility will be shared in the recruiting process.

EEO STATEMENT

ABOG is an Equal Opportunity Employer. We consider all qualified applicants without regard to race, color, religion, sex (including pregnancy, sexual orientation), national origin, age, disability, genetic information, veteran status, or any other protected status. We welcome requests for reasonable accommodation at any stage of the hiring process.

Company Description

Company Description

The American Board of Obstetrics and Gynecology (ABOG) is a national, non‑profit, apolitical organization that offers voluntary certification to obstetricians and gynecologists (OB‑GYNs) and offers continuing certification to OB‑GYNs in the United States and Canada.