Exam Developer

Smart Justice California; United States; Remote; USD 60,000 - 80,000; Full time

Job summary

Smart Justice California is seeking an Exam Developer to enhance our certification programs. This remote position requires a Bachelor's degree and at least three years of relevant experience. Candidates should possess strong organizational abilities and technical writing skills, with a capacity to coordinate expert teams and maintain exam standards. We offer a dynamic work environment with competitive benefits, including paid time off and insurance. The role will involve project leadership and skillful communication with stakeholders.

Benefits

Paid Time Off (PTO)

401k with Employer Matching

Medical, Dental, and Vision Insurance

Life Insurance

Short/Long Term Disability Coverage

Qualifications

• Minimum 3 years of experience in certification organization.
• Strong editing and writing skills for technical content.
• Ability to travel approximately 20% for meetings.

Responsibilities

• Lead development of certification programs with SMEs.
• Maintain certification item banks and facilitate meetings.
• Develop meeting documentation and ensure exam quality.

Skills

Organizational skills

Technical writing

Attention to detail

Presentation skills

Interpersonal skills

Computer skills

Statistical concepts

Fluency in English

Proficiency in Spanish

Education

Bachelor's Degree

Job description

ABOUT CCO CERTIFICATION:

CCO Certification (CCO) is a wholly owned subsidiary of the National Commission for the Certification of Crane Operators (NCCCO). NCCCO was formed in 1995 as a nonprofit organization with its mission to develop effective performance standards for safe load handling equipment operation to assist all segments of general industry and construction.

CCO, established in 2014, supports NCCCO’s mission by developing effective performance standards; providing fair, valid, and reliable assessments; acting as an industry resource; and being the leader in providing certifications for those who work in and around load handling equipment. CCO is headquartered in Murray, UT and maintains an office in Palm Harbor, FL.

POSITION SUMMARY:

The CCO certification team has an immediate opening for an Exam Developer position. The position is designated as a remote position but can also be based out of our offices in Palm Harbor, FL or Murray, UT if desired. This position’s primary responsibilities include working with the certification program development team on building new certification programs and maintaining and improving current programs in compliance with our ANAB ISO/IEC 17024 accreditation. The Exam Developer position reports to the Senior Program Manager, Certification.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

To perform this job successfully, an individual must be able to perform each essential duty and responsibility satisfactorily. Reasonable accommodation may be made to enable an individual with disabilities to perform the essential functions. Other duties may be assigned to meet business needs.

Serve as project lead for existing certification programs including the coordination of subject matter experts (SMEs) and work with the certification team to develop new certification programs.

Maintain item banks for assigned certification programs.

Facilitate in-person and virtual meetings for assigned committees.

Develop meeting agendas, reports, and meeting minutes in accordance with CCO’s house style to maintain appropriate and accurate records of all test development and maintenance activities.

Lead item development process with subject matter experts including editing test items to ensure that exam questions are consistent with psychometric standards, CCO’s standards, and English standards of grammar and spelling.

Assemble new examination forms and facilitate the form approval process with subject-matter experts (SMEs) and staff.
Review exam performance data and candidate feedback with SMEs with the goal of maintaining and improving items/exams over time.

Coordinate teams of SMEs.

Monitor progress on projects assigned as lead staff.

Maintain security of confidential test, candidate, and vendor information.

Make presentations regarding projects assigned as staff lead.

Assist psychometrician with role delineation / job analysis studies for new programs, and to update existing programs.

Assist in preparing and filing ANAB application submissions and responding to inquiries from ANAB and its assessors.

Assist with conducting cut score studies, analysis of cut score data and establishing exam passing points.

Assist the certification program development team with conducting quality assurance checks, publishing, and launching of new exams.

Assist the Psychometrician with interpreting item and test analysis results, and improving exams based on those results.

Assist in the development and maintenance of practical (performance) exams in collaboration with SMEs and staff.
Perform other job-related duties as assigned.

EDUCATION AND/OR EXPERIENCE:

Bachelor’s Degree, with a minimum of three (3) years of work experience in a similar role with a certification organization.
Knowledge, skills, and abilities:

Strong organizational skills to work effectively in either a team setting and independently on concurrent processes and projects to meet established goals, deadlines, and quality standards.

Excellent ability to write, analyze, and edit technical test questions and other materials for clarity.

Strong spelling, grammar, and proofreading skills, with excellent attention to detail.

Excellent oral and written communication skills, including the ability to review/edit collateral program materials for print and web, and the ability to make effective presentations to stakeholder groups.

Strong interpersonal skills to work effectively with staff, volunteers, and stakeholders to accomplish CCO’s goals and objectives.

Solid computer software skills, including item banking, spreadsheet, Internet, email, and word processing.

Basic understanding of the certification industry’s standard testing principles and basic statistical concepts.

Experience in working with committees and SME volunteers.

Ability to maintain a positive attitude under stress.

Fluency in English

Proficiency in Spanish an advantage

Willingness and ability to travel (approximately 20%). Meeting travel ranges from two to five days, typically during the work week.

JOB CONDITIONS:

CCO is seeking qualified applicants who reflect and understand our values: Quality, Integrity, Fairness, Excellence, Service and Respect. CCO is a fast-paced, high-energy organization with an ambitious agenda and staff that is highly motivated. This position may experience high work demands under tight timelines.

CCO is an equal opportunity employer.

BENEFITS

Paid Time Off (PTO)
14 Paid Holidays
401k with Employer matching and Profit Sharing
Medical, Dental and Vision Insurance
Life Insurance
Short/Long Term Disability Coverage
Celebrating 29 years as an organization