Technical Content Specialist

CWB Group; Hamilton; On-site; CAD 67,000 - 83,000; Full time

Job summary

A certification organization in Ontario seeks a Technical Content Specialist to develop and maintain quality certification exams. Candidates should have a degree in Psychology or a related field, strong collaboration skills with subject matter experts, and experience in psychometric analysis. This role offers opportunities for professional growth and requires effective project management to meet deadlines.

Qualifications

• Experience in psychometrics and assessment design.
• Ability to conduct item analysis and develop exam items.
• Strong project management skills.

Responsibilities

• Design and develop certification exams for engineers.
• Collaborate with SMEs on test specifications.
• Maintain compliance with testing standards.

Skills

Collaboration with SMEs

Psychometric analysis skills

Project management

Data management

Technical writing

Education

Degree in Psychology, Education, or related field

Job description

Compensation Band : 4

Compensation Range : $67, to $83, CAD per year

Overview

Your expertise shapes our business

At the CWB Group, we find fulfilment and inspiration knowing that we are performing meaningful and purposeful work. Every day is a new adventure with opportunities to learn from industry leaders and, most importantly, from each other. When you join the CWB Group, you become part of a diverse and inclusive, tight-knit team passionate about making a global impact.

Our commitment to Diversity, Equity and Inclusion (DEI)

The CWB Group believes that diversity and inclusion among our employees is critical to our success, and we seek to recruit, develop and retain the most talented employees from a diverse candidate pool.

Work with us and achieve your career goals

For almost 75 years, our employees have been the backbone of our business, driving our success and extraordinary reputation. We challenge our employees to take charge of their careers and provide growth opportunities, tools and resources to reach their goals.

What to expect

The Technical Content Specialist is responsible for the certification exams for the qualification of engineers, inspectors and supervisors. This role is responsible for designing, developing, analyzing, maintaining and validating examination instruments to ensure fairness, reliability, and validity. This role applies psychometric principles and statistical methods to maintain high-quality assessment programs that meet industry, accreditation, and organizational standards.

This includes :

Examination Maintenance and Development

• Collaborate with subject matter experts (SMEs) to design test specifications.
• Develop and review exam items, ensuring clarity, alignment with content standards, and cognitive complexity.
• Manage item bank systems, including tagging, version control, and security.

Psychometric Analysis

• Perform item analysis (difficulty, discrimination, distractor analysis) to improve question quality.
• Conduct equating and scaling to maintain score comparability across forms and administrations.

Quality Assurance & Validity

• Ensure compliance with professional testing standards (Standards for Educational and Psychological Testing, ISO guidelines).
• Validate exam content through codes and standards requirements and job task analyses.
• Evaluate fairness and accessibility of examinations.

Data Management & Reporting

• Prepare psychometric reports summarizing test performance, reliability, and validity evidence.
• Provide actionable recommendations to improve test forms and item banks.
• Maintain secure data handling practices in accordance with privacy regulations.

Stakeholder Collaboration

• Support accreditation and audit processes with psychometric documentation.

Project Management

• Maintain quality of certification exams to exceed KPI goals
• Prioritize work to meet deadlines
• Use learning resource tools and systems to manage and document assigned work
• Collaborate effectively with all members of the QA team
• Pro-actively problem solve challenges within projects
• Apply risk mitigation strategies to projects prior to initiation
• Provide status updates on all instructional design projects and timelines to the Registrar and Director, Quality Assurance and Public Safety.

Knowledge and Research

• Create learner and needs analyses for each examination type
• Assist in scoping and estimating all new projects
• Collaborate with subject matter experts to testing
• Maintain and stay up to date with current instructional design practice and adult learning concepts
• Consult with experts in specialist areas Full 10%

Other duties as assigned