Senior Programmer Analyst

Turtle Island Staffing; Canada; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading company is seeking a Senior Programmer/Analyst to develop and evaluate cognitive assessments. The ideal candidate will have extensive experience in psychometrics and statistical programming, with a strong educational background in psychology or education. This role involves collaboration with stakeholders and rigorous testing to ensure quality and compliance with best practices.

Qualifications

• Minimum five years of experience in developing standardized assessments.
• Ten years of experience in test development and evaluation.
• Experience in programming assessments using statistical languages.

Responsibilities

• Develop and evaluate cognitive assessments.
• Conduct testing and validation for quality assurance.
• Collaborate with stakeholders and prepare technical documentation.

Skills

Technical Expertise

Psychometric Evaluation

Statistical Programming

Education

PhD in Psychology or Education

Master's degree in Psychology or Education

Tools

R

Python

SAS

Matlab

SQL

Job description

1. Senior Programmer/Analyst
   1. Technical Expertise and Oversight: Provide guidance to support the effective development, deployment, and functional evaluation of a computer adaptive cognitive assessment, based on the organization’s IT platform, the psychometric requirements of the assessment, and available programming options.
   2. Development: Develop, modify, or evaluate a computer adaptive assessment of cognitive ability, and/or support the development of other types of cognitive assessments (e.g. gamification of an existing assessment, working memory).

• Testing and Evaluation: Conduct rigorous testing and validation of the developed assessment for quality assurance, compliance with psychometric best practices, and/or alignment with modern human resources practices.

1. Collaboration and Reporting: Work closely with the Technical Authority and internal stakeholders to ensure alignment with the CAF’s modernization initiatives. Prepare or oversee preparation of technical documentation, as required.

M1	Language Capacity The Bidder’s proposed resource(s) must demonstrate the capability to draft documentation and to clearly articulate concepts in English both in writing and orally with minimal error, and without assistance. This will be evaluated using the quality of the Curriculum Vitae (CV).
M2	Education Page Limit: one (1) page The Bidder’s proposed resource must hold one (1) of the following from a recognized Canadian university, or an equivalent credential from an accredited foreign institution: Option 1: A Doctor of Philosophy (PhD) in one of the following disciplines: · Psychology with a specialization in Psychometrics or Quantitative Psychology; or · Education with a specialization in Measurement, Evaluation, or Research Methodology. Option 2: A master’s degree in psychology in one of the following disciplines: · Psychology with a specialization in Psychometrics or Quantitative Psychology; or · Education with a specialization in Measurement, Evaluation, or Research Methodology. AND a minimum of five (5) years of experience in developing and evaluating standardized assessments or psychometric tools. The Bidder must identify the experience using the following format: Name of Employer: Position Title: Dates of Employment: Employer Representative: Employer Contact Information: Key responsibilities: A copy of the resource’s diploma(s) and a complete curriculum vitae (CV) must be included with the proposal.
M3	Experience - Test Development & Evaluation Knowledge Page Limit: one (1) page The Bidder’s proposed resource must have at least ten (10) years of experience and have worked on at least three (3) of the five (5) following aspects of test development and evaluation, with a focus on their role and the impact of their work. · Computer Adaptive Testing (CAT) / Item Response Theory (IRT) · Psychometric Evaluation of Tests (test and item level) · Test Design and Assembly · Item Banking · Test Equating The Bidder must identify the experience using the following format: · Name of Employer: · Position Title: · Dates of Employment: · Employer Representative: · Employer Contact Information: · Key responsibilities: The Bidder must include a complete curriculum vitae (CV) for the proposed resource.
M4	Experience – Statistical Programming Page Limit: one (1) page The Bidder’s proposed resource must have at least ten (10) years of experience leading or programming a test or an assessment system using statistical programming languages such as R, Python, or other similar languages (e.g., SAS, Matlab, SQL). The Bidder must identify at least two (2) relevant projects where their proposed resource(s) either programmed directly or responsible for the oversight of programming. The Bidder must identify the experience using the following format: · Name of Employer: · Position Title: · Dates of Employment: · Employer Representative: · Employer Contact Information: · Key responsibilities: specify whether the proposed resource was responsible for programming directly or overseeing a programming team. List the programming language(s) used in the project. · Description of the Project: brief summary of the scope and objectives. The Bidder must include a complete curriculum vitae (CV) for the proposed resource.