Clinical Data Management AI Evaluation Expert

OpenTrain AI; Canada; Hybrid; CAD 191,000 - 287,000; Part time

Benefits offered by this job

Remote work

Flexible contract hours (20-25h/week)

English working language

Job summary

OpenTrain AI is seeking a Clinical Data Management AI Evaluation Expert for remote, part-time work. You will lead end-to-end clinical data generation and quality review across complete data rooms, ensuring realism, traceability, and internal consistency of datasets, tables, and narratives.

The role requires evaluating AI-generated data against CDISC/SDTM standards and developing evaluation materials, prompts, and rubrics for agent assessment. Strong data management leadership is essential.

Qualifications

• At least 5 years of clinical data management experience; 10–25 years preferred
• Experience overseeing complete clinical data rooms
• Hands-on CDISC and SDTM conformance experience
• Experience with EDC builds through database lock
• Ability to design prompts, golden outputs, and rubrics for AI-agent assessment

Responsibilities

• Lead clinical data generation across the complete data-room workflow
• Reconcile protocols, datasets, tables, listings, figures, narratives, and derived metrics
• Validate synthetic clinical data rooms for realism, internal consistency, and traceability
• Perform cross-file checks to ensure patient-level references and results are accurate
• Design prompts, rubrics, and scoring criteria for AI evaluation
• Assess CDISC/SDTM conformance of generated data

Skills

Clinical data management

Data quality judgment

Prompts/design rubrics

Project coordination

Tools

CDISC

SDTM

EDC systems

Job description

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is hiring and contracting for this role, helping qualified specialists apply their expertise to projects that shape how advanced AI systems are built.

Creating an OpenTrain account is free. You can build a profile that reflects your experience, discover relevant projects, and apply in minutes.

About AI Training Work

AI training is the human side of developing artificial intelligence. Experts generate examples, review model outputs, and create evaluation standards so AI systems can perform specialized work accurately and responsibly.

In this role, your clinical data management judgment will help assess whether AI-generated clinical work is realistic, traceable, internally consistent, and aligned with applicable standards.

• Remote work supporting cutting-edge AI development
• Flexible contract work with a minimum commitment of 20 to 25 hours per week
• Direct use of specialized clinical data management expertise

The Role

OpenTrain is recruiting a Clinical Data Management AI Evaluation Expert to lead clinical data generation and quality review across complete clinical data rooms. You will examine protocols, datasets, tables, listings, figures, narratives, and derived metrics, ensuring that connected artifacts remain realistic, traceable, and internally consistent.

You will also create evaluation materials that measure an AI agent’s ability to perform comparable clinical data management work. The role is a remote contract opportunity for candidates in the United States or Canada.

• Contractor and part-time engagement
• Pay range: $100-$150 per hour
• Expected availability: at least 20-25 hours per week
• Preferred availability: 30 or more hours per week
• Default project commitment: 40 hours per week
• Working language: English

What You’ll Do

You will manage expert review across the full clinical data-room workflow and translate your judgment into clear AI evaluation criteria. The work requires careful reconciliation from raw patient-level data through final outputs and derived results.

• Lead clinical data generation across the complete data-room workflow
• Reconcile protocols, datasets, tables, listings, figures, narratives, and derived metrics
• Validate synthetic clinical data rooms for realism, internal consistency, and traceability
• Perform cross-file checks to confirm patient-level references and derived results remain accurate
• Design prompts, golden outputs, and scoring rubrics for AI-agent evaluation
• Assess whether generated clinical data work meets applicable CDISC and SDTM conformance expectations

Required Experience and Skills

This role requires substantial clinical data management expertise and the ability to oversee interconnected clinical data artifacts. The structured listing identifies the experience level as entry level, while the role requirements call for at least five years of clinical data management experience, with 10 to 25 years preferred.

• At least 5 years of clinical data management experience; 10-25 years preferred
• Managerial oversight of complete clinical data rooms
• Hands-on experience with CDISC and SDTM conformance
• Experience with EDC builds through database lock
• Ability to enforce consistency across raw data, tables, listings, figures, narratives, and derived metricsStrong judgment when evaluating synthetic clinical data for realism, traceability, and internal consistency
• Ability to design prompts, golden outputs, and rubrics for AI-agent assessment

Who Should Apply

This opportunity is designed for clinical data management professionals who have led end-to-end workflows and can evaluate both clinical artifacts and the quality of AI-generated work. Experience translating expert review criteria into practical prompts, golden outputs, and scoring rubrics will be especially useful.

The project is open to qualified candidates located in the United States or Canada who can support the stated weekly time commitment.

• Clinical data management leaders and experienced specialists
• Professionals familiar with EDC builds, database lock, CDISC, and SDTM
• Experts comfortable reviewing synthetic clinical data rooms
• Candidates able to work at least 20-25 hours per week

Build Your AI Training Career With OpenTrain

Every major AI system depends on carefully prepared and reviewed examples. By contributing clinical expertise, you can help shape how AI handles specialized data management tasks while building experience in a fast-growing area of tech.

OpenTrain gives you a place to develop a durable AI training profile, discover projects aligned with your background, and apply for new opportunities as your experience grows.

• Create a free OpenTrain account
• Build a profile showcasing your clinical data management expertise
• Apply to this contract opportunity in minutes
• Grow a portfolio in AI training and data evaluation