Senior Health AI Data Scientist — Remote Canada

Altis Technology; Canada; Remote; CAD 120,000 - 180,000; Full time

Job summary

Altis Technology is seeking a Senior Applied Data Scientist to help shape healthcare AI responsibly. You will design datasets and evaluation frameworks, work with clinicians and researchers, and influence AI safety and clinical relevance across patient care and operations.

Remote role in Canada with global collaboration. You will use Python/SQL, develop rigorous evaluation methods, and contribute to scalable QA and governance for regulated health data.

Qualifications

• 5+ years of progressive data science experience with at least 2 years in healthcare or regulated health data.
• Strong proficiency with Python, SQL, pandas, scikit-learn, statsmodels and modern evaluation tools.
• Experience designing machine learning datasets, annotation guidelines, QA processes, and evaluation methodologies.
• Working knowledge of healthcare standards & terminology including ICD-10, CPT, SNOMED CT, LOINC, RxNorm; familiarity with FHIR/HL7.
• Demonstrated experience evaluating Generative AI/LLMs/RAG and related evaluation frameworks.
• Strong statistics foundation: sampling, bias and fairness, inter-annotator agreement, confidence intervals, error analysis.
• Excellent communication to collaborate with clinicians and researchers.

Responsibilities

• Design high-quality datasets, annotation guidelines, evaluation rubrics, and sampling strategies for healthcare AI models.
• Develop statistically rigorous methods to measure model performance, fairness, reliability, and clinical accuracy.
• Collaborate with clinicians, researchers, and engineers to reflect real-world clinical workflows.
• Evaluate LLMs, RAG, and multimodal AI for safety, factual accuracy and guideline adherence.
• Establish QA processes and governance for regulated healthcare data handling.
• Contribute to reusable evaluation frameworks and healthcare taxonomies.

Skills

Python

SQL

pandas

scikit-learn

statsmodels

LLM evaluation

prompt engineering

data science methods

communication

Tools

FHIR/HL7 tooling

RAG pipelines

evaluation frameworks

Job description

Altis Technology is seeking a Senior Applied Data Scientist to help shape healthcare AI responsibly. You will design datasets and evaluation frameworks, work with clinicians and researchers, and influence AI safety and clinical relevance across patient care and operations.

Remote role in Canada with global collaboration. You will use Python/SQL, develop rigorous evaluation methods, and contribute to scalable QA and governance for regulated health data.