Remote Biomedical Informatics SME: AI Benchmark Architect

Turing; Denver (CO); Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Fully remote work environment

Work on cutting-edge AI projects

Potential for contract extension based on performance

Job summary

A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This role involves designing complex bioinformatics questions, ensuring clarity and validity in assessment materials. Ideal candidates will have deep technical expertise, preferably a PhD or ongoing studies in Biomedical Informatics, and practical experience in the field. This position is fully remote and offers the opportunity to work on exciting AI projects with leading companies.

Qualifications

• Deep expertise in biomedical data processing and interpretation.
• Practical experience in designing assessment materials with verifiable outcomes.
• Experience in at least two core bioinformatics domains.

Responsibilities

• Design bioinformatics coding questions that challenge AI model capabilities.
• Create automated evaluations with unit tests for correctness.
• Build comprehensive evaluation rubrics with defined criteria.

Skills

Biomedical data processing

Bioinformatics tools and pipelines

Python

Linux/Unix

Collaboration in interdisciplinary teams

Education

PhD in Biomedical Informatics or related field

Master's degree in biomedical data processing

Tools

Docker

Job description

A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This role involves designing complex bioinformatics questions, ensuring clarity and validity in assessment materials. Ideal candidates will have deep technical expertise, preferably a PhD or ongoing studies in Biomedical Informatics, and practical experience in the field. This position is fully remote and offers the opportunity to work on exciting AI projects with leading companies.