Remote Biomedical Informatics SME: AI Benchmark Architect

Turing; San Francisco (CA); On-site; USD 110,000 - 193,000; Part time

Benefits offered by this job

Work in a fully remote environment

Opportunity on cutting-edge AI projects

Potential for contract extension

Job summary

A leading AI research accelerator is seeking Biomedical Informatics Subject Matter Experts to create rigorous evaluation questions for advanced AI models. The ideal candidate will have a strong academic background and experience in designing evaluative materials within bioinformatics. Responsibilities include developing coding questions and evaluation metrics. This role offers the opportunity to work remotely and tackle cutting-edge AI projects. Candidates should have expertise across multiple bioinformatics domains and demonstrate a commitment of at least 30 hours per week.

Qualifications

• Master's degree or PhD in a relevant field.
• 3+ years experience in biomedical data processing.
• Expert-level knowledge in at least two bioinformatics domains.

Responsibilities

• Design challenging bioinformatics coding questions.
• Create automated evaluations with unit tests.
• Build evaluation rubrics with 7-10 distinct criteria.

Skills

biomedical data processing, analysis, and interpretation

bioinformatics tools and pipelines

Python

R

Linux/Unix

Docker

communication and collaboration

Education

Master's degree in biomedical data processing

PhD in Biomedical Informatics or related field

3+ years of experience in biomedical data processing

Job description

A leading AI research accelerator is seeking Biomedical Informatics Subject Matter Experts to create rigorous evaluation questions for advanced AI models. The ideal candidate will have a strong academic background and experience in designing evaluative materials within bioinformatics. Responsibilities include developing coding questions and evaluation metrics. This role offers the opportunity to work remotely and tackle cutting-edge AI projects. Candidates should have expertise across multiple bioinformatics domains and demonstrate a commitment of at least 30 hours per week.