AI Model Evaluation Specialist

Rise Data Labs

København

On-site

DKK 700,000 - 900,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rise Data Labs seeks an expert to evaluate and improve AI models through comprehensive testing and analysis. You will design evaluation frameworks, assess models, and deliver actionable insights for model improvement.

You will design metrics, test performance across scenarios, analyze outputs for bias and fairness, collaborate with ML engineers, and document findings to guide next steps.

Qualifications

  • PhD or Masters in Computer Science, ML, or related field.
  • 5+ years experience in AI/ML model evaluation.
  • Strong background in statistical analysis.
  • Experience with evaluation frameworks and metrics.
  • Excellent communication skills.

Responsibilities

  • Design and implement evaluation metrics for AI models.
  • Conduct thorough testing of model performance across different scenarios.
  • Analyze model outputs for bias, fairness, and accuracy.
  • Collaborate with ML engineers to implement improvements.
  • Document findings and recommendations.

Skills

Statistical analysis
Communication skills
Model evaluation

Education

PhD or Masters in Computer Science, ML, or related field
5+ years experience in AI/ML model evaluation

Tools

Evaluation frameworks
Performance metrics

Job description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.

Key Responsibilities
  • Design and implement evaluation metrics for AI models
  • Conduct thorough testing of model performance across different scenarios
  • Analyze model outputs for bias, fairness, and accuracy
  • Collaborate with ML engineers to implement improvements
  • Document findings and recommendations
Ideal Candidate
  • PhD or Masters in Computer Science, ML, or related field
  • 5+ years experience in AI/ML model evaluation
  • Strong background in statistical analysis
  • Experience with evaluation frameworks and metrics
  • Excellent communication skills
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Model Evaluation Architect
AI Model Evaluation Architect

Rise Data Labs • København

On-site
DKK 700,000 - 900,000
Remote ML/AI Expert — Evaluate & Improve AI Systems
Remote ML/AI Expert — Evaluate & Improve AI Systems

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,584,000
Remote work
Flexible hours
AI/ML Engineer
AI/ML Engineer

NovaGate Solutions • København

Hybrid
DKK 700,000 - 1,000,000
Computer Science PhD (Denmark)
Computer Science PhD (Denmark)

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,584,000
Remote work
Flexible hours
Remote ML/AI Expert (PhD in CS)
Remote ML/AI Expert (PhD in CS)

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,593,000
Remote work
Flexible hours
AI Engineer
AI Engineer

ACCENTURE Company • København

On-site
DKK 900,000 - 1,300,000
Computer Science PhD (Netherlands)
Computer Science PhD (Netherlands)

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,593,000
Remote work
Flexible hours
Healthcare & Medical Expert
Healthcare & Medical Expert

Anyone AI • København

Remote
DKK 277,000 - 553,000
Marketing Expert
Marketing Expert

Anyone AI Inc. • København

Remote
DKK 275,000 - 550,000
Senior Fellow - Scientific AI (Clinical Biostatistician)
Senior Fellow - Scientific AI (Clinical Biostatistician)

McKinsey • København

On-site
DKK 1,000,000 - 1,600,000
Top locations