AI Model Evaluation Architect

Rise Data Labs

København

On-site

DKK 700,000 - 900,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rise Data Labs seeks an expert to evaluate and improve AI models through comprehensive testing and analysis. You will design evaluation frameworks, assess models, and deliver actionable insights for model improvement.

You will design metrics, test performance across scenarios, analyze outputs for bias and fairness, collaborate with ML engineers, and document findings to guide next steps.

Qualifications

  • PhD or Masters in Computer Science, ML, or related field.
  • 5+ years experience in AI/ML model evaluation.
  • Strong background in statistical analysis.
  • Experience with evaluation frameworks and metrics.
  • Excellent communication skills.

Responsibilities

  • Design and implement evaluation metrics for AI models.
  • Conduct thorough testing of model performance across different scenarios.
  • Analyze model outputs for bias, fairness, and accuracy.
  • Collaborate with ML engineers to implement improvements.
  • Document findings and recommendations.

Skills

Statistical analysis
Communication skills
Model evaluation

Education

PhD or Masters in Computer Science, ML, or related field
5+ years experience in AI/ML model evaluation

Tools

Evaluation frameworks
Performance metrics

Job description

Rise Data Labs seeks an expert to evaluate and improve AI models through comprehensive testing and analysis. You will design evaluation frameworks, assess models, and deliver actionable insights for model improvement.

You will design metrics, test performance across scenarios, analyze outputs for bias and fairness, collaborate with ML engineers, and document findings to guide next steps.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Model Evaluation Specialist
AI Model Evaluation Specialist

Rise Data Labs • København

On-site
DKK 700,000 - 900,000
Remote ML/AI Expert — Evaluate & Improve AI Systems
Remote ML/AI Expert — Evaluate & Improve AI Systems

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,584,000
Remote work
Flexible hours
AI/ML Engineer
AI/ML Engineer

NovaGate Solutions • København

Hybrid
DKK 700,000 - 1,000,000
AI Solutions Architect for Impactful, Reliable Delivery
AI Solutions Architect for Impactful, Reliable Delivery

Hill-Top Consultancy • Denmark

Hybrid
DKK 700,000 - 900,000
Remote ML/AI Expert (PhD in CS)
Remote ML/AI Expert (PhD in CS)

Anyone AI Inc. • Denmark

Remote
DKK 1,179,000 - 1,593,000
Remote work
Flexible hours
Remote AI Marketing Task Designer - Independent Contractor
Remote AI Marketing Task Designer - Independent Contractor

Anyone AI Inc. • København

Remote
DKK 275,000 - 550,000
AI Strategy & Use-Case Lead
AI Strategy & Use-Case Lead

Terma Group • Aarhus kommune

Hybrid
DKK 700,000 - 900,000
International environment
Flexible working hours
Pension and health package
+3
AI Test Engineer: Accounting Eval & QA
AI Test Engineer: Accounting Eval & QA

Sumary ApS • København

On-site
DKK 700,000 - 900,000
Office in Copenhagen
Real ownership of projects
AI Engineer
AI Engineer

Y-Axis • Kolding

Hybrid
DKK 650,000 - 900,000
Lead AI/ML Scientist - Build Production-Ready Models
Lead AI/ML Scientist - Build Production-Ready Models

Twoday Denmark • København

On-site
DKK 1,100,000 - 1,500,000
Top locations