Founding ML Engineer, Audio Evaluation & Pipelines

Cantina Labs

Netherlands

Remote

EUR 90,000 - 150,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Generous equity
Insurance – medical, dental, vision
Paid time off – 42 days
Parental leave & fertility support
401(k) retirement plan
Lifestyle spending account
In-office lunch and snacks
One Medical membership

Job summary

Cantina Labs is seeking an experienced Machine Learning Engineer to lead audio model evaluation for speech generation and recognition. You will build evaluation pipelines for development and production, and create automated dashboards reporting results, while shaping the future of the evaluation team.

As a founding member, you will drive metric design, coordinate with product and data teams, and guide model improvements based on comprehensive evaluations.

Qualifications

  • Ability to design metrics that capture model performance.
  • Experience designing user studies on Mechanical Turk or similar platforms.
  • Experience with training and fine-tuning models for evaluation.
  • Strong statistical knowledge to compare evaluation results and guide decisions.
  • Very strong engineering and programming skills.
  • Experience with training ASR and TTS models.
  • Experience in ML teams handling large-scale ML problems.

Responsibilities

  • Design evaluation pipelines for models in development and production.
  • Design user studies for subjective model evaluations.
  • Convert requirements into measurable metrics.
  • Develop automated evaluation dashboards to visualize model performance.
  • Train new models to capture new metrics.
  • Collaborate with the model team to improve models based on evaluation results.
  • Collaborate with the data team on data needs to improve performance.
  • Coordinate with product managers to ensure correct measurement of requirements.
  • Help grow and lead the evaluation team as the founding member.

Skills

Metrics design
User studies (Mechanical Turk)
Model training & fine-tuning
Statistics & data analysis
Engineering & programming
ASR & TTS training
Large-scale ML experience
>3B parameter models with >1m hours of

Job description

Cantina Labs is seeking an experienced Machine Learning Engineer to lead audio model evaluation for speech generation and recognition. You will build evaluation pipelines for development and production, and create automated dashboards reporting results, while shaping the future of the evaluation team.

As a founding member, you will drive metric design, coordinate with product and data teams, and guide model improvements based on comprehensive evaluations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer, Speech & Voice Conversion (End-to-End)
ML Engineer, Speech & Voice Conversion (End-to-End)

Cantina Labs • Netherlands

Remote
EUR 120,000 - 180,000
Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
+5
Machine Learning Engineer, Core Evaluations
Machine Learning Engineer, Core Evaluations

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Generous equity
Insurance – medical, dental, vision
+6
Senior Speech ML Engineer: TTS, Voice Cloning & AI
Senior Speech ML Engineer: TTS, Voice Cloning & AI

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Company equity
Medical, dental, vision insurance
+5
Machine Learning Engineer, Voice Conversion
Machine Learning Engineer, Voice Conversion

Cantina Labs • Netherlands

Remote
EUR 120,000 - 180,000
Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
+5
Machine Learning Engineer, TTS
Machine Learning Engineer, TTS

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Company equity
Medical, dental, vision insurance
+5
Senior ML Engineering Manager, Production Inference
Senior ML Engineering Manager, Production Inference

DeepL • Amsterdam

Hybrid
EUR 150,000 - 190,000
Hybrid work
Virtual Shares
Regular team events
+4
Research Engineer
Research Engineer

ElevenLabs • Netherlands

Remote
EUR 70,000 - 110,000
Senior ML Engineer - Evaluations Platform (Remote)
Senior ML Engineer - Evaluations Platform (Remote)

Prosus • Amsterdam

Hybrid
EUR 120,000 - 180,000
Relocation support
Amsterdam office base
Remote work arrangements
+2
AI Data Engineer - Large-Scale Pipelines (Remote)
AI Data Engineer - Large-Scale Pipelines (Remote)

RemoteWork • Netherlands

Remote
EUR 90,000 - 120,000
AI Engineer: End-to-End ML & Matching Systems
AI Engineer: End-to-End ML & Matching Systems

GloPros • Amsterdam

On-site
EUR 90,000 - 130,000