Machine Learning Engineer, Core Evaluations

Cantina

Philippines

Remote

PHP 12,523,000 - 13,776,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity participation
Comprehensive health insurance (US)
42 days PTO (US)
Parental leave & fertility support
401(k) retirement plan
Lifestyle spending account
Office perks & meals

Job summary

Cantina Labs is seeking an experienced Machine Learning Engineer to lead audio model evaluation, focusing on speech generation and recognition. You will design evaluation pipelines for development and production, build automated dashboards, and train models to capture new metrics.

As a founding team member, you will help scale the evaluation program and guide future growth. You will collaborate with the model, data, and product teams to ensure metrics drive better models and informed decisions,

Qualifications

  • Experience designing metrics that capture model performance.
  • Experience designing user studies on Mechanical Turk or similar platforms.
  • Experience training and fine-tuning models for evaluation.
  • Strong statistical knowledge to compare results and guide decisions.
  • Excellent engineering and programming skills.
  • Experience training ASR/TTS models.
  • Experience on ML teams handling large-scale data (>3B models, >1M hours).

Responsibilities

  • Design evaluation pipelines for development and production models.
  • Design user studies for subjective evaluations.
  • Convert requirements into measurable metrics.
  • Develop automated evaluation dashboards for model performance comparisons.
  • Train new models to capture new evaluation metrics.
  • Collaborate with model team to improve models based on evaluation results.
  • Collaborate with data team to determine data needs for performance improvements.
  • Coordinate with product manager to ensure metrics reflect product requirements.
  • Help grow and lead the evaluation team as the founding member.
  • Lead the evaluation team in the future.

Skills

Metrics design
User studies (MTurk)
Model training
Statistics & analysis
Engineering proficiency
ASR model training
Large-scale ML experience

Tools

MTurk

Job description

About Cantina:

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role:

We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models.

This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results.

As the founding member of our evaluation team, the ideal candidate is expected to leverage their experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.

What You’ll Do:
  • Designing model evaluation pipelines for models in development and production

  • Designing user studies for subjective model evaluations.

  • Converting requirements into measurable metrics.

  • Designing and developing automated evaluation dashboard to see model performances and compare results.

  • Training new models to capture new and different evaluation metrics.

  • Communicating with the model team to help design better models based on the evaluation results.

  • Communicating with the data team to help decide the type of data necessary to improve model performance.

  • Communication with the product-manager to make sure product requirements are correctly measured.

  • Help grow the evaluation team as the founding member.

  • Lead the evaluation team in the future.

What You’ll Bring:
  • Strong experience and intuition for designing metrics that capture model performance.

  • Strong experience with designing user studies on Mechanical Turk or similar platforms. .

  • Strong experience with model training and fine-tuning for model evaluation.

  • Strong statistical knowledge and experience to statistically compare evaluation results and take decisions.

  • Very strong engineering and programming skills.

  • Experience with training ASR, TTS models.

  • Experience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)

Compensation:

The anticipated annual base salary range for this role is between $200,000-$220,000 (€170,000-€190,000). When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles:
  • Competitive salary and generous company equity

  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

  • 42 days of paid time off, including:

    • 15 PTO days

    • 10 sick days

    • 15 company holidays

    • 2 floating holidays

  • Generous parental leave & fertility support

  • 401(k) retirement savings plan

  • Lifestyle spending account – $500/month to use however you’d like

  • Complimentary lunch and snacks for in-office employees

  • One Medical membership, and more!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer, TTS
Machine Learning Engineer, TTS

Cantina • Philippines

Remote
PHP 12,571,000 - 13,828,000
Medical, dental, and vision insurance
Company equity
42 days paid time off
+5
Lead ML Engineer: Audio Model Evaluation & Dashboards
Lead ML Engineer: Audio Model Evaluation & Dashboards

Cantina • Philippines

Remote
PHP 12,523,000 - 13,776,000
Equity participation
Comprehensive health insurance (US)
42 days PTO (US)
+4
Machine Learning Lead
Machine Learning Lead

Social Discovery Group • España

Remote
PHP 7,524,000 - 11,285,000
Remote role
Vacation 28 days
Wellness days
+5
Senior ML Engineer – End-to-End Speech & TTS
Senior ML Engineer – End-to-End Speech & TTS

Cantina • Philippines

Remote
PHP 12,571,000 - 13,828,000
Medical, dental, and vision insurance
Company equity
42 days paid time off
+5
PH - GenAI Engineer
PH - GenAI Engineer

Thinking Machines Data Science • Philippines

Hybrid
PHP 800,000 - 1,200,000
Hybrid Set-Up
Health benefits
Professional development budget
+1
PH - GenAI Engineer
PH - GenAI Engineer

Thinking Machines Data Science, Inc. • Manila

Hybrid
PHP 2,009,000 - 3,125,000
Hybrid Set-Up
Professional development budget
Health insurance
GenAI Engineer - Hybrid Role with Growth & Benefits
GenAI Engineer - Hybrid Role with Growth & Benefits

Thinking Machines Data Science • Philippines

Hybrid
PHP 800,000 - 1,200,000
Hybrid Set-Up
Health benefits
Professional development budget
+1
PH - GenAI Engineer
PH - GenAI Engineer

Thinking Machines Data Science, Inc. • Taguig

Hybrid
PHP 558,000 - 781,200
Competitive salary
Hybrid work model
Health benefits
+2
Lead/Senior Data Scientist (Generative AI)
Lead/Senior Data Scientist (Generative AI)

Lingaro Group Philippines • Manila

Hybrid
PHP 1,200,000 - 2,100,000
Office as an option (remote or office)
Udemy learning platform access
Certificate training programs
+1
PH - GenAI Engineer
PH - GenAI Engineer

Thinking Machines Data Science Inc. • Taguig

Hybrid
PHP 600,000 - 900,000
Hybrid work
Health benefits
Professional development budget
+1
Top locations