Machine Learning Engineer, TTS

Cantina Labs

Netherlands

Remote

EUR 90,000 - 150,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Company equity
Medical, dental, vision insurance
Paid time off 42 days
Parental leave
401(k) retirement saving plan
Wellness stipend
In-office meals

Job summary

Cantina Labs is seeking a Research / ML Engineer to join the Speech Team and build state-of-the-art speech systems end-to-end—from data specs through production inference. You will drive the model data evaluation flywheel for TTS and related tasks, collaborating with research, data, and infra to ship reliable, cost-conscious models.

You’ll work at the intersection of cutting-edge research and practical engineering, contributing to safe, steerable, and trustworthy AI systems with a strong

Qualifications

  • Exceptional research/development experience with large-scale audio models.
  • Hands-on experience with transformer or diffusion models and audio language modelling.
  • Strong multi-node and multi-GPU distributed training experience.
  • Proven track record of building complex, production-quality systems.

Responsibilities

  • Architect and implement large-scale speech models and pre-/post-training steps.
  • Lead small research projects and collaborate on larger team initiatives.
  • Design and run rigorous experiments to advance model understanding.
  • Develop and improve dev tooling to boost team productivity.
  • Contribute across the stack from low-level performance to model design.
  • Define data requirements and guide data curation and labeling strategies.
  • Design automated evaluations and robustness checks and ensure production SLAs.

Skills

Transformer architectures
Distributed training
PyTorch
Production quality code
Voice cloning/ASR/VC

Tools

CUDA
Triton
C++

Job description

About Cantina

Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Our bots are lifelike, social creatures that can interact wherever people are online—across voice, video, and text. Create yourself, imagine someone new, or choose from thousands of characters to share infinitely scalable, personalized content and seamless group chat. If you’re excited about how AI can shape creativity and social interaction, come help us build what’s next.

About the Role

We’re looking for a Research / ML Engineer to join our Speech Team to build state-of-the‑art speech systems end‑to‑end—from data specs through production inference. You’ll drive the model data eval flywheel for TTS and adjacent tasks (voice cloning, controllable TTS, voice conversion and more), partnering closely with research, data, and infra to ship fast, reliable, and cost‑aware models. In this role, you will work at the intersection of cutting‑edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems.

What You’ll Do
  • Model Building: Architect, implement, pre‑train, fine‑tune, and post‑train/alignment (e.g., GRPO/DPO) for large‑scale speech models.
  • Project Leadership: Independently lead small research projects while collaborating on larger team initiatives.
  • Experimental Design: Design, run, and analyze scientific experiments to advance our understanding of the models.
  • Tool Development: Develop and improve dev tooling to enhance team productivity.
  • Full‑Stack Contribution: Contribute to the entire stack, from low‑level optimizations to high‑level model design.
  • Data Ownership: Define data requirements and collaborate on acquisition, curation, augmentation, labeling quality, and synthetic data strategies.
  • Rigorous Evaluation: Design automated objective/subjective evaluations—listening tests, SV/WER/ASR‑based metrics, robustness & bias checks, and red‑team studies.
  • Pipeline Delivery: Harden the training → evaluation → inference pipeline; profile latency, memory, and cost; and meet production SLAs with robust monitoring and rollback.
  • GPU Scaling: Partner with infrastructure to run distributed training/inference on cloud fleets and productionize models with reliability and observability.
  • Safety & Responsibility: Contribute to safety/consent guardrails and to misuse/abuse mitigation for responsible speech technology.
What You’ll Bring

Exceptional research/development experience with large scale audio models (>3B models and >500k hours data). Exceptional understanding and hands‑on experience with transformer architectures and/or diffusion models (inc. distillation and streaming) and/or audio language modelling. Strong experience with multi‑node and multi‑gpu distributed model training. Strong software engineering skills with a proven track record of building complex systems Strong with PyTorch and performance work (profiling, CUDA/Triton/C++ as needed) and writing reliable production quality code. Shipped large scale speech/audio models to production. Background in working with large‑scale ML data. Ability to iterate on data,, and triangulate quality using subjective and objective signals. Notable publications and/or open source contributions in speech/audio/ML. Experience with voice‑cloning, speech‑control, voice‑generation.

Preferred Experience
  • Shipped large scale speech/audio models (TTS/VC/ASR) to production.
  • Work on large‑scale ML systems.
  • Experience with audio language modelling, transformer architectures.
  • Experience with voice‑cloning, speech‑control, voice‑generation.
  • Background in processing large‑scale ML data.
  • Publications or notable open‑source in speech/audio/ML.
Compensation

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles
  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including: 15 PTO days 10 sick days 15 company holidays 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in‑office employees One Medical membership, and more!
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer, Voice Conversion
Machine Learning Engineer, Voice Conversion

Cantina Labs • Netherlands

Remote
EUR 120,000 - 180,000
Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
+5
Machine Learning Engineer, Core Evaluations
Machine Learning Engineer, Core Evaluations

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Generous equity
Insurance – medical, dental, vision
+6
Research Scientist, Real-Time Video Generation
Research Scientist, Real-Time Video Generation

Cantina Labs • Netherlands

Remote
EUR 90,000 - 140,000
Competitive salary
Company equity
Medical, dental, and vision insurance
+5
Senior Speech ML Engineer: TTS, Voice Cloning & AI
Senior Speech ML Engineer: TTS, Voice Cloning & AI

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Company equity
Medical, dental, vision insurance
+5
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)

Salve.Inno Consulting • Amsterdam

Remote
EUR 70,000 - 110,000
Fully remote (Europe)
B2B contractor agreement
20 paid leave days per year
+6
ML Engineer, Speech & Voice Conversion (End-to-End)
ML Engineer, Speech & Voice Conversion (End-to-End)

Cantina Labs • Netherlands

Remote
EUR 120,000 - 180,000
Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
+5
Software Engineer, AI Data - The Hague, Netherlands
Software Engineer, AI Data - The Hague, Netherlands

Speechify • Den Haag

Hybrid
EUR 27,000 - 107,000
Autonomy
Competitive compensation
Asynchronous work culture
+1
Remote AI Data Engineer: Build Scalable Training Pipelines
Remote AI Data Engineer: Build Scalable Training Pipelines

Speechify Inc. • Eindhoven

Hybrid
EUR 27,000 - 107,000
Software Engineer, AI Data - Utrecht, Netherlands
Software Engineer, AI Data - Utrecht, Netherlands

Speechify • Utrecht

Hybrid
EUR 27,000 - 107,000
Dynamic work environment
Asynchronous culture
Competitive compensation
+1
Android Engineer - Creative App
Android Engineer - Creative App

ElevenLabs • Netherlands

Remote
EUR 80,000 - 110,000
Innovative culture
Growth opportunities
Learning stipend
+2