Machine Learning Engineer, Voice Conversion

Cantina Labs

Netherlands

Remote

EUR 120,000 - 180,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
Parental leave & fertility support
401(k) retirement savings plan
Lifestyle spending account
In-office lunch and snacks
One Medical membership

Job summary

Cantina Labs is hiring a Research / ML Engineer for its Speech Team to develop state-of-the-art speech systems from data specs to production inference. You will drive evaluation flywheels, work with research, data, and infra to ship reliable models, and help ensure safety and steerability of AI systems.

You will collaborate closely with infra and product to drive measurable improvements, design experiments, and iterate on data and model improvements at scale.

Qualifications

  • Hands-on experience with large-scale audio models and data handling.
  • Experience with diffusion/flow‑matching methods and vocoder design.
  • Proven ability to train and optimize production-grade speech systems.
  • Strong software engineering skills and production-quality code.

Responsibilities

  • Architect and pre-train/fine-tune large-scale speech models.
  • Design experiments and analyze results with objective/subjective metrics.
  • Develop dev tooling to improve team productivity.
  • Contribute across the stack from low-level optimizations to model design.
  • Define data requirements and improve data quality and synthetic data strategies.
  • Engineer robust training/evaluation/inference pipelines and meet SLAs.
  • Support safety/guardrails and responsible speech technology.

Skills

Large-scale audio models
Diffusion/flow‑matching transformers
Speech model training
PyTorch
Distributed training (multi-node/multi

Tools

CUDA/Triton
DeepSpeed
FSDP
C++

Job description

About Cantina

Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Our bots are lifelike, social creatures that can interact wherever people are online—across voice, video, and text. Create yourself, imagine someone new, or choose from thousands of characters to share infinitely scalable, personalized content and seamless group chat. If you’re excited about how AI can shape creativity and social interaction, come help us build what’s next.

About the Role

We’re looking for a Research / ML Engineer to join our Speech Team to build state-of-the-art speech systems end-to-end—from data specs through production inference. You’ll drive the model data eval flywheel for VC and adjacent tasks (controllable TTS, voice design and more), partnering closely with research, data, and infra to ship fast, reliable, and cost‑aware models. In this role, you will work at the intersection of cutting‑edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems. You will thrive in this role if you: See research and engineering as two sides of the same coin and enjoy owning work end‑to‑end. Are results‑oriented, flexible, and willing to pick up whatever moves the needle. Like collaborating closely with infra, data, and product to ship measurable improvements. Enjoy designing experiments, listening tests, and metrics that correlate with user‑perceived quality. Eager to learn every‑day, find and solve unique large‑scale problems.

What You’ll Do
  • Model Building: Architect, implement, pre‑train, fine‑tune, and post‑train/alignment (e.g., GRPO/DPO) for large‑scale speech models.
  • Experimental Design: Design, run, and analyze scientific experiments to advance our understanding of the models.
  • Tool Development: Develop and improve dev tooling to enhance team productivity.
  • Full‑Stack Contribution: Contribute to the entire stack, from low‑level optimizations to high‑level model design.
  • Data Ownership: Define data requirements and collaborate on acquisition, curation, augmentation, labeling quality, and synthetic data strategies.
  • Rigorous Evaluation: Design automated objective/subjective evaluations—listening tests, SV/WER/ASR‑based metrics, robustness & bias checks, and red‑team studies.
  • Pipeline Delivery: Harden the training → evaluation → inference pipeline; profile latency, memory, and cost; and meet production SLAs with robust monitoring and rollback.
  • Safety & Responsibility: Contribute to safety/consent guardrails and to misuse/abuse mitigation for responsible speech technology.
What You’ll Bring
  • Exceptional research/development experience with large‑scale audio models (>8B parameters, >500k hours of data).
  • Deep hands‑on experience with diffusion and/or flow‑matching transformers, including practical knowledge of samplers, schedules, conditioning mechanisms, and distillation.
  • Deep hands‑on experience training audio VAEs, neural audio codecs, and vocoders latent/tokenizer design, reconstruction and perceptual objectives, adversarial training.
  • Strong experience with multi‑node, multi‑GPU distributed training (FSDP/DeepSpeed or equivalent).
  • Strong software engineering skills with a proven track record of building complex systems.
  • Strong with PyTorch and performance work (profiling, CUDA/Triton/C++ as needed) and writing reliable production‑quality code.
  • Shipped large‑scale speech/audio or multimodal generative models to production.
  • Background in working with large‑scale ML data, and the ability to iterate on data and triangulate quality using both subjective and objective signals.
  • Experience with voice cloning, speech control/steerability, or expressive speech generation.
  • Notable publications and/or open‑source contributions in speech/audio/ML.
Compensation

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles
  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in-office employees
  • One Medical membership, and more!
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer, TTS
Machine Learning Engineer, TTS

Cantina Labs • Netherlands

Remote
EUR 90,000 - 150,000
Competitive salary
Company equity
Medical, dental, vision insurance
+5
Research Scientist, Real-Time Video Generation
Research Scientist, Real-Time Video Generation

Cantina Labs • Netherlands

Remote
EUR 90,000 - 140,000
Competitive salary
Company equity
Medical, dental, and vision insurance
+5
ML Engineer, Speech & Voice Conversion (End-to-End)
ML Engineer, Speech & Voice Conversion (End-to-End)

Cantina Labs • Netherlands

Remote
EUR 120,000 - 180,000
Equity
Medical/dental/vision insurance
42 days of PTO (paid time off)
+5
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)

Salve.Inno Consulting • Amsterdam

Remote
EUR 70,000 - 110,000
Fully remote (Europe)
B2B contractor agreement
20 paid leave days per year
+6
Remote AI Data Engineer: Build Scalable Training Pipelines
Remote AI Data Engineer: Build Scalable Training Pipelines

Speechify Inc. • Eindhoven

Hybrid
EUR 27,000 - 107,000
Software Engineer, AI Data - The Hague, Netherlands
Software Engineer, AI Data - The Hague, Netherlands

Speechify • Den Haag

Hybrid
EUR 27,000 - 107,000
Autonomy
Competitive compensation
Asynchronous work culture
+1
Software Engineer, AI Data - Utrecht, Netherlands
Software Engineer, AI Data - Utrecht, Netherlands

Speechify • Utrecht

Hybrid
EUR 27,000 - 107,000
Dynamic work environment
Asynchronous culture
Competitive compensation
+1
Android Engineer - Creative App
Android Engineer - Creative App

ElevenLabs • Netherlands

Remote
EUR 80,000 - 110,000
Innovative culture
Growth opportunities
Learning stipend
+2
Software Engineer, AI Data - Rotterdam, Netherlands
Software Engineer, AI Data - Rotterdam, Netherlands

Speechify Inc. • Rotterdam

Hybrid
EUR 27,000 - 107,000
Stock options
Bonus
Asynchronous work culture
+1
Remote AI Data Engineer — Scale Data Pipelines
Remote AI Data Engineer — Scale Data Pipelines

Speechify Inc. • Utrecht

Hybrid
EUR 27,000 - 107,000
Dynamic work environment
Asynchronous culture
Competitive compensation
+1