ML Engineer: Voice Conversion & Speech Generation

Cantina Labs; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Generous equity

Paid time off and holidays

401(k) retirement plan

Lunch and snacks in-office

One Medical membership

Job summary

Cantina Labs is seeking an expert ML engineer to architect and train large-scale speech models for its AI character creator platform. You will design experiments, implement diffusion/flow-matching architectures, and optimize data pipelines and tooling for production readiness.

Responsibilities include end-to-end model development, evaluation, safety guardrails, and collaboration across data, ML, and platform teams to deliver robust, scalable audio generation capabilities.

Qualifications

• Must have exceptional research or development experience with large-scale audio models (>8B parameters, >500k hours of data).
• Experience with diffusion and/or flow-matching transformers, including samplers, schedules, conditioning mechanisms, and distillation.
• Experience training audio VAEs, neural audio codecs, and vocoders, including latent/tokenizer design and objectives.

Responsibilities

• Architect, implement, pre-train, fine-tune, and post-train or align large-scale speech models.
• Design, run, and analyze experiments to advance model understanding.
• Develop and improve tools to enhance team productivity.
• Contribute across the stack from low-level optimizations to model design.
• Define data requirements and collaborate on data curation, augmentation, labeling quality, and synthetic data strategies.
• Design automated evaluations, including listening tests and ASR-based metrics, robustness and bias checks.
• Harden the training and inference pipeline; monitor latency, memory, and cost; meet production SLAs with robust monitoring.
• Contribute to safety and consent guardrails to mitigate misuse of speech technology.

Skills

Diffusion models

Flow-matching transformers

Audio VAEs

Neural audio codecs

Vocoders

Multi-node distributed training

PyTorch

CUDA/C++

Production-ready coding

Tools

FSDP/DeepSpeed

CUDA

Triton

Python

Job description

Cantina Labs is seeking an expert ML engineer to architect and train large-scale speech models for its AI character creator platform. You will design experiments, implement diffusion/flow-matching architectures, and optimize data pipelines and tooling for production readiness.

Responsibilities include end-to-end model development, evaluation, safety guardrails, and collaboration across data, ML, and platform teams to deliver robust, scalable audio generation capabilities.