Audio Inference Engineer — Model Efficiency (Remote-friendly)

Cohere; New York (NY); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Open and inclusive culture

Weekly lunch stipend

Full health and dental benefits

Parental Leave top-up for 6 months

Personal enrichment benefits

6 weeks of vacation

Job summary

Cohere is seeking an engineering professional in New York to develop and optimize audio machine learning systems. You will work with cross-functional teams to improve audio model metrics, addressing latency and throughput while ensuring real-time audio inference integration. The ideal candidate will possess expertise in programming languages like C++ and Python, and experience with audio deep learning models. Cohere offers a vibrant workplace with a focus on AI research, full health benefits, six weeks of vacation, and an inclusive culture.

Qualifications

• Significant experience developing high-performance audio or machine learning inference systems.
• Proficiency with C++ and Python.
• Hands-on experience with deep learning models for audio, speech, or language applications.

Responsibilities

• Work on advancing core audio model serving metrics, including latency, throughput, and quality.
• Identify bottlenecks and deliver creative solutions for audio processing and streaming workloads.
• Collaborate with training and serving infrastructure teams for seamless integration.

Skills

High-performance audio or machine learning inference systems

C++

Python

Deep learning models for audio

Results-oriented mindset

Tools

PyTorch

TensorFlow

vLLM

SGLang

Tensort-LLM

Job description

Cohere is seeking an engineering professional in New York to develop and optimize audio machine learning systems. You will work with cross-functional teams to improve audio model metrics, addressing latency and throughput while ensuring real-time audio inference integration. The ideal candidate will possess expertise in programming languages like C++ and Python, and experience with audio deep learning models. Cohere offers a vibrant workplace with a focus on AI research, full health benefits, six weeks of vacation, and an inclusive culture.