Software Engineer, Machine Learning

AssemblyAI; New York (NY); Remote; USD 157,000 - 175,000; Full time

Job summary

Join a leading AI company as a Machine Learning Engineer, focusing on building infrastructure for rapid model deployment and collaborating with research teams. Ideal candidates will have strong Python skills and experience with AWS, MLOps, and scalable architectures.

Qualifications

• Strong Python backend engineering experience.
• Experience with distributed, containerized applications on AWS.

Responsibilities

• Design and implement tooling for quick model deployment.
• Build and maintain high-performance inference pipelines.
• Improve MLOps practices to streamline research and production.

Skills

Python

AWS

Observability

Scalable Architectures

Tools

PyTorch

Kubernetes

Job description

Join to apply for the Software Engineer, Machine Learning role at AssemblyAI

About AssemblyAI
At AssemblyAI, we're building at the forefront of Speech AI, creating powerful models for speech-to-text and speech understanding available through a straightforward API. With more than 200,000 developers building on our API and over 5,000 paying customers, AssemblyAI is helping unlock and support the next generation of powerful, meaningful products built with AI.

Progress in AI is moving at an unprecedented pace– and our team is made up of experts in AI research that are focused on making sure that our customers are able to stay on the cutting edge, with production-ready AI models that are constantly updating and improving as our team continues to improve accuracy, latency, and what's possible with Speech AI. Our models consistently rank highest in industry benchmarks for accuracy, outperforming models from Google and Amazon, and up to 30% fewer hallucinations than OpenAI's Whisper. Our models power more than 2 billion end-user experiences each day, helping companies better understand customer feedback, run more productive meetings with automated meeting notes, and helping improve childhood literacy via ed tech tools.

We've raised funding by leading investors including Accel, Insight Partners, Y Combinator's AI Fund, Patrick and John Collision, Nat Friedman, and Daniel Gross. We're a remote team looking to build one of the next great AI companies, and are looking for driven, talented people to help us get there!

About the role

We're seeking a Machine Learning Engineer to accelerate our AI research-to-production pipeline. Responsibilities include building infrastructure for rapid deployment and testing of models, maintaining scalable inference systems, and collaborating closely with research and engineering teams.

What You'll Do

1. Design and implement tooling for quick model deployment and evaluation
2. Build and maintain high-performance inference pipelines
3. Optimize infrastructure for speed and reliability
4. Develop user-facing APIs for ML systems
5. Implement observability solutions for performance monitoring
6. Troubleshoot production issues in distributed systems
7. Improve MLOps practices to streamline research and production

What You'll Need

1. Strong Python backend engineering experience
2. Experience with distributed, containerized applications on AWS
3. Proficiency in observability solutions (monitoring, logging, alerting)
4. Ability to design resilient, scalable architectures

Ideal candidates may also have:

• MLOps experience with PyTorch and Kubernetes
• Startup experience demonstrating ownership and rapid iteration
• Experience working with remote, distributed teams
• Knowledge of the entire ML lifecycle from model serving to API development
• Audio domain experience (ASR, TTS, etc.)
• Experience with other cloud providers, Ray.io, Bazel, monorepos, alternative ML frameworks, and low-latency inference optimization

Pay Transparency

Salary range: $157,500-$175,000. Compensation is based on experience, skills, and qualifications, with considerations for internal equity and regional differences.

Working at AssemblyAI

We are a remote team of AI researchers and startup veterans committed to diversity, inclusion, and building a strong company culture. We value bringing your full self to work and provide opportunities for growth and success regardless of background.

Explore More

• Check us out on YouTube
• Learn about AI models for speech recognition
• Core Transcription | Audio Intelligence | LeMUR | Playground
• Funding: $50M Series C