Senior ML Engineer — Real-Time Inference (Serbia)

HellaGoodAudio; United States; Remote; USD 180,000 - 230,000; Full time

Job summary

Inworld, a research lab and inference provider, seeks engineers to advance real-time, agentic AI for consumer-facing apps. You will work on reducing latency, scaling multimodal inference, and delivering reliable production-ready systems.

The team emphasizes open-source contributions and cross-functional impact. The role offers opportunities to containerize research models, optimize their serving, and collaborate with a US-based leadership and engineering group in a fast-moving environment.

Qualifications

• PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.

Responsibilities

• Containerize models from research for production deployment.
• Optimize model serving performance and scalability.
• Ensure reliability of production systems across deployments.
• Collaborate with US-based leadership and engineering teams.

Skills

Inference optimization

Model acceleration

High-performance systems

Distributed systems

Open-source contributions

Full-cycle ownership

Public work experience

Education

PhD in CS, Physics, Math

Tools

C++

CUDA

Rust

Python

Kubernetes

Ray

vLLM

Job description

Inworld, a research lab and inference provider, seeks engineers to advance real-time, agentic AI for consumer-facing apps. You will work on reducing latency, scaling multimodal inference, and delivering reliable production-ready systems.

The team emphasizes open-source contributions and cross-functional impact. The role offers opportunities to containerize research models, optimize their serving, and collaborate with a US-based leadership and engineering group in a fast-moving environment.