Research Engineer: Inference / MLOps

CAMB.AI

United States

Remote

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Innovative Environment
Growth Opportunities
Competitive Compensation

Job summary

CAMB.AI Ltd. is seeking a Senior ML Infrastructure Engineer to deploy models into production and own the end-to-end serving pipeline. The role emphasizes optimizing inference quality, reducing latency, and controlling costs across diverse models.

You will build robust monitoring for inference, investigate timing anomalies, and create tooling to accelerate deployment from checkpoint to scaled inference, with a focus on GPU scheduling and optimization.

Responsibilities

  • Deploying various models to production and owning the process from working checkpoint to performant serving infrastructure.
  • Optimizing inference quality and performance in the model serving stack to improve model output quality and detect hallucinations or errors.
  • Enhancing latency, throughput, and cost through techniques like custom kernels, cache optimization, GPU scheduling/scaling, and quantization.
  • Implementing robust monitoring and incident flagging systems for inference management and investigating timing anomalies or inference failures.
  • Creating tooling to enable rapid deployment of new models from checkpoint to scaled inference, optimizing GPU availability.

Job description

Technical responsibilities of the role:
  • Deploying various models to production and owning the process from working checkpoint to performant serving infrastructure.
  • Optimizing inference quality and performance in the model serving stack to:
    • Improve model output quality, e.g. experimenting with various guidance and guardrail schemes, automatic detection of hallucinations or errors.
    • Improve the inference performance in terms of latency, throughput, cost; e.g. via custom kernels, cache optimization, GPU scheduling/scaling optimization, quantization.
  • Implementing robust monitoring and incident flagging systems for inference management. E.g. flagging and investigating timing anomalies, inference failures, understanding general inference statistics across various models.
  • Creating tooling to allow rapid deployment of newly developed models from checkpoint to scaled inference, optimizing GPU availability and choice for new models.
  • Making autonomous decisions to holistically improve the inference experience in different models and use cases. E.g. how to approach handling the different kinds of optimization needed for an extreme low-latency streaming model versus a “quality sensitive” slow dubbing model.
Why Join Us?
  • Innovative Environment: Be part of a forward-thinking company at the cutting edge of technology and digital transformation.
  • Growth Opportunities: Enjoy professional development and career growth in a fast-paced, dynamic industry.
  • Competitive Compensation: Receive a competitive salary, performance bonuses, and comprehensive benefits.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

INFERENCE ENGINEER
INFERENCE ENGINEER

Makermaker • San Francisco (CA)

On-site
USD 120,000 - 160,000
Research Engineer - Inference
Research Engineer - Inference

Ladders • United States

Remote
USD 150,000 - 350,000
Remote work flexibility
Visa sponsorship
Relocation assistance
+4
Software Engineer, Inference Runtime
Software Engineer, Inference Runtime

LM Studio • New York (NY)

On-site
USD 140,000 - 210,000
Competitive salary and equity grants
Catered team lunch / expensed dinners
Member of Technical Staff, Inference
Member of Technical Staff, Inference

OpenRelay, Inc. • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Inference Engineer
Inference Engineer

adaption • San Francisco (CA)

On-site
USD 150,000 - 230,000
Flexible work: In-person Bay Area coll
Adaption Passport: travel stipend
Lunch Stipend: weekly meal allowance
+1
Senior Software Engineer - Model Performance
Senior Software Engineer - Model Performance

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits
AI Researcher — Inference Optimization
AI Researcher — Inference Optimization

Featherlessai • United States

Remote
USD 140,000 - 210,000
Senior Applied Scientist, Efficient LLM Inference & Model Optimization
Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius Group • United States

Remote
USD 180,000 - 260,000
Inference Engineer - Member of Technical Staff
Inference Engineer - Member of Technical Staff

Designworks Talent • Bellevue (WA)

Hybrid
USD 150,000 - 230,000
Medical, dental, and vision insurance
401(k) with company match
Paid holidays
Machine Learning Engineer- Inference Optimization | Experienced Hire
Machine Learning Engineer- Inference Optimization | Experienced Hire

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 150,000 - 230,000