Gen AI Inference Engineer for Scalable LLMs

Robotic Process Automation LLC

Austin (TX)

On-site

USD 86,000 - 123,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotic Technologies Automation seeks a Software Engineer to design, build, and optimize production LLM inference services powering GenAI features across internal and customer-facing apps. You will collaborate with ML, platform, and product teams to improve speed, reliability, and cost efficiency at scale.

Responsibilities include designing scalable inference services for open-weight and hosted LLMs on Kubernetes, implementing batching and caching strategies, and integrating with external model

Qualifications

  • 2+ years in ML/LLM production systems.
  • Strong Python, and knowledge of performance paths in Go/C++/Rust.

Responsibilities

  • Design, deploy, and maintain scalable inference services on Kubernetes infrastructure.
  • Reduce latency and cost per request through optimizations and benchmarking.
  • Build observability with logging, metrics, tracing, and dashboards.

Skills

Python
Go
C++
Rust
LLM serving
Kubernetes
Docker
GPU scheduling
PyTorch
Hugging Face
Prometheus
Grafana
OpenTelemetry

Tools

vLLM
TensorRT-LLM
TGI
SGLang
Triton Inference Server

Job description

Robotic Technologies Automation seeks a Software Engineer to design, build, and optimize production LLM inference services powering GenAI features across internal and customer-facing apps. You will collaborate with ML, platform, and product teams to improve speed, reliability, and cost efficiency at scale.

Responsibilities include designing scalable inference services for open-weight and hosted LLMs on Kubernetes, implementing batching and caching strategies, and integrating with external model

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Gen AI Solutions Engineer - Production LLM Inference
Gen AI Solutions Engineer - Production LLM Inference

Robotics Technologies • Jackson (TN)

On-site
USD 86,000 - 123,000
Gen AI Inference Engineer - Scalable LLM Serving
Gen AI Inference Engineer - Scalable LLM Serving

CloudBigD • Austin (TX)

On-site
USD 86,000 - 123,000
Gen AI Inference Engineer — Scalable LLM Services
Gen AI Inference Engineer — Scalable LLM Services

Ethereum Technologies LLC • Austin (TX)

On-site
USD 86,000 - 123,000
Gen AI Inference Engineer (Production-Ready)
Gen AI Inference Engineer (Production-Ready)

Valiant Technologies LLC • Austin (TX)

On-site
USD 96,000 - 124,000
Senior AI Engineer: Generative AI, LLMs & Scalable Systems
Senior AI Engineer: Generative AI, LLMs & Scalable Systems

Robotic Process Automation LLC • Frederick (MD)

On-site
USD 180,000 - 240,000
Gen AI Inference Engineer (LLM, Kubernetes, Production)
Gen AI Inference Engineer (LLM, Kubernetes, Production)

Quantum Technologies LLC • Austin (TX)

On-site
USD 86,000 - 123,000
AI/ML Engineer: Generative AI & LLM Solutions
AI/ML Engineer: Generative AI & LLM Solutions

Robotic Process Automation LLC • Plano (TX)

On-site
USD 120,000 - 160,000
Generative AI Engineer for LLMs & NLP
Generative AI Engineer for LLMs & NLP

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 120,000 - 180,000
Senior AI/ML Engineer: Generative AI, MLOps & AWS
Senior AI/ML Engineer: Generative AI, MLOps & AWS

Robotic Technologies Automation • Pennsylvania

On-site
USD 140,000 - 190,000
Lead GenAI Engineer: LLMs, Pipelines & Strategy
Lead GenAI Engineer: LLMs, Pipelines & Strategy

Robotic Technologies Automation • Atlanta (GA)

On-site
USD 150,000 - 190,000