Senior AI Engineer: Production LLM Agents & Inference

Bitus Labs; Irvine (CA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Bitus Labs is seeking an AI Engineer to drive agent systems, memory management, and RAG pipelines for our in-game personalization platform. You will contribute to model deployment, inference optimization, and end-to-end production readiness.

This role focuses on building and operating scalable, low-latency AI services with Docker/Kubernetes, LangGraph, and vector databases, while collaborating with researchers and backend engineers to ship production-ready systems.

Qualifications

• Bachelor's or Master's in CS/ML or related field.
• 3+ years of industry experience in ML engineering or related roles.
• Proven ability to build low-latency production services in Go, Rust, C++, or equivalents.
• Strong PyTorch and Hugging Face experience for production LLMs and agents.
• Experience with real-time inference systems and vector databases.

Responsibilities

• Design, build, and optimize LLM-powered agents with planning, tool use, and multi-step reasoning.
• Architect memory systems and manage context/session state.
• Build and optimize RAG pipelines for relevance and freshness.
• Operate vector-store infra (pgvector, Milvus, Qdrant, Weaviate).
• Define evaluation methods for agents and prompts; improve latency and reliability.
• Develop production inference services with low latency and high concurrency.

Skills

Go / Rust / C++

PyTorch / HuggingFace

LLM / agent apps

Docker / Kubernetes

Cloud platforms (AWS / GCP / Azure)

Real-time inference

Production ML systems

Education

Bachelor's or Master's in CS/ML

Tools

LangGraph

LlamaIndex

pgvector

Milvus

Qdrant

Weaviate

Job description

Bitus Labs is seeking an AI Engineer to drive agent systems, memory management, and RAG pipelines for our in-game personalization platform. You will contribute to model deployment, inference optimization, and end-to-end production readiness.

This role focuses on building and operating scalable, low-latency AI services with Docker/Kubernetes, LangGraph, and vector databases, while collaborating with researchers and backend engineers to ship production-ready systems.