Senior AI Inference Systems Engineer (Scale & Latency)

Sapience AI Corporation; United States; Remoto; USD 204.000 - 216.000; Tempo pieno

Descrizione del lavoro

Sapience AI is hiring an ML Infrastructure and Systems Engineer to build and operate high‑performance inference infrastructure. You will focus on serving models at scale, reducing latency, and controlling costs while ensuring reliability and safe rollouts.

You’ll work adjacent to Applied AI, Platform Engineering, and Research teams to ship production-grade AI capabilities. Your work drives fast, dependable answers for members and communities, balancing performance, cost, and maintainability in a

Competenze

• Five+ years in infrastructure, ML infrastructure, or systems engineering.
• Hands-on experience serving ML/LLM models in production at scale.
• Strong understanding of latency, throughput, and performance optimization.

Mansioni

• Own the inference serving and systems end-to-end under real load.
• Drive latency reduction and performance tuning across the full path.
• Scale inference to more users and communities while maintaining reliability.
• Own the economics of inference including GPU/hardware efficiency.
• Manage model deployment, versioning, rollout, and rollback.
• Instrument the serving layer with observability, alerts, and dashboards.
• Make sound platform choices for accelerators, runtimes, and frameworks.

Conoscenze

Inference serving

Latency optimization

Distributed systems

GPU/accelerator efficiency

Model deployment

Observability

Python

Go/Rust/C++

Strumenti

vLLM

TensorRT

Triton

Kubernetes

AWS/GCP/Azure

Descrizione del lavoro

Sapience AI is hiring an ML Infrastructure and Systems Engineer to build and operate high‑performance inference infrastructure. You will focus on serving models at scale, reducing latency, and controlling costs while ensuring reliability and safe rollouts.

You’ll work adjacent to Applied AI, Platform Engineering, and Research teams to ship production-grade AI capabilities. Your work drives fast, dependable answers for members and communities, balancing performance, cost, and maintainability in a