Senior AI Infra Engineer: LLMOps, GPU, Kubernetes

eloquentai; San Francisco (CA); On-site; USD 130,000 - 160,000; Full time

Job summary

Eloquent AI is seeking a Senior Software Engineer, AIOps & Infrastructure based in San Francisco. The role involves designing scalable AI infrastructure, automating MLOps workflows, and optimizing AI systems for efficiency.

Applicants should have over 5 years of experience in software engineering, deep expertise in Kubernetes, and a strong understanding of cloud platforms. Join us in redefining AI operations!

Qualifications

• 5+ years of experience in software engineering, MLOps, or infrastructure development.
• Strong expertise in Kubernetes and managing containerized ML workloads.
• Deep understanding of cloud platforms and distributed computing.

Responsibilities

• Design and build scalable ML infrastructure for AI agents.
• Automate LLMOps and MLOps workflows for model deployment.
• Optimize GPU and cloud compute workloads for efficiency.
• Develop Kubernetes-based solutions for ML model orchestration.
• Ensure observability and reliability in AI systems.

Skills

Software engineering

MLOps

Kubernetes

Cloud platforms (AWS, GCP, Azure)

Python

ML model deployment pipelines

Problem-solving

Job description

Eloquent AI is seeking a Senior Software Engineer, AIOps & Infrastructure based in San Francisco. The role involves designing scalable AI infrastructure, automating MLOps workflows, and optimizing AI systems for efficiency.

Applicants should have over 5 years of experience in software engineering, deep expertise in Kubernetes, and a strong understanding of cloud platforms. Join us in redefining AI operations!