Senior AI Infra Engineer: AIOps & ML Deployment

Eloquent AI; San Francisco (CA); Vor Ort; USD 120.000 - 160.000; Vollzeit

Zusammenfassung

Eloquent AI in San Francisco is building the next generation of AI Operators—multimodal, autonomous systems that execute complex workflows across tools with human-level precision.

As a Senior Software Engineer, AIOps & Infrastructure, you will design, build, and optimize scalable AI infrastructure to support enterprise AI agents. You will enable ML engineers to train, fine-tune, and deploy LLMs efficiently at scale.

Qualifikationen

• 5+ years of software engineering, MLOps, or infrastructure experience.
• Strong Kubernetes expertise and containerized ML workloads.
• Deep understanding of cloud platforms (AWS, GCP, Azure) and distributed computing.
• Proficiency in Python for ML/AI services.
• Experience with ML model deployment pipelines, including serving, inference optimization, and monitoring.
• Familiarity with vector databases, retrieval systems, and RAG architectures is a plus.

Aufgaben

• Design and build scalable ML infrastructure for deploying and maintaining AI agents in production.
• Automate LLMOps and MLOps workflows, ensuring training, fine-tuning, deployment, and monitoring.
• Optimize GPU and cloud compute workloads to improve efficiency and reduce latency.
• Develop Kubernetes-based solutions, including custom operators for ML model orchestration.
• Improve observability and reliability with logging, monitoring, and performance tracking for AI models.
• Collaborate with ML and engineering teams to streamline data pipelines, model serving, and inference optimizations.
• Ensure security, compliance, and reliability in AI infrastructure, maintaining high availability and scalability.
• Participate in on-call rotations to ensure 24/7 reliability of critical AI systems.

Kenntnisse

Kubernetes

Python

Cloud platforms

ML Ops

Model deployment

Tools

AWS

GCP

Azure

Jobbeschreibung

Eloquent AI in San Francisco is building the next generation of AI Operators—multimodal, autonomous systems that execute complex workflows across tools with human-level precision.

As a Senior Software Engineer, AIOps & Infrastructure, you will design, build, and optimize scalable AI infrastructure to support enterprise AI agents. You will enable ML engineers to train, fine-tune, and deploy LLMs efficiently at scale.