Senior AI/ML Infrastructure Engineer

BackOps; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

BackOps is building an AI resolution layer for enterprise operations. As an AI/ML Engineer, you will own the infrastructure that powers Relay's intelligence, balancing performance and reliability across thousands of real-world workflows.

You will design, implement, and scale model execution, inference optimization, and continuous improvement, collaborating with the CTO and engineering teams. You will work at the intersection of machine learning, distributed systems, and production AI, making

Qualifications

• Have 6+ years of software engineering experience with ownership of complex systems.
• Experience deploying production AI/ML infrastructure and model-serving pipelines.
• Strong fundamentals in Python and distributed systems; capable of operating in production environments.

Responsibilities

• Build and own the AI/ML infrastructure powering Relay, enabling reliable, scalable model execution.
• Optimize latency, throughput, and cost across the AI stack for production workloads.
• Evaluate, benchmark, and continuously improve model quality and system reliability.

Skills

Python

Distributed systems

Production AI

Model serving

Performance optimization

Cloud infra

Tools

PyTorch

Hugging Face

Kubernetes

Ray

Triton

vLLM

Job description

BackOps is building an AI resolution layer for enterprise operations. As an AI/ML Engineer, you will own the infrastructure that powers Relay's intelligence, balancing performance and reliability across thousands of real-world workflows.

You will design, implement, and scale model execution, inference optimization, and continuous improvement, collaborating with the CTO and engineering teams. You will work at the intersection of machine learning, distributed systems, and production AI, making