SRE Lead: GenAI Platform Reliability (Remote)

BMC Software, Inc.; United States; Remote; USD 153,000 - 255,000; Full time

Job summary

BMC Software, Inc. is seeking a Senior AI Platform Engineer to build, operate, and improve AI/ML and Generative AI platforms in production, covering deployment, monitoring, incident management, and continuous improvement.

You will work with AI engineers, data scientists, DevOps, and security to ensure reliability, scalability, and observability across LLM, GenAI, and related workloads, with on-call responsibilities as needed.

Qualifications

• SRE fundamentals; SLOs/SLIs, monitoring, incident management.
• Linux, networking, distributed systems, troubleshooting, performance analysis.
• CI/CD and DevSecOps practices; containers/orchestration (Docker, Kubernetes, OpenShift); cloud platforms.
• Generative AI/LLM literacy; RAG/agents/tooling concepts as level requires.
• MLOps/LLMOps tooling and AI observability as level requires.
• Scripting/automation (Python, Bash); security-first, calm incident handling.
• Linux/scripting fundamentals; exposure to monitoring or cloud (project/internship OK).
• Curiosity about how LLM/agent systems fail in production.
• Calm, careful work under guidance; readiness for eventual on-call with support.
• Past experience: Contributed to monitoring, runbooks, or operational fixes within an existing workflow.

Responsibilities

• Build and operate production-grade infrastructure for LLM, GenAI, RAG, and Agentic AI applications.
• Define and defend SLOs/SLIs for agent and model behavior—latency, availability, quality, and cost.
• Monitor production AI systems for performance, drift, hallucination rates, and quality regressions; act before customers are affected.
• Lead incident response for AI systems: detection, triage, mitigation, and blameless post-mortems.
• Build runbooks, automation, and self-healing for common AI operational issues; participate in on-call as required.
• Operate model/agent lifecycle in production: versioning, rollout, rollback, and safe promotion with evaluation gates.
• Manage LLM cost, capacity, and scaling; manage model serving/inference infrastructure.
• Maintain observability/tracing for agents, tools, and prompts (Langfuse, OpenTelemetry, OpenSearch).
• Operate AI/ML workloads on IBM Z where required; harden the AMI Platform for reliability, scalability, and security.
• Partner with AI Engineers, Data Scientists, DevOps, and Security to embed reliability from design onward.

Skills

SRE fundamentals

Linux fundamentals

Networking

Distributed systems

Troubleshooting

CI/CD

DevSecOps

Containers & Orchestration

Docker

Kubernetes

OpenShift

Cloud platforms

Generative AI / LLM literacy

MLOps / LLMOps

Python / Bash scripting

Security-first incident handling

On-call readiness

Monitoring tools exposure

Tools

Langfuse

OpenTelemetry

OpenSearch

CI/CD tooling

Incident management tools

Job description

BMC Software, Inc. is seeking a Senior AI Platform Engineer to build, operate, and improve AI/ML and Generative AI platforms in production, covering deployment, monitoring, incident management, and continuous improvement.

You will work with AI engineers, data scientists, DevOps, and security to ensure reliability, scalability, and observability across LLM, GenAI, and related workloads, with on-call responsibilities as needed.