AI/LLM SRE Software Engineer III

Testing Site - JPMC; Columbus (OH); On-site; USD 140,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. in Columbus, OH seeks a Lead Software Engineer to ensure reliability, scalability, and automation of AI-powered applications and infrastructure. You will partner with engineering and stakeholders to deliver observability and autonomic operations across our platforms.

You will mentor engineers, design AI-driven alerting, and drive the roadmap for AI-assisted SRE and observability in a fast-paced enterprise environment.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Strong experience in SRE, DevOps, or Platform Engineering roles.
• Hands-on experience with AWS services: ECS, Lambda, API Gateway, RDS, EKS, CloudWatch.
• Experience with AWS Bedrock, OpenAI, or LLM APIs.

Responsibilities

• Ensure reliability, scalability, and performance of AI-assisted application and platform operations.
• Design and implement AI-driven solutions for intelligent alerting, noise reduction & auto-correlation systems.
• Build and maintain observability, monitoring, and telemetry for AI applications and platforms.
• Build and support automation for alerting, anomaly detection, and self-healing workflows.
• Collaborate with engineering and other stakeholders to drive operational excellence.
• Mentor and guide engineers on AIOps standards and operational excellence.
• Define and execute the roadmap for AI-assisted SRE and observability.

Skills

SRE

DevOps

Platform Engineering

Distributed Systems

Cloud Architecture

Python

AI/LLM

Tools

OpenTelemetry

Grafana

Prometheus

ELK

CloudWatch

GitHub Actions

Jenkins

Spinnaker

Bedrock

OpenAI API

Job description

Job description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Employee Platforms team, you will be responsible for ensuring the reliability, scalability, and automation of AI-powered applications and infrastructure. You will partner with engineering, and other stakeholders to deliver modern observability, intelligent incident response, and autonomic operations across our applications.

Job responsibilities

• Ensure reliability, scalability, and performance of AI-assisted application and platform operations.
• Design and implement AI-driven solutions for intelligent alerting, noise reduction & auto-correlation systems.
• Build and maintain observability, monitoring, and telemetry for AI application and platforms.
• Build and support automation for alerting, anomaly detection, and self-healing workflows.
• Collaborate with engineering, and other stakeholders to drive operational excellence.
• Mentor and guide engineers on AIOps standards and operational excellence.
• Define and execute the roadmap for AI-assisted SRE and observability.

Required qualifications, capabilities, and skills:

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Demonstrates strong experience in SRE, DevOps, or Platform Engineering roles.
• Strong hands‑on experience with AWS (ECS, Lambda, API Gateway, Bedrock, CloudWatch, RDS, EKS).
• Hands‑on experience with AWS Bedrock, OpenAI, or LLM APIs.
• Expertise in observability tools: OpenTelemetry, Grafana, Prometheus, ELK, CloudWatch.
• Experience with CI/CD tools (GitHub Actions, Jenkins, Spinnaker ).
• Proven track record in automation, operational tooling, and event‑driven workflows.
• In‑depth understanding of distributed systems, microservices, and cloud architectures.

Preferred qualifications, capabilities, and skills:

• Experience with AI-powered coding assistants like GitHub Copilot, windsurf.
• Familiarity with prompt engineering, embeddings, and RAG pipelines.
• Experience building operational copilots or chatbots for runbooks or troubleshooting.
• Proficiency in Python (Go is a plus).