Senior AI Monitoring & Control Engineer – On-Prem OpenShift

Bank of America; Richmond (VA); On-site; USD 122,000 - 200,000; Full time

Benefits offered by this job

Discretionary incentive program

Industry-leading benefits

Paid time off

Job summary

Bank of America is seeking a senior software engineer to own the delivery of critical vendor applications in an on‑premises OpenShift environment, ensuring production readiness and alignment with enterprise AI Agent initiatives.

You will build APIs, establish guardrails, and develop observability with dashboards and alerts while working across teams to meet strict delivery timelines and regulatory requirements.

Qualifications

• Bachelor's or Master's in Computer Science, Data Science, MIS, or equivalent practical experience.

Responsibilities

• Own delivery of critical vendor applications from build to production in a fully on‑premises OpenShift environment.
• Build and maintain APIs connecting guardrail and observability platforms to enterprise AI Agent solutions.
• Establish and manage workflows that monitor performance, safety, latency, throughput, quality, and guardrail effectiveness.
• Implement and maintain model evaluation frameworks using LLM-as-a-Judge and language models.
• Develop observability dashboards and alerting using Grafana for audit-friendly evidence and traceability.
• Troubleshoot production issues and improve scalability, resilience, and operational efficiency.

Skills

Automation

Influence

Result Orientation

Stakeholder Management

Architecture

Solution Design

Agile Practices

Analytical Thinking

Collaboration

Education

Bachelor's degree in Computer Science or related field

Master's degree preferred

Tools

OpenShift

Kubernetes

LangChain

OpenAI APIs

Splunk

Grafana

Job description

Bank of America is seeking a senior software engineer to own the delivery of critical vendor applications in an on‑premises OpenShift environment, ensuring production readiness and alignment with enterprise AI Agent initiatives.

You will build APIs, establish guardrails, and develop observability with dashboards and alerts while working across teams to meet strict delivery timelines and regulatory requirements.