Senior AI Monitoring & Control Engineer – OpenShift

Bank of America; Pennington (NJ); On-site; USD 122,000 - 200,000; Full time

Job summary

Bank of America is seeking an experienced engineer to own the delivery of critical vendor applications on an on-prem OpenShift platform, supporting AI monitoring, controls, and governance.

The role emphasizes building APIs, guardrails, and observability for LLM-powered systems, with leadership responsibilities across cross-functional teams and a focus on reliability and audit readiness.

Qualifications

• Bachelor's or Master's in CS/Data Science/MIS or equivalent experience.
• 13+ years of software engineering experience building and scaling production apps.
• Proficiency in Python and deploying containerized workloads on OpenShift or Kubernetes.
• Experience bringing LLM- or RAG-based apps to production with guardrails and observability.
• Experience with AI Agents development (OpenAI APIs, LangChain).

Responsibilities

• Own delivery of critical vendor applications from build through production in a fully on-premises OpenShift environment.
• Build and maintain APIs linking guardrail and observability platforms to enterprise AI Agent solutions.
• Establish workflows to monitor performance, safety, latency, throughput, quality and guardrail effectiveness.
• Implement and maintain model evaluation frameworks using LLM-as-a-Judge and language models.
• Develop observability dashboards and alerting using Grafana or similar tools, with audit-ready traceability.
• Troubleshoot production issues and improve scalability, resilience, and availability.
• Contribute to evaluation methodologies and guardrail controls for AI systems.
• Lead and mentor engineers, set development standards, drive cross-functional improvements.
• Provide input into financial planning and budgeting for supported applications.

Skills

Automation

Influence

Result Orientation

Stakeholder Management

Technical Strategy Development

Application Development

Architecture

Business Acumen

Risk Management

Solution Design

Agile Practices

Analytical Thinking

Collaboration

Data Management

Solution Delivery Process

Education

Bachelor's or Master's in Computer Science, Data Science, MIS or related field

Tools

OpenShift

Kubernetes

Grafana

Job description

Bank of America is seeking an experienced engineer to own the delivery of critical vendor applications on an on-prem OpenShift platform, supporting AI monitoring, controls, and governance.

The role emphasizes building APIs, guardrails, and observability for LLM-powered systems, with leadership responsibilities across cross-functional teams and a focus on reliability and audit readiness.