Senior AI Monitoring & Control Engineer (On-Prem OpenShift)

Bank of America; Plano (TX); On-site; USD 170,000 - 230,000; Full time

Job summary

Bank of America is hiring an experienced software engineer to own the delivery of critical AI vendor applications on an on-prem OpenShift platform. You will build APIs, design guardrails, and maintain observability for enterprise AI Agent solutions.

The role requires deep Python expertise, production experience with LLM/RAG systems, and leadership to guide cross-functional teams in a regulated financial environment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, MIS, or equivalent practical experience.
• 13+ years of software engineering experience designing, building, and scaling production applications.
• Strong Python proficiency with ML libraries and containerized workloads on OpenShift/Kubernetes.
• Proven production deployment of LLM- or RAG-based applications at scale.
• Experience building APIs and integrating third-party platforms.
• Experience with AI Agents development including OpenAI APIs and LangChain.
• Understanding of inference performance, guardrails, observability, and evaluation.
• Experience delivering in Agile environments with firm timelines.

Responsibilities

• Own delivery of critical vendor apps from build to production in a fully on-prem OpenShift environment.
• Build and maintain APIs connecting guardrail/observability platforms to AI Agent solutions.
• Establish workflows to monitor performance, safety, latency, throughput, quality, and guardrail effectiveness.
• Implement model evaluation frameworks using LLM-as-a-Judge and specialized language models.
• Develop observability dashboards and alerting with Grafana for audit-friendly traceability.
• Troubleshoot production issues and improve scalability, resilience, and availability.
• Contribute to evaluation methodologies and guardrails for AI systems.
• Lead and mentor engineers, set development standards, and drive process improvements.
• Provide input into budgeting, forecasting, and management of supported applications.

Skills

Automation

Influence

Result Orientation

Stakeholder Management

Technical Strategy Development

Application Development

Architecture

Business Acumen

Risk Management

Solution Design

Agile Practices

Analytical Thinking

Collaboration

Data Management

Solution Delivery Process

Education

Bachelor's or Master's degree in Computer Science, Data Science, MIS, a related field, or equivalent practical experience

Tools

OpenShift

Kubernetes

LangChain

OpenAI APIs

Grafana

Job description

Bank of America is hiring an experienced software engineer to own the delivery of critical AI vendor applications on an on-prem OpenShift platform. You will build APIs, design guardrails, and maintain observability for enterprise AI Agent solutions.

The role requires deep Python expertise, production experience with LLM/RAG systems, and leadership to guide cross-functional teams in a regulated financial environment.