AI Monitoring & Guardrails Engineer (On-Prem OpenShift)

Hobbsnews; Charlotte, Northern (NC, KY); Hybrid; USD 122,000 - 200,000; Full time

Benefits offered by this job

Benefits eligible

Job summary

Bank of America is hiring for a senior engineering role focused on building and operating on-prem vendor applications within OpenShift. You will develop APIs, implement guardrails, and establish observability for enterprise AI Agent solutions.

The ideal candidate has 13+ years of software engineering experience, strong Python skills, and hands-on Kubernetes/OpenShift deployment with AI integrations. This role emphasizes governance, risk management, and cross-functional leadership.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, MIS, a related field, or equivalent practical experience.
• 13+ years of software engineering experience designing, building, and scaling production applications.
• Strong proficiency in Python, including common data and ML libraries; hands-on experience deploying and operating containerized workloads on OpenShift or Kubernetes.

Responsibilities

• Own delivery of critical vendor applications from build through production support in a fully on-premises OpenShift environment, meeting milestones and quality expectations.
• Build and maintain APIs and integrations connecting vendor guardrail and observability platforms to enterprise AI Agent solutions.
• Establish and manage workflows that monitor performance, safety, latency, throughput, quality, and guardrail effectiveness for AI risk and control objectives.
• Implement and maintain model evaluation frameworks using LLM-as-a-Judge and specialized language models.
• Develop observability dashboards and alerting using Grafana or similar tools, producing audit-friendly evidence and traceability.
• Troubleshoot production issues and improve scalability, resilience, and operational efficiency to sustain availability for critical business services.
• Contribute to evaluation methodologies and guardrail controls for agentic and multi-step AI systems.
• Lead and mentor engineers, establish development standards, and drive process improvements across cross-functional delivery.
• Provide input into financial planning, budget tracking, forecasting, and management of supported applications and services.

Skills

Automation

Influence

Result Orientation

Stakeholder Management

Technical Strategy Development

Application Development

Architecture

Business Acumen

Risk Management

Solution Design

Agile Practices

Analytical Thinking

Collaboration

Data Management

Solution Delivery Process

Education

Bachelor's or Master's degree in Computer Science, Data Science, MIS, or related field

Tools

OpenShift

Kubernetes

OpenAI APIs

LangChain

Grafana

Job description

Bank of America is hiring for a senior engineering role focused on building and operating on-prem vendor applications within OpenShift. You will develop APIs, implement guardrails, and establish observability for enterprise AI Agent solutions.

The ideal candidate has 13+ years of software engineering experience, strong Python skills, and hands-on Kubernetes/OpenShift deployment with AI integrations. This role emphasizes governance, risk management, and cross-functional leadership.