GenAI Guardrails & Observability Engineer on OpenShift

Hobbsnews; Charlotte, Northern (NC, KY); Hybrid; USD 103,000 - 180,000; Full time

Job summary

Bank of America is seeking an experienced software engineer to architect, deploy, and operate on‑premises GenAI applications within an OpenShift environment. You will build APIs to connect guardrail and observability platforms to enterprise GenAI apps and monitor model evaluation workflows for safety and performance.

The role emphasizes leadership, cross‑functional collaboration, and rapid adaptation to evolving AI tooling, with a strong focus on governance and scalable deployments.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, MIS, or related field, or equivalent experience.
• 10+ years of software engineering experience building and scaling production applications.
• Strong Python development experience, including common ML and data libraries.
• Hands-on experience with OpenShift or Kubernetes in production environments.
• Experience deploying and supporting LLM or RAG-based applications.
• Understanding of AI risks, agent behavior, and governance frameworks.
• Experience integrating third-party platforms and supporting vendor applications.
• Experience with OpenAI APIs, LangChain, and GenAI development frameworks.
• Knowledge of inference performance optimization and scalability.
• Experience implementing AI guardrails, observability, and model evaluation processes.
• Experience working in Agile environments.
• Proven ability to lead technical initiatives and influence stakeholders.
• Strong analytical, problem-solving, and communication skills.
• Experience delivering technology solutions within large, regulated enterprise environments, preferably financial services.
• Experience with annotation pipelines, feedback loops, fine-tuning, and alignment techniques.
• Familiarity with prompt lifecycle management and versioning.
• Experience with Galileo, LangSmith, Splunk, or similar observability platforms.
• Familiarity with LlamaIndex, Haystack, or other GenAI frameworks.
• Experience with evaluation and guardrails for agentic AI workflows.
• Self-directed, collaborative working style across engineering teams.

Responsibilities

• Develop, deploy, and operate vendor applications in an on-premises OpenShift environment.
• Build and maintain APIs and integrations connecting vendor guardrail and observability platforms to enterprise GenAI applications.
• Monitor application performance, safety, latency, throughput, and guardrail metrics.
• Implement and maintain model-based evaluation workflows, including annotation and calibration processes.
• Utilize orchestration frameworks such as LangChain for guardrail checks, prompt management, and scoring workflows.
• Build observability dashboards and alerting solutions.
• Troubleshoot production issues and optimize performance, scalability, and resilience.
• Contribute to emerging AI evaluation and guardrail strategies for agentic workflows.
• Lead and mentor engineers while driving cross-functional initiatives and engineering best practices.

Skills

Python development

APIs & integrations

DevOps practices

Analytical thinking

Communication

Leadership

Agile

Problem solving

Cross-functional collaboration

Guardrails & evaluation

Education

Bachelor's or Master's degree in Computer Science, Data Science, MIS, or related field, or equivalent experience

Tools

OpenShift

Kubernetes

LangChain

LangSmith

Splunk

GenAI frameworks

OpenAI APIs

Job description

Bank of America is seeking an experienced software engineer to architect, deploy, and operate on‑premises GenAI applications within an OpenShift environment. You will build APIs to connect guardrail and observability platforms to enterprise GenAI apps and monitor model evaluation workflows for safety and performance.

The role emphasizes leadership, cross‑functional collaboration, and rapid adaptation to evolving AI tooling, with a strong focus on governance and scalable deployments.