GenAI Observability & Governance Engineer (OpenShift)

Bank of America

United States

On-site

USD 180,000 - 250,000

Full time

2 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Bank of America is seeking an experienced software engineer to own GenAI operations in an on-prem OpenShift environment. You will deploy and support guardrail and observability tools, integrate AI workflows, and drive model-based evaluation across enterprise systems.

The role emphasizes leadership, collaboration with cross-functional teams, and a pragmatic build-and-operate mindset to advance governance and performance of LLM/RAG powered applications.

Qualifications

10+ years of software engineering experience.
Strong Python development with ML libraries.
Experience with OpenShift or Kubernetes.
Experience with OpenAI APIs and LangChain.
Experience building APIs and integrating platforms.

Responsibilities

Develop, deploy, and support vendor apps in on-prem OpenShift.
Build APIs to connect guardrails with GenAI apps.
Monitor performance, safety, latency, quality metrics.
Calibrate model-based evaluation workflows including annotation and feedback.
Lead cross-functional delivery and engineering standards.
Support agentic and multi-step AI workflows.

Skills

Python

OpenShift

Kubernetes

APIs

LangChain

LLM governance

Agile

Leadership

Education

Bachelor's or Master's in CS or related

Tools

LangChain

LangSmith

OpenAI APIs

Observability tools

Docker

Job description

The role emphasizes leadership, collaboration with cross-functional teams, and a pragmatic build-and-operate mindset to advance governance and performance of LLM/RAG powered applications.

Get your free, confidential resume review.

or drag and drop your file here.