GenAI Observability & Governance Engineer (On‑Prem OpenShift)
Bank of America
Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Job summary
Bank of America is seeking an experienced software engineer to lead GenAI operations within an on-prem OpenShift environment in Jersey City, NJ. You will guardrails, monitor observability, and integrate AI governance tools across enterprise applications.
The role requires a strong background in Python, containerized workloads, and building production-grade AI workflows, with collaboration across teams and leadership responsibilities.
Qualifications
- Degree in CS/Data Science/MIS or equivalent experience.
- 10+ years of software engineering in production applications.
- Strong Python development experience with ML libraries.
- Experience deploying containerized workloads on OpenShift/Kubernetes.
- Experience bringing LLM/RAG-based apps to production.
- Knowledge of AI risks, governance, and guardrails.
Responsibilities
- Develop, deploy, and support vendor apps in an on-prem OpenShift environment.
- Build APIs and integrations connecting guardrails and observability tools.
- Implement and maintain monitoring for performance, safety, latency.
- Develop and calibrate model-based evaluation workflows.
- Utilize LangChain for guardrails, prompts, and scoring workflows.
- Create observability dashboards and alerting capabilities.
- Troubleshoot production issues and improve scalability and reliability.
- Lead and mentor team members; drive engineering standards.
Skills
Education
Tools
Job description
Bank of America is seeking an experienced software engineer to lead GenAI operations within an on-prem OpenShift environment in Jersey City, NJ. You will guardrails, monitor observability, and integrate AI governance tools across enterprise applications.
The role requires a strong background in Python, containerized workloads, and building production-grade AI workflows, with collaboration across teams and leadership responsibilities.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
