GenAI Observability & Guardrails Engineer - On-Prem OpenShift
Bank of America
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Job summary
Bank of America is seeking an experienced engineer to design, deploy, and operate on-prem OpenShift-based GenAI monitoring and governance applications. You will build and integrate components, support containerized services, and uphold AI guardrails with Galileo, LangSmith, and related tools.
You will monitor performance, safety, and quality, operationalize model-based evaluation workflows, and collaborate across teams to advance enterprise AI initiatives in a regulated financial services
Qualifications
- Degree in CS/DS or related field or equivalent experience.
- 10+ years of software engineering experience.
- Strong Python development with ML libraries.
- Experience deploying containerized workloads on OpenShift/Kubernetes.
- Proven in production LLM/RAG applications and governance.
- Experience building APIs and third-party integrations.
Responsibilities
- Develop, deploy, and support vendor apps in an on-prem OpenShift environment.
- Build APIs and integrations between guardrails, observability tools and GenAI apps.
- Implement and maintain monitoring for performance, safety, latency, and quality.
- Calibrate model-based evaluation workflows including annotation and feedback.
- Use LangChain for guardrails, prompts, and scoring workflows.
- Create dashboards and alerts; troubleshoot and improve scalability.
- Mentor teammates and drive engineering standards and delivery.
Skills
Education
Tools
Job description
Bank of America is seeking an experienced engineer to design, deploy, and operate on-prem OpenShift-based GenAI monitoring and governance applications. You will build and integrate components, support containerized services, and uphold AI guardrails with Galileo, LangSmith, and related tools.
You will monitor performance, safety, and quality, operationalize model-based evaluation workflows, and collaborate across teams to advance enterprise AI initiatives in a regulated financial services
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
