Senior AI Guardrails & Observability Engineer

Bank of America; Charlotte (NC); In loco; USD 122.000 - 200.000; Tempo pieno

Vantaggi offerti da questo lavoro

Benefits eligible

Descrizione del lavoro

Bank of America is seeking an experienced software engineer to own end-to-end delivery of on-prem vendor applications within an OpenShift environment, supporting AI monitoring and governance across enterprise systems.

You will build APIs, implement guardrails, and lead cross-functional delivery while ensuring reliability, scalability and auditability in a regulated financial services setting.

Competenze

• Bachelor's or Master's degree in Computer Science, Data Science, MIS, a related field, or equivalent practical experience.
• 13+ years of software engineering experience designing, building, and scaling production applications.
• Strong proficiency in Python, including common data and ML libraries. Hands-on experience deploying and operating containerized workloads on OpenShift or Kubernetes.
• Proven experience taking LLM- or RAG-based applications into production and maintaining them at scale.
• Experience building APIs and integrating third-party platforms.
• Working experience with AI Agents development, including OpenAI APIs and LangChain.
• Practical understanding of inference performance optimization. Experience applying guardrails, observability, and model-based evaluation to AI applications.
• Experience delivering within Agile and Agile-at-scale environments against firm timelines.
• Proven ability to influence outcomes and meet delivery commitments in a matrixed organization without direct authority. Strong problem-solving, communication, and stakeholder management skills.

Mansioni

• Own delivery of critical vendor applications from build through production support in a fully on-premises OpenShift environment, meeting committed milestones and quality expectations.
• Build and maintain APIs and integrations connecting vendor guardrail and observability platforms to enterprise AI Agent solutions.
• Establish and manage workflows that monitor performance, safety, latency, throughput, quality, and guardrail effectiveness in support of AI risk and control objectives.
• Implement and maintain model evaluation frameworks using LLM-as-a-Judge and specialized language models.
• Develop observability dashboards and alerting using Grafana or similar tools, producing audit-friendly evidence and traceability.
• Troubleshoot production issues and improve scalability, resilience, and operational efficiency to sustain availability for critical business services.
• Contribute to evaluation methodologies and guardrail controls for agentic and multi-step AI systems.
• Lead and mentor engineers, establish development standards, and drive process improvements across cross-functional delivery.
• Provide input into financial planning, budget tracking, forecasting, and management of supported applications and services.

Conoscenze

Python

OpenShift

Kubernetes

LangChain

OpenAI APIs

APIs

LLM Production

Agile

Observability

Guardrails

Formazione

Bachelor's or Master's in CS/Data Science/MIS

Strumenti

Grafana

LangSmith

Splunk

Galileo

Descrizione del lavoro

Bank of America is seeking an experienced software engineer to own end-to-end delivery of on-prem vendor applications within an OpenShift environment, supporting AI monitoring and governance across enterprise systems.

You will build APIs, implement guardrails, and lead cross-functional delivery while ensuring reliability, scalability and auditability in a regulated financial services setting.