Senior AI Engineer: Production LLM Pipelines

Brown Brothers Harriman; Jersey City (NJ); On-site; USD 175,000 - 215,000; Full time

Job summary

Brown Brothers Harriman (BBH) seeks an experienced AI Engineer to build the intelligence layer of its platform, enabling financial services users to generate data transformations from natural language and receive intelligent integration suggestions. You will develop LLM pipelines, RAG systems, and agentic workflows in production, alongside Backend Engineers to surface AI capabilities through the platform.

The role requires 5+ years in software engineering with hands-on GenAI/LLM work and a track

Qualifications

• 5+ years of software engineering with production AI experience.
• 1+ years focused on GenAI/LLM applications in production and shipped features to real users.
• Experience building robust LLM pipelines and RAG systems for production.
• Ability to work with Backend Engineers and cloud platforms to surface AI capabilities.
• Familiarity with financial data schemas and data transformation concepts is a plus.

Responsibilities

• Build and iterate on AI-powered product features - transformation generation from natural language, integration configuration suggestions, data quality detection, and automated validation.
• Implement LLM pipelines that are robust, observable, and production-ready - not proof-of-concepts.
• Build and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial services data schemas.
• Evaluate and improve AI output quality continuously - build evaluation datasets and automated scoring frameworks.
• Implement multi-step agentic workflows using Agno and ensure proper error handling, retry logic, and human escalation paths.
• Work closely with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer.

Skills

LLM/GenAI

Python

LLM pipelines

RAG systems

Agentic workflows

Cloud experience

Vector databases

OpenAI/Anthropic APIs

Tools

Agno

LangChain

LlamaIndex

OpenAI API

Anthropic Claude

Pinecone

Weaviate

Job description

Brown Brothers Harriman (BBH) seeks an experienced AI Engineer to build the intelligence layer of its platform, enabling financial services users to generate data transformations from natural language and receive intelligent integration suggestions. You will develop LLM pipelines, RAG systems, and agentic workflows in production, alongside Backend Engineers to surface AI capabilities through the platform.

The role requires 5+ years in software engineering with hands-on GenAI/LLM work and a track