Senior AI Engineer: Production LLM Pipelines for Finance

Brown Brothers Harriman; New York (NY); On-site; USD 175,000 - 215,000; Full time

Job summary

Brown Brothers Harriman (BBH) invites an AI Engineer to build the intelligence layer of our platform. You’ll develop AI-powered features, robust LLM pipelines, and agentic workflows in production, collaborating with Backend Engineers to surface capabilities through the platform API.

You will influence data transformation generation from natural language, data quality checks, and cost-efficient AI solutions for financial services, reporting to the Head of AI Engineering.

Qualifications

• 5+ years software engineering; 1+ years focused on GenAI/LLM applications in production
• Has shipped AI features to real users - not just prototypes or internal demos
• Hands-on with LLM APIs in production - Anthropic Claude and/or OpenAI
• Built and shipped RAG systems to production (not just experimented with them)
• Experience with agentic frameworks - Agno, LangChain, LlamaIndex, or comparable
• Strong Python proficiency
• Azure or AWS cloud experience
• Vector databases - Pinecone, Weaviate, pgvector, or comparable
• Active user of AI coding assistants in daily workflow

Responsibilities

• Build and iterate on AI-powered product features - transformation generation from natural language, integration configuration suggestions, data quality detection, and automated validation
• Implement LLM pipelines that are robust, observable, and production-ready - not proof-of-concepts
• Build and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial services data schemas
• Evaluate and improve AI output quality continuously - build evaluation datasets and automated scoring frameworks
• Optimize for accuracy, latency, and cost across different usage patterns
• Implement multi-step agentic workflows using Agno
• Build workflows that handle complex, multi-turn AI interactions cleanly - with proper error handling, retry logic, and human escalation paths
• Work closely with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer
• Build the service interfaces that connect AI outputs to platform execution cleanly
• Participate in code reviews and maintain high standards for code quality and testability

Skills

LLM APIs production

RAG systems

Agentic frameworks

Python

Cloud experience (Azure/AWS)

Vector databases

AI coding assistants

5+ years software engineering

GenAI/LLM production

Tools

Agno

LangChain

LlamaIndex

Pinecone

Weaviate

pgvector

Job description

Brown Brothers Harriman (BBH) invites an AI Engineer to build the intelligence layer of our platform. You’ll develop AI-powered features, robust LLM pipelines, and agentic workflows in production, collaborating with Backend Engineers to surface capabilities through the platform API.

You will influence data transformation generation from natural language, data quality checks, and cost-efficient AI solutions for financial services, reporting to the Head of AI Engineering.