Senior AI Engineer — Production LLM & RAG Pipelines

Brown Brothers Harriman & Co.; Town of Boston (NY); On-site; USD 175,000 - 215,000; Full time

Job summary

Brown Brothers Harriman & Co. is hiring a Senior AI Engineer to build the intelligent layer of our platform across multiple U.S. locations including Boston, Jersey City, and New York.

You will own AI features—from transformation generation via natural language to data-quality checks—while shipping robust LLM pipelines and RAG components in production. You will work closely with Backend Engineers under the Head of AI Engineering to ensure scalable, observable AI capabilities and cost-efficient

Qualifications

• 5+ years software engineering experience.
• ≥1 year focused on GenAI/LLM in production.

Responsibilities

• Build and iterate on AI-powered features, including data transformations from natural language and integration suggestions.
• Develop and maintain production-ready LLM pipelines with prompt engineering, context management, and RAG systems.
• Collaborate with Backend Engineers to surface AI capabilities through the platform and ensure reliable API integration.

Skills

LLM APIs

RAG systems

Agentic frameworks

Python

Cloud (Azure/AWS)

Vector databases

AI in production

Code assistants

Tools

Agno

LangChain

LlamaIndex

Job description

Brown Brothers Harriman & Co. is hiring a Senior AI Engineer to build the intelligent layer of our platform across multiple U.S. locations including Boston, Jersey City, and New York.

You will own AI features—from transformation generation via natural language to data-quality checks—while shipping robust LLM pipelines and RAG components in production. You will work closely with Backend Engineers under the Head of AI Engineering to ensure scalable, observable AI capabilities and cost-efficient