Senior GenAI Engineer, Production LLM Pipelines

Brown Brothers Harriman

Boston (MA)

On-site

USD 175,000 - 215,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

BBH in Boston seeks an AI Engineer to build the AI-powered features of our platform, enabling natural language-driven data transformations, intelligent integration suggestions, and data quality tooling. You will own LLM pipelines, RAG systems, and agentic workflows, collaborating with Backend Engineers to surface capabilities through the API.

You will report to the Head of AI Engineering and deliver production-ready AI features with a focus on accuracy, latency, and cost in a financial services

Qualifications

  • 5+ years software engineering; 1+ years focused on GenAI/LLM applications in production
  • Has shipped AI features to real users - not just prototypes or internal demos

Responsibilities

  • Build and iterate on AI-powered product features: transformations from natural language, config suggestions, data quality detection, automated validation.
  • Implement robust LLM pipelines that are observable and production-ready, including prompt engineering, context management, and RAG systems.
  • Create multi-step agentic workflows using Agno and ensure error handling, retries, and proper escalation.
  • Collaborate with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer; build service interfaces connecting outputs to platform execution; participate in code reviews and maintain high standards.

Skills

Python
LLM APIs
RAG systems
Agno/agentic
LangChain
Cloud: Azure/AWS
Vector databases
Code quality/testing
Data transformation

Tools

Agno
LangChain
LlamaIndex
Pinecone
Weaviate
pgvector

Job description

BBH in Boston seeks an AI Engineer to build the AI-powered features of our platform, enabling natural language-driven data transformations, intelligent integration suggestions, and data quality tooling. You will own LLM pipelines, RAG systems, and agentic workflows, collaborating with Backend Engineers to surface capabilities through the API.

You will report to the Head of AI Engineering and deliver production-ready AI features with a focus on accuracy, latency, and cost in a financial services

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer: Production LLM Pipelines
Senior AI Engineer: Production LLM Pipelines

Brown Brothers Harriman • Jersey City (NJ)

On-site
USD 175,000 - 215,000
Senior AI Engineer — Production LLM & RAG Pipelines
Senior AI Engineer — Production LLM & RAG Pipelines

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 175,000 - 215,000
Senior AI Engineer: Production LLM Pipelines for Finance
Senior AI Engineer: Production LLM Pipelines for Finance

Brown Brothers Harriman • New York (NY)

On-site
USD 175,000 - 215,000
Principal AI Engineer: Lead Production LLMs & AI Platform
Principal AI Engineer: Lead Production LLMs & AI Platform

Harrington Starr • Boston (MA)

On-site
USD 180,000 - 260,000
Senior AI Engineer — Production LLM Systems
Senior AI Engineer — Production LLM Systems

CyberCoders • New York (NY)

On-site
USD 220,000 - 280,000
Unlimited PTO
Wellhub Platinum membership
Comprehensive health, dental, and vis​
+1
Senior AI/ML Engineer, Production Pipelines & RAG
Senior AI/ML Engineer, Production Pipelines & RAG

Bain & Company • Atlanta (GA)

Hybrid
USD 79,000 - 87,000
401(k) plan with employer contribution
Premium medical/dental/vision coverage
Generous paid time off
LLM & GenAI Engineer — Production-Grade AI Pipelines
LLM & GenAI Engineer — Production-Grade AI Pipelines

Latitude • Chicago (IL), Northern (KY)

Hybrid
USD 140,000 - 210,000
Remote Senior AI Engineer: LLM Pipelines & Agentic Systems
Remote Senior AI Engineer: LLM Pipelines & Agentic Systems

BairesDev • United States

Remote
USD 140,000 - 200,000
100% remote work
Excellent USD compensation
Hardware & software setup
+3
LLM Engineer: Production ML Systems & AI Pipelines
LLM Engineer: Production ML Systems & AI Pipelines

Cantor Fitzgerald • New York (NY)

On-site
USD 140,000 - 160,000
Senior Backend Engineer: AI/LLM Production & Data Pipelines
Senior Backend Engineer: AI/LLM Production & Data Pipelines

Instrumentl • Oregon (WI)

Hybrid
USD 175,000 - 220,000
Health insurance
Dental insurance
Vision insurance
+1