Senior AI Engineer

Brown Brothers Harriman

Jersey City (NJ)

On-site

USD 175,000 - 215,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Brown Brothers Harriman (BBH) seeks an experienced AI Engineer to build the intelligence layer of its platform, enabling financial services users to generate data transformations from natural language and receive intelligent integration suggestions. You will develop LLM pipelines, RAG systems, and agentic workflows in production, alongside Backend Engineers to surface AI capabilities through the platform.

The role requires 5+ years in software engineering with hands-on GenAI/LLM work and a track

Qualifications

  • 5+ years of software engineering with production AI experience.
  • 1+ years focused on GenAI/LLM applications in production and shipped features to real users.
  • Experience building robust LLM pipelines and RAG systems for production.
  • Ability to work with Backend Engineers and cloud platforms to surface AI capabilities.
  • Familiarity with financial data schemas and data transformation concepts is a plus.

Responsibilities

  • Build and iterate on AI-powered product features - transformation generation from natural language, integration configuration suggestions, data quality detection, and automated validation.
  • Implement LLM pipelines that are robust, observable, and production-ready - not proof-of-concepts.
  • Build and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial services data schemas.
  • Evaluate and improve AI output quality continuously - build evaluation datasets and automated scoring frameworks.
  • Implement multi-step agentic workflows using Agno and ensure proper error handling, retry logic, and human escalation paths.
  • Work closely with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer.

Skills

LLM/GenAI
Python
LLM pipelines
RAG systems
Agentic workflows
Cloud experience
Vector databases
OpenAI/Anthropic APIs

Tools

Agno
LangChain
LlamaIndex
OpenAI API
Anthropic Claude
Pinecone
Weaviate

Job description

At BBH, Partnership is more than a form of ownership—it’s our approach to business and relationships. We know that supporting your professional and personal goals is the best way to help our clients and advance our business. We take that responsibility seriously. With a 200-year legacy and a shared passion for what’s next, this is the right place to build a fulfilling career.

About The Role

As an AI Engineer, you'll build the intelligence layer of the platform - the AI-powered features that allow financial services users to generate data transformations from natural language, get intelligent integration suggestions, detect data quality issues, and refine outputs based on feedback. This is where the product stops feeling like a tool and starts feeling genuinely new.

This is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize AI systems for accuracy, latency, and cost in a context where correctness matters; and collaborate closely with Backend Engineers to ensure AI capabilities are reliably surfaced through the platform. You'll work under the direction of the Head of AI Engineering and have real ownership over the features you build.

Responsibilities
AI Feature Development
  • Build and iterate on AI-powered product features - transformation generation from natural language, integration configuration suggestions, data quality detection, and automated validation
  • Implement LLM pipelines that are robust, observable, and production-ready - not proof-of-concepts
LLM Pipeline Engineering
  • Build and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial services data schemas
  • Evaluate and improve AI output quality continuously - build evaluation datasets and automated scoring frameworks
  • Optimize for accuracy, latency, and cost across different usage patterns
Agentic Workflows
  • Implement multi-step agentic workflows using Agno
  • Build workflows that handle complex, multi-turn AI interactions cleanly - with proper error handling, retry logic, and human escalation paths
Platform Collaboration
  • Work closely with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer
  • Build the service interfaces that connect AI outputs to platform execution cleanly
  • Participate in code reviews and maintain high standards for code quality and testability
Requirements
Experience
  • 5+ years software engineering; 1+ years focused on GenAI/LLM applications in production
  • Has shipped AI features to real users - not just prototypes or internal demos
Technical Skills
  • Hands-on with LLM APIs in production - Anthropic Claude and/or OpenAI
  • Built and shipped RAG systems to production (not just experimented with them)
  • Experience with agentic frameworks - Agno, LangChain, LlamaIndex, or comparable
  • Strong Python proficiency
  • Azure or AWS cloud experience
  • Vector databases - Pinecone, Weaviate, pgvector, or comparable
  • Active user of AI coding assistants in daily workflow
Nice to Have
  • Financial services or data domain background - understanding of financial data schemas, transformation logic, or data quality requirements adds significant context to the role
  • Experience with Temporal or workflow orchestration systems
  • Experience fine-tuning models or working with open-source LLMs for domain-specific tasks
  • Open-source AI contributions or technical writing
  • Data engineering familiarity - understanding ETL/ELT patterns helps in building more effective transformation generation features
Salary Range

MA: $175,000 - $215,000 base salary + annual target bonus

NY/ NJ: $175,000 - $215,000 base salary + annual target bonus

BBH and its affiliates' compensation program includes base salary, discretionary bonuses, and profit-sharing. The anticipated base salary range(s) shown above are only for the indicated location(s) and may differ in other locations due to cost of living and labor considerations. Base salaries may vary based on factors such as skill, experience and qualification for the role. BBH's total rewards package recognizes your contributions with more than just a paycheck—providing you with benefits that enhance your experience at BBH from long-term savings, healthcare, and income protection to professional development opportunities and time off, our programs support your overall well-being.

We value diverse experiences. We value diverse experiences and transferrable skillsets. If your career hasn’t followed a traditional path, includes alternative experiences, or doesn’t meet every qualification or skill listed in the job description, please do go ahead and apply.

About BBH

Brown Brothers Harriman (BBH) is a premier global financial services firm, known for premium service, specialist expertise, technology solutions and partnership approach to client management. Across Investor Services and Capital Partners, we work with an enviable roster of sophisticated clients who make BBH their first call when they are tackling their hardest challenges. Delivering for our clients and each other energizes us.

We believe that how we do our work is just as important as what we do. We are relentless problem solvers who know our best ideas come from collective debate and development—so we are never possessive about our ideas. Every day we come together as a diverse community of smart and caring people to deliver exceptional service and expert advice—creating success that lasts. No matter where you sit in the organization, everyone is empowered to contribute their ideas. BBHers can pick up the phone and call any colleague, and they are happy to help. Expanding your impact beyond your daily role is part of how we operate as trusted partners to one another.

We believe stability is a competitive advantage, but being stable means having the knowledge, skill, and discipline to evolve, often—pushing the boundaries of innovation. As a private partnership, every investment we make is in the relationships, technologies, products and development we believe are in the long-term interests of our clients and our people. Our long-tenured leaders are experts in their areas and are actively involved in the day-to day business, taking the time to provide guidance and mentoring to build the next generation of BBHers. Because we know, our success begins with yours.

Go to BBH.com to learn more about our rewards and benefits, philanthropy, approach to sustainability or how we support you to thrive personally, physically and financially.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, genetic information, creed, marital status, sexual orientation, gender identity, disability status, protected veteran status, or any other protected status under federal, state or local law.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer
Senior AI Engineer

Brown Brothers Harriman • Boston (MA)

On-site
USD 175,000 - 215,000
Senior AI Engineer
Senior AI Engineer

Brown Brothers Harriman • New York (NY)

On-site
USD 175,000 - 215,000
Senior AI Engineer
Senior AI Engineer

Brown Brothers Harriman & Co. • Boston (MA)

On-site
USD 175,000 - 215,000
Senior AI Engineer
Senior AI Engineer

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 175,000 - 215,000
AI Engineering Director
AI Engineering Director

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 210,000 - 260,000
Market-rate salary
Comprehensive benefits
Equity options for select roles
AI Engineering Director
AI Engineering Director

Brown Brothers Harriman • Boston (MA)

On-site
USD 150,000 - 200,000
Market-rate salary and comprehensive benefits
Equity available for select roles
Professional development budget
AI Engineering Director
AI Engineering Director

Brown Brothers Harriman • New York (NY)

On-site
USD 150,000 - 200,000
Market-rate salary
Comprehensive benefits
Equity options for select roles
+3
AI Engineering Director
AI Engineering Director

Brown Brothers Harriman • Jersey City (NJ)

On-site
USD 150,000 - 180,000
Market-rate salary
Comprehensive benefits
Equity available for select roles
Frontend Engineer
Frontend Engineer

Brown Brothers Harriman • New York (NY)

On-site
USD 90,000 - 135,000
Frontend Engineer
Frontend Engineer

Brown Brothers Harriman & Co. • Boston (MA)

On-site
USD 85,000 - 130,000