Python/GenAI Engineer (Hybrid: NYC or NJ)

Braintrust; New York (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

Braintrust seeks a Python/GenAI Engineer to design, build, and deploy production-grade GenAI applications for financial services clients. You will develop LLM-powered solutions, scalable Python services, and data pipelines, collaborating with data scientists, software engineers, and client stakeholders to ensure accuracy, governance, scalability, and security.

You will architect RAG pipelines, craft prompts, and evaluate model performance, latency, and reliability while delivering robust API

Qualifications

• Design, build, and deploy GenAI-powered applications for financial services clients.
• Develop LLM-based solutions with scalable Python services and data pipelines.
• Collaborate with data scientists, software engineers, and stakeholders to meet enterprise standards.

Responsibilities

• GenAI application development: create LLM-powered apps like assistants, summarization, and workflow automation.
• Implement Retrieval-Augmented Generation (RAG) pipelines with vector databases and embedding models.
• Craft and evaluate prompts and agentic workflows to measure accuracy and latency.
• Build scalable Python services and RESTful APIs with FastAPI or Flask.
• Develop data ingestion/transformation pipelines using Pandas, SQL, and cloud services.
• Deploy and monitor AI solutions on cloud platforms with Docker and CI/CD.

Skills

GenAI

Prompt engineering

API design

Data pipelines

Agile collaboration

Python development

Tools

LangChain

LlamaIndex

OpenAI

Anthropic

Azure OpenAI

Pinecone

FAISS

pgvector

FastAPI

Flask

Pandas

Docker

AWS

Azure

GCP

Job description

As a Python/GenAI Engineer, you will design, build, and deploy intelligent, production-grade applications that apply generative AI to real-world challenges for financial services clients. In this client-facing technical role, you will develop LLM-powered solutions, build scalable Python services and data pipelines, and integrate AI capabilities into enterprise workflows. You will partner closely with data scientists, software engineers, business analysts, and client stakeholders to deliver AI solutions that meet strict enterprise standards for accuracy, governance, scalability, and security.

Essential Functions & Key Responsibilities

• GenAI Application Development: Design, develop, and deploy LLM-powered applications such as intelligent assistants, document summarization, and workflow automation, using frameworks like LangChain or LlamaIndex and models from providers such as OpenAI, Anthropic, or Azure OpenAI.
• Retrieval-Augmented Generation (RAG): Architect and implement RAG pipelines using vector databases (e.g., Pinecone, FAISS, pgvector), embedding models, and chunking strategies to ground model outputs in enterprise data.
• Prompt Engineering & Evaluation: Craft, test, and iterate on prompts and agentic workflows, and establish evaluation frameworks to measure accuracy, relevance, hallucination rates, and latency.
• Python Backend & API Development: Build scalable Python services and RESTful APIs using FastAPI or Flask, with clean, well-tested, and maintainable code.
• Data Engineering & Pipelines: Develop data ingestion and transformation pipelines using Pandas, SQL, and cloud-based data services to prepare structured and unstructured data for AI workloads.
• Cloud Deployment & MLOps: Deploy and monitor AI solutions on cloud platforms (AWS, Azure, or GCP) using Docker, CI/CD pipelines, and observability tooling to ensure reliability and cost efficiency.
• Responsible AI & Security: Implement guardrails, data privacy controls, and governance practices that align with client security, model risk management, and regulatory compliance standards.
• Agile Collaboration: Participate actively in Agile ceremonies (sprint planning, daily stand-ups), track work in Jira and collaborate with cross-functional teams to translate business needs to AI-enabled solutions.