Python/GenAI Engineer (Hybrid: NYC or NJ)

Braintrust; United States; Hybrid; USD 80,000 - 113,000; Full time

Job summary

Braintrust is seeking a Python/GenAI Engineer in a hybrid role based in New York/New Jersey. You will design, build, and deploy LLM-powered applications for financial services, collaborating with data scientists, engineers, and client stakeholders to ensure accuracy, governance, and scalable solutions.

Responsibilities include building Python services, implementing RAG pipelines, and deploying AI workloads on cloud platforms with Docker and CI/CD. Strong emphasis on security and compliance.

Qualifications

• Design, build, and deploy GenAI-powered applications for financial services clients.
• Develop LLM-powered solutions and scalable Python services.
• Implement RAG pipelines grounding outputs in enterprise data.

Responsibilities

• Develop GenAI applications using LangChain or LlamaIndex.
• Architect RAG pipelines with vector databases and embeddings.
• Craft prompts, evaluate models, and optimize latency and accuracy.
• Build Python backends and RESTful APIs with FastAPI or Flask.
• Create data pipelines using Pandas and SQL for AI workloads.
• Deploy AI solutions on AWS/Azure/GCP with CI/CD and observability.
• Ensure governance, security, and compliance in AI systems.

Skills

GenAI

RAG

Prompt engineering

Python

Pandas

Cloud/MLOps

Security

Agile

Tools

LangChain

LlamaIndex

OpenAI

Azure OpenAI

Pinecone

FAISS

Docker

FastAPI

Job description

• Rate: $70/hr
• Hours: 40 hours / week
• Experience: 5 - 10 years
• Location: Jersey City, NJ, USA + 1 more

As a Python/GenAI Engineer, you will design, build, and deploy intelligent, production-grade applications that apply generative AI to real-world challenges for financial services clients. In this client-facing technical role, you will develop LLM-powered solutions, build scalable Python services and data pipelines, and integrate AI capabilities into enterprise workflows. You will partner closely with data scientists, software engineers, business analysts, and client stakeholders to deliver AI solutions that meet strict enterprise standards for accuracy, governance, scalability, and security.

Essential Functions & Key Responsibilities

• GenAI Application Development: Design, develop, and deploy LLM-powered applications such as intelligent assistants, document summarization, and workflow automation, using frameworks like LangChain or LlamaIndex and models from providers such as OpenAI, Anthropic, or Azure OpenAI.
• Retrieval-Augmented Generation (RAG): Architect and implement RAG pipelines using vector databases (e.g., Pinecone, FAISS, pgvector), embedding models, and chunking strategies to ground model outputs in enterprise data.
• Prompt Engineering & Evaluation: Craft, test, and iterate on prompts and agentic workflows, and establish evaluation frameworks to measure accuracy, relevance, hallucination rates, and latency.
• Python Backend & API Development: Build scalable Python services and RESTful APIs using FastAPI or Flask, with clean, well-tested, and maintainable code.
• Data Engineering & Pipelines: Develop data ingestion and transformation pipelines using Pandas, SQL, and cloud-based data services to prepare structured and unstructured data for AI workloads.
• Cloud Deployment & MLOps: Deploy and monitor AI solutions on cloud platforms (AWS, Azure, or GCP) using Docker, CI/CD pipelines, and observability tooling to ensure reliability and cost efficiency.
• Responsible AI & Security: Implement guardrails, data privacy controls, and governance practices that align with client security, model risk management, and regulatory compliance standards.
• Agile Collaboration: Participate actively in Agile ceremonies (sprint planning, daily stand-ups), track work in Jira, and collaborate with cross-functional teams to translate business needs into AI-enabled solutions.

Company: Python/GenAI Engineer (Hybrid: NYC or NJ)

Location: New York, NY, USA