Senior AI Data Engineer: RAG & LLM Production Architect

Cooley LLP; New York (NY); On-site; USD 220,000 - 250,000; Full time

Job summary

Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications.

Work with the Northstar Lakehouse and Databricks stack, partnering with data engineers to maintain governance, data quality, and scalable AI infrastructure for the firm’s analytics needs.

Qualifications

• 5+ years of data/AI engineering with production responsibility for RAG pipelines and AI infrastructure.
• Strong Python proficiency and production-grade code practices.
• Experience with LLM integration, prompt engineering, and observability.

Responsibilities

• Design, build, and maintain production RAG pipelines and embedding infrastructure.
• Develop and monitor LLM integration, prompts, and feature observability.
• Collaborate with Data Engineering & Platform to ensure governed data for AI workloads.

Skills

RAG pipelines

LLM integration

Python

Databricks

Vector search

Tools

Pinecone

Databricks Vector Search

pgvector

Chroma

Job description

Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications.

Work with the Northstar Lakehouse and Databricks stack, partnering with data engineers to maintain governance, data quality, and scalable AI infrastructure for the firm’s analytics needs.