Senior AI Data Engineer: RAG & LLM Production Architect

Cooley LLP

New York (NY)

On-site

USD 220,000 - 250,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications.

Work with the Northstar Lakehouse and Databricks stack, partnering with data engineers to maintain governance, data quality, and scalable AI infrastructure for the firm’s analytics needs.

Qualifications

  • 5+ years of data/AI engineering with production responsibility for RAG pipelines and AI infrastructure.
  • Strong Python proficiency and production-grade code practices.
  • Experience with LLM integration, prompt engineering, and observability.

Responsibilities

  • Design, build, and maintain production RAG pipelines and embedding infrastructure.
  • Develop and monitor LLM integration, prompts, and feature observability.
  • Collaborate with Data Engineering & Platform to ensure governed data for AI workloads.

Skills

RAG pipelines
LLM integration
Python
Databricks
Vector search

Tools

Pinecone
Databricks Vector Search
pgvector
Chroma

Job description

Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications.

Work with the Northstar Lakehouse and Databricks stack, partnering with data engineers to maintain governance, data quality, and scalable AI infrastructure for the firm’s analytics needs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Data Engineer - RAG & LLM Infra
Senior AI Data Engineer - RAG & LLM Infra

Cooley AI • Los Angeles (CA)

On-site
USD 220,000 - 250,000
Medical insurance
Dental insurance
Vision insurance
+2
Senior AI Data Engineer - RAG & LLM Infra
Senior AI Data Engineer - RAG & LLM Infra

Cooley AI • New York (NY)

On-site
USD 220,000 - 250,000
Senior AI/LLM Engineer: Build Production-Ready RAG
Senior AI/LLM Engineer: Build Production-Ready RAG

Clear Point Consultants • United States

On-site
USD 140,000 - 200,000
Senior AI/ML Engineer for Production-Grade LLM AI Apps
Senior AI/ML Engineer for Production-Grade LLM AI Apps

MassGenics, Inc. • Jersey City (NJ)

On-site
USD 83,000 - 90,000
Medical & pharmacy coverage
Dental/vision insurance
401(k)
+5
Senior AI Engineer - LLM, RAG & Governance (Databricks)
Senior AI Engineer - LLM, RAG & Governance (Databricks)

Thinking Minds Inc. • Atlanta (GA)

On-site
USD 120,000 - 170,000
Senior AI Data Engineer
Senior AI Data Engineer

Cooley LLP • New York (NY)

On-site
USD 220,000 - 250,000
Senior AI/ML Engineer — Production LLM & RAG Expert
Senior AI/ML Engineer — Production LLM & RAG Expert

Innova Solutions Inc • Jersey City (NJ)

On-site
USD 83,000 - 90,000
Medical & pharmacy coverage
Dental/vision insurance
401(k)
+8
Senior AI Engineer - Production LLMs & RAG in FinTech
Senior AI Engineer - Production LLMs & RAG in FinTech

Imigrus • Plano (TX)

On-site
USD 140,000 - 180,000
Senior AI Engineer - LLM Orchestration & RAG
Senior AI Engineer - LLM Orchestration & RAG

BigBear • Maryland

On-site
USD 170,000 - 210,000
Senior AI Engineer: LLM Architecture & RAG Pipelines
Senior AI Engineer: LLM Architecture & RAG Pipelines

EPAM Systems • United States

Remote
USD 140,000 - 210,000