Senior AI Data Engineer - RAG & LLM Infra

Cooley AI

New York (NY)

Sur place

USD 220 000 - 250 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Cooley AI, the innovation arm of the leading technology law firm, seeks a Senior AI Data Engineer to build production AI infrastructure powering Northstar Lakehouse-based applications. You will own RAG pipelines, embedding strategies, and LLM integration, ensuring reliability and scale in a high-stakes data environment.

You will collaborate with the Data Engineering & Platform teams, implement observability, and advance AI feature maturity while adhering to governance and security standards

Qualifications

  • 5+ years of data engineering or AI engineering experience with hands-on production responsibility for RAG pipelines, LLM integration, or AI-powered data infrastructure

Responsabilités

  • Design, build, and maintain production RAG pipelines that ingest, process, chunk, embed, and index firm data assets for retrieval by AI-powered legal intelligence applications.
  • Own the vector search implementation including index design, embedding model selection and maintenance, retrieval strategy configuration, and ongoing retrieval quality assessment.
  • Build and maintain embedding pipelines that transform structured and unstructured firm data assets into vector representations used by retrieval systems and LLM-powered features.
  • Monitor and maintain retrieval quality in production, surface degradation early, and collaborate with governance controls.
  • Build and maintain the LLM integration layer for Data Applications squad products with prompt engineering, validation, latency management, and cost-aware API usage.
  • Implement AI feature observability tooling for LLM response quality, retrieval relevance, and latency patterns.
  • Apply responsible AI practices aligned with firm governance and ongoing AI landscape awareness.
  • Collaborate with Senior Data Application Engineer and other squad functions to ensure integration across application and intelligence layers.

Connaissances

Data engineering
AI engineering
RAG pipelines
LLM integration
Python proficiency
Databricks
Vector search
CI/CD
Agile delivery

Outils

Databricks Delta Lake
Unity Catalog
Databricks SQL
Databricks Appkit
Databricks Vector Search
Pinecone

Description du poste

Cooley AI, the innovation arm of the leading technology law firm, seeks a Senior AI Data Engineer to build production AI infrastructure powering Northstar Lakehouse-based applications. You will own RAG pipelines, embedding strategies, and LLM integration, ensuring reliability and scale in a high-stakes data environment.

You will collaborate with the Data Engineering & Platform teams, implement observability, and advance AI feature maturity while adhering to governance and security standards

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior AI Data Engineer - RAG & LLM Infra
Senior AI Data Engineer - RAG & LLM Infra

Cooley AI • Los Angeles (CA)

Sur place
USD 220 000 - 250 000
Medical insurance
Dental insurance
Vision insurance
+2
Senior AI Data Engineer: RAG & LLM Production Architect
Senior AI Data Engineer: RAG & LLM Production Architect

Cooley LLP • New York (NY)

Sur place
USD 220 000 - 250 000
Senior AI/LLM Engineer: Build Production-Ready RAG
Senior AI/LLM Engineer: Build Production-Ready RAG

Clear Point Consultants • États-Unis

Sur place
USD 140 000 - 200 000
Senior AI Engineer - LLM Orchestration & RAG
Senior AI Engineer - LLM Orchestration & RAG

BigBear • Maryland

Sur place
USD 170 000 - 210 000
Senior AI Engineer: LLM Architecture & RAG Pipelines
Senior AI Engineer: LLM Architecture & RAG Pipelines

EPAM Systems • États-Unis

À distance
USD 140 000 - 210 000
Senior AI Platform Architect - RAG, LLM & Microservices
Senior AI Platform Architect - RAG, LLM & Microservices

GE Vernova, Inc. • Cambridge (MA)

Sur place
USD 128 000 - 213 000
Healthcare benefits
Relocation assistance
401(k) with company match
Senior AI/ML Engineer: LLMs, RAG & Production AI
Senior AI/ML Engineer: LLMs, RAG & Production AI

Triunity Software, Inc. • Addison (TX)

Sur place
USD 150 000 - 230 000
Bonus based on performance
Health insurance
Training & development
Senior AI/ML Engineer — Production LLM & RAG Expert
Senior AI/ML Engineer — Production LLM & RAG Expert

Innova Solutions Inc • Jersey City (NJ)

Sur place
USD 83 000 - 90 000
Medical & pharmacy coverage
Dental/vision insurance
401(k)
+8
Senior AI Data Engineer (RAG / Retrieval / Python)
Senior AI Data Engineer (RAG / Retrieval / Python)

Insoftex • États-Unis

À distance
USD 120 000 - 180 000
Senior AI/ML Engineer - Production LLM & RAG Solutions
Senior AI/ML Engineer - Production LLM & RAG Solutions

Overnox • États-Unis

À distance
USD 150 000 - 220 000