Senior Data & AI Engineer: Build AI-Ready Pipelines & RAG

Carlyle; Washington (District of Columbia); Hybrid; USD 160,000 - 180,000; Full time

Benefits offered by this job

Retirement benefits

Health insurance

Life and disability insurance

Paid time off

Paid holidays

Family planning benefits

Wellness programs

Annual discretionary incentive program

Job summary

Carlyle seeks a senior Data & AI Engineer to turn the firm’s data and AI architecture into production systems. You will build AI-ready pipelines, semantic layers, and retrieval systems powering analytics, automation, and LLM agents across the business.

Reporting to the Senior AI & Data Architect, you’ll implement RAG patterns and partner with data science, governance, and domain teams to deliver trusted data at enterprise scale.

Qualifications

• 6+ years of technical experience
• Hands-on experience building generative AI in production
• Experience with retrieval, grounding, and semantic components for LLM/agent apps
• Strong Python and SQL, knowledge of Spark
• Experience with dbt, Fivetran, Snowflake in AWS environments

Responsibilities

• Build and operate AI-ready data pipelines with embedding generation, indexing, and refresh workflows
• Implement RAG components including vector stores, hybrid search and grounding logic
• Design and maintain production ELT, streaming, and transformation pipelines
• Implement semantic models and data contracts for trusted self-service analytics
• Ensure data quality, observability, and AI trust with governance alignment
• Collaborate with architects, data scientists, and domain teams; mentor junior engineers

Skills

Python

SQL

AI engineering

RAG

Education

Bachelor’s degree in computer science or related field

Tools

AWS Bedrock

Databricks ML

Snowflake Cortex

OpenAI APIs

LangChain

LlamaIndex

MLflow

Vector databases

Job description

Carlyle seeks a senior Data & AI Engineer to turn the firm’s data and AI architecture into production systems. You will build AI-ready pipelines, semantic layers, and retrieval systems powering analytics, automation, and LLM agents across the business.

Reporting to the Senior AI & Data Architect, you’ll implement RAG patterns and partner with data science, governance, and domain teams to deliver trusted data at enterprise scale.