Senior Data & AI Engineer — RAG, LLMs, Data Platforms

Carlyle; Washington (District of Columbia); On-site; USD 160,000 - 180,000; Full time

Job summary

Carlyle is seeking a Data & AI Engineer in Washington, DC (or NYC) to design and operate AI-ready data pipelines, semantic models, and RAG components that power enterprise analytics and AI applications. This senior IC role emphasizes production-grade engineering, guardrails, and collaboration with data science teams.

In this role you will build ELT and streaming pipelines, implement vector stores, and contribute to reusable data products while adhering to enterprise standards and governance.

Qualifications

• 6+ years of relevant technical experience.
• Experience building generative AI or AI/ML systems in production.
• Experience implementing retrieval, grounding, and semantic components for AI apps.
• Hands-on experience with AI platforms and tooling (AWS Bedrock, OpenAI, etc.).
• Strong Python and SQL, and knowledge of dbt, Fivetran, Snowflake.
• Experience operating in federated data operating models in regulated environments.

Responsibilities

• Build and operate AI-ready data pipelines, embedding generation, chunking, indexing, and refresh workflows for LLMs, agents, and AI apps.
• Implement retrieval-augmented generation components, including vector stores, hybrid search, re-ranking, and grounding logic.
• Develop interfaces for agents to query and act on enterprise data with guardrails and observability.
• Collaborate with Data Science and AI Engineering to operationalize feature stores and evaluation datasets.
• Advance semantic models and data contracts to enable trusted self-service analytics.

Skills

Python

SQL

RAG patterns

LLM tooling

Education

Bachelor’s degree in computer science or related field

Master’s degree preferred

Tools

dbt

Fivetran

Snowflake

Databricks ML

LangChain

LlamaIndex

OpenAI API

Job description

Carlyle is seeking a Data & AI Engineer in Washington, DC (or NYC) to design and operate AI-ready data pipelines, semantic models, and RAG components that power enterprise analytics and AI applications. This senior IC role emphasizes production-grade engineering, guardrails, and collaboration with data science teams.

In this role you will build ELT and streaming pipelines, implement vector stores, and contribute to reusable data products while adhering to enterprise standards and governance.