Senior AI Data Engineer - Production RAG & Vector Search

Huxley; United States; Hybrid; USD 150,000 - 250,000; Full time

Benefits offered by this job

Medical coverage

Paid leave

Job summary

Huxley is seeking a Senior AI Data Engineer to design and scale AI infrastructure, focusing on Production RAG systems, vector databases, and LLM integrations within a modern cloud data ecosystem.

In this senior IC role you will own end-to-end data pipelines, build scalable embedding workflows, and collaborate with application engineers to deliver AI-powered features with strong observability and governance.

Qualifications

• 5+ years in Data/AI Engineering or ML infrastructure.
• Hands-on with production RAG systems at scale.
• Strong Python development and cloud data skills.

Responsibilities

• Design, build, and maintain end-to-end RAG pipelines (ingestion, chunking, embeddings, vector indexing, retrieval).
• Develop vector search infrastructure for accurate contextual retrieval.
• Build scalable embedding pipelines for structured and unstructured data.
• Implement LLM-powered features: prompts, validation, latency, fallbacks, costs.
• Create observability for AI performance, retrieval quality, token usage, reliability.
• Collaborate with application engineers to embed AI in products.
• Maintain data pipelines supporting AI workloads with governance and security.
• Evaluate new AI tech and set production best practices.
• Contribute to architecture, standards, CI/CD, testing, operational excellence.

Skills

Data Engineering

AI Engineering

ML Infrastructure

Production RAG systems

LLM APIs

Python

Cloud data platforms

CI/CD

Agile

Tools

Pinecone

pgvector

Chroma

Databricks Vector Search

LangChain

Job description

Huxley is seeking a Senior AI Data Engineer to design and scale AI infrastructure, focusing on Production RAG systems, vector databases, and LLM integrations within a modern cloud data ecosystem.

In this senior IC role you will own end-to-end data pipelines, build scalable embedding workflows, and collaborate with application engineers to deliver AI-powered features with strong observability and governance.