AI Data Engineer: Scalable Pipelines, RAG & Vector AI

Quantum Technologies. LLC; Georgia; On-site; USD 120,000 - 180,000; Full time

Job summary

Quantum Technologies. LLC is seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure supporting AI/ML, RAG, and LLM applications.

The role requires strong SQL, Python/Scala, and cloud data platforms, with experience handling structured and unstructured data. The candidate will design ingestion and processing pipelines, build embedding workflows, implement data governance, and support ML lifecycle activities, including MLOps and LLMOps, while

Qualifications

• Strong SQL and Python/Scala.
• Apache Airflow / dbt.
• RAG, Vector Databases, Embeddings, and Vector Search.
• Unstructured Data Processing.
• ML Lifecycle Knowledge.

Responsibilities

• Design and develop data ingestion, transformation, and processing pipelines.
• Build embedding pipelines and integrate vector databases.
• Develop data pipelines supporting RAG, chunking, and vector search.
• Process structured and unstructured data (PDFs, documents, logs, transcripts).
• Implement data quality, governance, lineage, and access controls.
• Support ML model training, inference, MLOps, and LLMOps workflows.
• Optimize data pipelines for performance, scalability, and cost.

Skills

SQL

Python/Scala

Airflow

dbt

RAG

Vector Databases

Embeddings

Vector Search

Unstructured Data

ML Lifecycle

Tools

Apache Airflow

dbt

Job description

Quantum Technologies. LLC is seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure supporting AI/ML, RAG, and LLM applications.

The role requires strong SQL, Python/Scala, and cloud data platforms, with experience handling structured and unstructured data. The candidate will design ingestion and processing pipelines, build embedding workflows, implement data governance, and support ML lifecycle activities, including MLOps and LLMOps, while