AI Data Engineer: ML Pipelines, Vector AI & RAG

Cloud Analytics Technologies, LLC; Phoenix (AZ); On-site; USD 83,000 - 117,000; Full time

Job summary

Cloud Analytics Technologies, LLC is seeking an AI Data Engineer in Phoenix, AZ to build and maintain data infrastructure powering AI/ML initiatives, including data pipelines for model training, retrieval-augmented generation (RAG), and production ML systems.

Role sits at the intersection of data engineering and applied AI, ensuring high-quality, governed data for analytics and AI consumption. Collaboration with ML engineers and data scientists is essential.

Qualifications

• Proficient in SQL and at least one of Python or Scala for data pipeline development.
• Experience with a cloud data platform.
• Experience with orchestration tools such as Airflow and dbt.
• Understanding of embedding models, vector search, and RAG patterns.
• Experience processing unstructured data.

Responsibilities

• Design and build pipelines to ingest, clean, and transform structured and unstructured data (documents, PDFs, transcripts, logs) for AI/ML use cases.
• Build and maintain vector embedding pipelines and support vector database integration.
• Develop feature stores/pipelines for ML model training and inference.
• Implement data pipelines supporting RAG architectures — chunking strategies, embedding refresh cycles, metadata tagging.
• Partner with ML engineers and data scientists to understand data requirements for model training and evaluation.
• Ensure data lineage, quality, and governance across pipelines feeding AI systems.
• Optimize pipelines for cost and performance (e.g., Dynamic Tables, streaming ingestion).
• Support MLOps/LLMOps workflows — versioning datasets, tracking data used in model training for reproducibility and compliance.
• Implement entitlement/access control logic so AI systems only access data they're authorized to use.

Skills

SQL

Python/Scala

Unstructured data processing

Embedding models & vector search

Tools

Airflow

dbt

Job description

Cloud Analytics Technologies, LLC is seeking an AI Data Engineer in Phoenix, AZ to build and maintain data infrastructure powering AI/ML initiatives, including data pipelines for model training, retrieval-augmented generation (RAG), and production ML systems.

Role sits at the intersection of data engineering and applied AI, ensuring high-quality, governed data for analytics and AI consumption. Collaboration with ML engineers and data scientists is essential.