AI Data Engineer: Build Scalable LLM Pipelines

Ethereum Technologies; Scottsdale (AZ); On-site; USD 140,000 - 190,000; Full time

Job summary

Ethereum Technologies is seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure to support AI/ML, RAG, and LLM applications. The role requires strong SQL, Python/Scala, and cloud data platform skills.

You will design ingestion pipelines, build embedding workflows, and ensure data quality, governance, and ML lifecycle support across production systems.

Qualifications

• Strong SQL and Python/Scala experience.
• Experience with Apache Airflow and dbt.
• Knowledge of RAG, vector databases, embeddings and vector search.
• Proficient in processing unstructured data.
• Understanding of ML lifecycle and MLOps workflows.

Responsibilities

• Design and develop data ingestion, transformation, and processing pipelines.
• Build embedding pipelines and integrate vector databases.
• Develop data pipelines for RAG, chunking and vector search.
• Process structured and unstructured data (PDFs, documents, logs, transcripts).
• Implement data quality, governance, lineage, and access controls.
• Support ML model training, inference, MLOps, and LLMOps workflows.
• Optimize data pipelines for performance, scalability and cost.

Skills

SQL

Python/Scala

Apache Airflow

dbt

RAG

Vector Databases

Embeddings

Vector Search

Unstructured Data Processing

ML Lifecycle Knowledge

Job description

Ethereum Technologies is seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure to support AI/ML, RAG, and LLM applications. The role requires strong SQL, Python/Scala, and cloud data platform skills.

You will design ingestion pipelines, build embedding workflows, and ensure data quality, governance, and ML lifecycle support across production systems.