Remote Data Engineer — AI Pipelines & Retrieval

Azumo; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

PTO

US Holidays

Profit sharing

Remote across LATAM

Job summary

Azumo is a San Francisco-based company building production AI systems. We are hiring a Data Engineer to own ingestion, transformation pipelines, storage design, and the retrieval layer for AI applications. This fully remote role is aligned to US time zones and works across LATAM.

You will build batch and streaming pipelines using Spark, Kafka, dbt and Airflow, design scalable warehouses, and ensure data quality and security in production environments for client projects.

Qualifications

• 5+ years building and operating production data pipelines with Python and SQL.
• Experience designing data warehouses or lakehouses with dimensional modeling.
• Distributed processing at scale with Spark, Kafka, Flink or equivalent.
• Orchestration with Airflow, Dagster or Prefect, with retries and backfill strategy.
• Transformation under version control with dbt or equivalent.
• Cloud deployment experience (Azure preferred, AWS acceptable) with Docker & CI/CD.
• Cost, runtime and throughput management for pipelines.
• Experience using AI-assisted coding tools in real delivery work.
• Clear written and spoken English (C1+).
• Bachelor's degree or equivalent professional experience.

Responsibilities

• Ingestion and transformation pipelines for batch and streaming data.
• Storage and modeling: warehouse and lakehouse design.
• Retrieval layer: embedding and indexing pipelines for RAG systems.
• Data quality: tests, lineage and alerting across pipelines.
• PII classification, masking and access controls, audit trails.
• Production operation: containerized deployment, CI/CD, observability.
• Work inside client environments with SOC 2/HIPAA considerations when required.

Skills

Python

SQL

English proficiency

CI/CD familiarity

Education

Bachelor's degree in Computer Science, Data Science, or related field

Tools

Spark

Kafka

dbt

Airflow

Terraform

Azure

AWS

Docker

Git

Job description

Azumo is a San Francisco-based company building production AI systems. We are hiring a Data Engineer to own ingestion, transformation pipelines, storage design, and the retrieval layer for AI applications. This fully remote role is aligned to US time zones and works across LATAM.

You will build batch and streaming pipelines using Spark, Kafka, dbt and Airflow, design scalable warehouses, and ensure data quality and security in production environments for client projects.