Remote Data Engineer: Pipelines, Storage & Retrieval

Azumo; Colombia; Remote; COP 142,392,000 - 284,783,000; Full time

Benefits offered by this job

Paid time off (PTO)

U.S. Holidays

AI Training

Mentored career development

Profit sharing

$US remuneration

Job summary

Azumo is hiring a Data Engineer to own ingestion, transformation pipelines, storage design, and the retrieval infrastructure that AI systems query. The role is fully remote across Latin America, aligned to the client's working day and production data systems since 2016.

You will build batch and streaming pipelines using Spark, Kafka, dbt, and Airflow, design warehouse and lakehouse models (Snowflake/BigQuery/Redshift/Databricks), and implement robust data quality, governance, and cost controls.

Qualifications

• 5+ years building and operating production data pipelines with Python and SQL
• Experience designing data warehouses or lakehouses and cost/performance trade-offs
• Experience with distributed processing at production scale (Spark, Kafka, Flink)
• Orchestration with Airflow, Dagster or Prefect including retries and backfills
• Transformation under version control with dbt or equivalent
• Cloud deployment experience (Azure/AWS) with Docker and CI/CD

Responsibilities

• Own ingestion and transformation pipelines end-to-end
• Design and maintain storage and warehouse models
• Develop retrieval layer for RAG systems and embeddings
• Ensure data quality, lineage, and alerting
• Manage security, access controls and audit trails
• Deploy and monitor production pipelines in cloud environments
• Collaborate with clients and internal teams in LATAM time zones

Skills

Python

SQL

Data pipelines

Distributed processing

English proficiency

Education

Bachelor's degree in CS/DS or related field

Tools

Spark

Kafka

dbt

Airflow

Snowflake/BigQuery/Redshift/Databricks

Job description

Azumo is hiring a Data Engineer to own ingestion, transformation pipelines, storage design, and the retrieval infrastructure that AI systems query. The role is fully remote across Latin America, aligned to the client's working day and production data systems since 2016.

You will build batch and streaming pipelines using Spark, Kafka, dbt, and Airflow, design warehouse and lakehouse models (Snowflake/BigQuery/Redshift/Databricks), and implement robust data quality, governance, and cost controls.