Data Engineer LATAM: Scale Data Lakehouse & Pipelines

Onebeat; Ciudad de México; Presencial; MXN 450.000 - 750.000; Jornada completa

Descripción de la vacante

Onebeat is looking for an experienced Data Engineer to design, develop, and manage our open-source data platform, including a Data-Lakehouse, ETL processes, and Temporal workflows. You will join a collaborative team to build scalable solutions for analysts, scientists, and engineers.

The role focuses on batch data processing, data quality, governance, and security within a microservices environment and AWS cloud. Strong SQL and data modeling skills are essential.

Formación

• 3+ years of experience as a Data Engineer or in a similar data infrastructure role.
• Strong proficiency in SQL and on data modeling.
• Experience with data lake/lakehouse architectures (e.g., Apache Iceberg, S3).
• Experience with analytical/columnar databases (e.g., ClickHouse).
• Experience building and orchestrating ETL/ELT pipelines (Temporal, Airflow).
• Strong programming skills in Python and/or Scala/Java.
• Experience working within a microservices architecture and cloud environments (AWS preferred).
• Excellent communication skills and the ability to work both independently and collaboratively.

Responsabilidades

• Develop a scalable data platform integrating multiple sources for easy access.
• Design and enhance data tools (orchestration, governance, Data-Lakehouse, BI).
• Ensure smooth operation of data systems for analysts, scientists, and engineers.
• Optimize data pipelines (ingestion, processing, and output) in a microservices environment.
• Build, maintain, and monitor ETL/ELT processes and orchestrate workflows using Temporal.
• Troubleshoot and improve the performance, scalability, and reliability of the data infrastructure (S3, Apache Iceberg, ClickHouse).
• Collaborate cross-functionally with data scientists, analysts, and backend engineers to understand data needs and deliver solutions.
• Implement and champion data quality, governance, and security best practices across the platform.

Conocimientos

SQL

Data Modeling

Python

Scala/Java

ETL/ELT

Airflow

Temporal

Apache Spark

Data Lakehouse

AWS

Herramientas

Apache Iceberg

S3

ClickHouse

Temporal Workflow

Airflow

Spark

Kubernetes

CI/CD

Descripción del empleo

Onebeat is looking for an experienced Data Engineer to design, develop, and manage our open-source data platform, including a Data-Lakehouse, ETL processes, and Temporal workflows. You will join a collaborative team to build scalable solutions for analysts, scientists, and engineers.

The role focuses on batch data processing, data quality, governance, and security within a microservices environment and AWS cloud. Strong SQL and data modeling skills are essential.