Data Engineer - Lakehouse & ETL Automation (LATAM)

Onebeat; Bogotá ciudad; Presencial; COP 133.920.000 - 178.560.000; Jornada completa

Descripción de la vacante

Onebeat is seeking an experienced Data Engineer to design, develop, and maintain a scalable data platform, including a Data-Lakehouse, ETL processes, and Temporal workflows. You’ll collaborate with data scientists, analysts, and engineers to deliver reliable data solutions and governance across the stack.

The role emphasizes batch data processing with strong SQL, Python/Scala/Java coding, and cloud experience (AWS). Excellent communication and teamwork are essential for success.

Formación

• 3+ years of experience as a Data Engineer or in a similar data infrastructure role.
• Strong proficiency in SQL and data modeling.
• Experience with data lake/lakehouse architectures (e.g., Apache Iceberg, S3, or similar).
• Experience with analytical/columnar databases (e.g., ClickHouse).
• Experience building and orchestrating ETL/ELT pipelines (Temporal, Airflow, or similar).
• Strong programming skills in Python and/or Scala/Java.
• Experience working within a microservices architecture and cloud environments (AWS preferred).
• Self-motivated, multitasking, and team-oriented.
• Hands-on experience with Apache Spark.
• Proficient in written and spoken English.
• Note: focus on batch data processing; not real-time streaming.

Responsabilidades

• Develop a scalable data platform integrating multiple sources for easy access.
• Design and enhance data tools (orchestration, governance, Data-Lakehouse, BI).
• Ensure smooth operation of data systems for analysts, scientists, and engineers.
• Optimize data pipelines (ingestion, processing, output) in a microservices environment.
• Build, maintain, and monitor ETL/ELT processes and orchestrate workflows using Temporal.
• Troubleshoot and improve performance, scalability, and reliability of data infra (S3, Iceberg, ClickHouse).
• Collaborate cross-functionally with data scientists, analysts, and backend engineers.
• Implement and champion data quality, governance, and security best practices across the platform.

Conocimientos

SQL

Data modeling

Python

Scala/Java

Temporal

AWS

Batch processing

English

Git

Team player

Herramientas

Apache Spark

Apache Iceberg

ClickHouse

Data Lakehouse

Temporal Workflow

Descripción del empleo

Onebeat is seeking an experienced Data Engineer to design, develop, and maintain a scalable data platform, including a Data-Lakehouse, ETL processes, and Temporal workflows. You’ll collaborate with data scientists, analysts, and engineers to deliver reliable data solutions and governance across the stack.

The role emphasizes batch data processing with strong SQL, Python/Scala/Java coding, and cloud experience (AWS). Excellent communication and teamwork are essential for success.