Data Ingestion Architect for Global Platforms

Kpler; Norte; Presencial; COP 130.788.000 - 202.410.000; Jornada completa

Descripción de la vacante

Kpler is seeking a Data Engineer II to own end-to-end data ingestion for core analytics platforms. You will build and maintain scalable pipelines from sources like Kafka, S3, and Iceberg, partnering with engineering, cloud, and client teams to ensure reliable data flows across Snowflake and ClickHouse.

You'll work with Java and Python, emphasize observability, and contribute to platform standards and developer experience within a global product ecosystem.

Formación

• 3+ years building, operating production data ingestion pipelines (batch/streaming).
• Strong Java and Python with SQL and data modeling fundamentals.
• Ownership of production cloud services including monitoring and CI/CD workflows.

Responsabilidades

• Architect and maintain data ingestion pipelines from Kafka, S3, Iceberg using Java/Python and Airflow.
• Drive reliability: monitoring, alerts, reduce failure modes, on-call readiness.

Conocimientos

Data ingestion

Java

Python

SQL

DevOps

Communication

Herramientas

Kafka

S3

Iceberg

Airflow

Snowflake

ClickHouse

Kubernetes

Descripción del empleo

Kpler is seeking a Data Engineer II to own end-to-end data ingestion for core analytics platforms. You will build and maintain scalable pipelines from sources like Kafka, S3, and Iceberg, partnering with engineering, cloud, and client teams to ensure reliable data flows across Snowflake and ClickHouse.

You'll work with Java and Python, emphasize observability, and contribute to platform standards and developer experience within a global product ecosystem.