Senior Data Engineer — AI-Scale Systems (Remote, Contract)

Bespoke Labs; Colombia; A distancia; COP 387.341.000 - 602.531.000; Jornada completa

Descripción de la vacante

A leading AI research lab is seeking a Senior/Staff Data Engineer for a remote, 2-4 month contract. The role focuses on architecting and building complex curation systems for AI models. Candidates should have 6+ years of experience in data engineering with proven ownership in high-throughput data platforms. Skills in Python, Scala, Spark, and Kafka are essential. This position offers a hyper-competitive hourly rate and the opportunity to work on cutting-edge AI data systems.

Formación

• 6+ years of Data Engineering experience is required.
• Demonstrated Senior/Staff-level ownership of production data platforms.
• Fluency in Python/Scala, Spark, Kafka, Airflow needed.

Responsabilidades

• Architect AI-Scale Systems, designing data architecture at TB/PB scale.
• Write production-grade code in Python/Scala, Spark for handling data.
• Implement advanced data filtering, deduplication, and quality-scoring.

Conocimientos

Python

Scala

Spark

Kafka

Airflow

Herramientas

Apache Iceberg

Delta Lake

Hudi

Snowflake

BigQuery

Redshift

Descripción del empleo

A leading AI research lab is seeking a Senior/Staff Data Engineer for a remote, 2-4 month contract. The role focuses on architecting and building complex curation systems for AI models. Candidates should have 6+ years of experience in data engineering with proven ownership in high-throughput data platforms. Skills in Python, Scala, Spark, and Kafka are essential. This position offers a hyper-competitive hourly rate and the opportunity to work on cutting-edge AI data systems.