Senior Data Engineer — AI-Scale Systems (Remote, Contract)

Bespoke Labs; Colombia; Remote; COP 387,341,000 - 602,531,000; Full time

Job summary

A leading AI research lab is seeking a Senior/Staff Data Engineer for a remote, 2-4 month contract. The role focuses on architecting and building complex curation systems for AI models. Candidates should have 6+ years of experience in data engineering with proven ownership in high-throughput data platforms. Skills in Python, Scala, Spark, and Kafka are essential. This position offers a hyper-competitive hourly rate and the opportunity to work on cutting-edge AI data systems.

Qualifications

• 6+ years of Data Engineering experience is required.
• Demonstrated Senior/Staff-level ownership of production data platforms.
• Fluency in Python/Scala, Spark, Kafka, Airflow needed.

Responsibilities

• Architect AI-Scale Systems, designing data architecture at TB/PB scale.
• Write production-grade code in Python/Scala, Spark for handling data.
• Implement advanced data filtering, deduplication, and quality-scoring.

Skills

Python

Scala

Spark

Kafka

Airflow

Tools

Apache Iceberg

Delta Lake

Hudi

Snowflake

BigQuery

Redshift

Job description

A leading AI research lab is seeking a Senior/Staff Data Engineer for a remote, 2-4 month contract. The role focuses on architecting and building complex curation systems for AI models. Candidates should have 6+ years of experience in data engineering with proven ownership in high-throughput data platforms. Skills in Python, Scala, Spark, and Kafka are essential. This position offers a hyper-competitive hourly rate and the opportunity to work on cutting-edge AI data systems.