Remote Senior Data Engineer - AI-Scale Data Platforms

Bespoke Labs; South Africa; Remote; ZAR 964,000 - 1,515,000; Full time

Job summary

A leading AI Research lab seeks a Senior Data Engineer for a contract role focusing on building complex data systems for AI model training. This position requires 6+ years of experience and expertise in Python, Scala, and Spark, as well as familiarity with high-throughput data processing. Ideal candidates will have a background in FAANG or Fortune 100 companies. The role is fully remote and offers an opportunity to work with cutting-edge technology in AI development.

Qualifications

• 6+ years of Data Engineering experience.
• Demonstrated Senior/Staff-level ownership of production data platforms.
• Experience with large Tier-1 enterprises (FAANG, large SaaS, Fortune 100).

Responsibilities

• Design and build data architecture required for advanced AI model training.
• Develop complex data processing and ingestion systems.
• Optimize data processing workloads for high throughput.

Skills

Data Engineering

Python

Scala

Spark

Kafka

Airflow

Tools

Apache Iceberg

Delta Lake

Hudi

Snowflake

BigQuery

Redshift

Job description

A leading AI Research lab seeks a Senior Data Engineer for a contract role focusing on building complex data systems for AI model training. This position requires 6+ years of experience and expertise in Python, Scala, and Spark, as well as familiarity with high-throughput data processing. Ideal candidates will have a background in FAANG or Fortune 100 companies. The role is fully remote and offers an opportunity to work with cutting-edge technology in AI development.