Senior Data Engineer: AWS, Airflow & Data Platforms

Ten Lifestyle Group; Cape Town; Hybrid; ZAR 700,000 - 1,000,000; Full time

Benefits offered by this job

Hybrid work possibilities

Paid time off

Sabbatical after 5 years

Employee discounts on travel and娱乐

Job summary

Ten Lifestyle Group is seeking a Data Engineer to design, implement, and maintain a robust data foundation enabling analytics and product decisions. You will partner with Analysts, Engineering, and Client Services to translate business needs into scalable data solutions.

The role focuses on building end-to-end data infrastructure in AWS, establishing data quality, and delivering accessible data products to drive insights and strategic decisions in a hybrid Cape Town environment.

Qualifications

• 5+ years' experience building data pipelines using Python.
• Proven experience with AWS Lambda and ECS.
• Strong knowledge of Airflow for ETL/ELT data pipelines.
• Extensive SQL experience with data transformations and analytics workloads.
• Ability to work with batch and streaming data processing.

Responsibilities

• Establish and maintain data quality checks, validation processes, and governance standards.
• Build scalable pipelines that ingest, normalise, and transform data from multiple sources into a central data store.
• Develop clean, structured data models ready for analysis and reporting.
• Build APIs and data delivery mechanisms for fast, reliable access to analytics and dashboards.
• Partner with Data Analysts to ensure data is consumable for reporting and decision-making.
• Develop ingestion APIs and solutions for importing external/client data.
• Own and maintain Data Feeds with timely fixes and high reliability.
• Improve data accessibility, query performance and database efficiency.
• Collaborate with Engineering on best practices and architecture improvements.
• Model and analyse impact of roadmap items to support prioritisation.

Skills

SQL

Python

AWS (Lambda, ECS)

Airflow

Snowflake

MS SQL Server

PostgreSQL

GitHub

Jira

Education

Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or related field

Tools

Spark

Pandas

Job description

Ten Lifestyle Group is seeking a Data Engineer to design, implement, and maintain a robust data foundation enabling analytics and product decisions. You will partner with Analysts, Engineering, and Client Services to translate business needs into scalable data solutions.

The role focuses on building end-to-end data infrastructure in AWS, establishing data quality, and delivering accessible data products to drive insights and strategic decisions in a hybrid Cape Town environment.