Senior Data Engineer - Cloud, AWS & Spark | Sydney

Tata Consultancy Services Limited; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

Tata Consultancy Services Australia is seeking a Senior Data Engineer to join our Sydney team. You will design, build and operate cloud‑native data platforms, partnering with stakeholders to enable data‑driven decisions and sustainable, scalable data services.

The role focuses on SQL, Python, AWS (S3/Glue/EMR/Athena), ETL/ELT pipelines, data modeling and Spark/PySpark, plus CDC, data governance and CI/CD (GitHub Actions). Kafka, Terraform, Snowflake and DBT are considered advantageous.

Qualifications

• 8+ years of experience in data engineering or related field.
• Strong SQL, Python and AWS (S3, Glue, EMR, Athena) skills.
• Hands-on experience with ETL/ELT pipelines and data modeling.
• Proficient in Spark/PySpark and data governance practices.
• Experience with CDC, CI/CD (GitHub Actions), monitoring and operational databases.
• Exposure to Kafka/MSK, Terraform and event-driven architectures is desirable.
• Strong problem-solving, stakeholder engagement and Agile delivery skills.
• Snowflake and DBT are a plus.

Responsibilities

• Design, build and operate cloud-native data platforms.
• Develop and maintain ETL/ELT pipelines and data models.
• Collaborate with stakeholders to enable data-driven decisions.
• Ensure data quality, governance and efficient CI/CD processes.
• Work with Spark/PySpark, Snowflake and DBT where applicable.

Skills

SQL

Python

AWS

ETL/ELT

data modeling

Spark/PySpark

CDC

data governance

CI/CD

GitHub Actions

monitoring

operational databases

Kafka/MSK

Terraform

event-driven architectures

Agile delivery

Snowflake

DBT

Tools

Kafka/MSK

Terraform

Snowflake

DBT

Job description

Tata Consultancy Services Australia is seeking a Senior Data Engineer to join our Sydney team. You will design, build and operate cloud‑native data platforms, partnering with stakeholders to enable data‑driven decisions and sustainable, scalable data services.

The role focuses on SQL, Python, AWS (S3/Glue/EMR/Athena), ETL/ELT pipelines, data modeling and Spark/PySpark, plus CDC, data governance and CI/CD (GitHub Actions). Kafka, Terraform, Snowflake and DBT are considered advantageous.