Senior Data Engineer: Cloud-Native Pipelines on AWS

Tata Consultancy Services Limited; Sydney; On-site; AUD 130,000 - 180,000; Full time

Job summary

Tata Consultancy Services Limited in Sydney seeks an experienced Data Engineer to design, build and optimize scalable data pipelines across cloud platforms. You will work on Omnia-based processing, PySpark, SQL transformations, and leverage AWS services and Snowflake to enable reliable data delivery.

The role requires 8+ years in data engineering, with strong Python and SQL expertise, plus hands-on experience with Spark, dbt, Airflow and CI/CD practices.

Qualifications

• 8+ years of experience in data engineering or a related field.
• Strong hands-on experience designing, developing and supporting scalable data pipelines.
• Proficient with Spark, AWS services and modern cloud data platforms.

Responsibilities

• Design, develop and maintain scalable data pipelines using AWS, Snowflake and dbt.
• Translate business requirements into durable data rules and engineering solutions.
• Troubleshoot data pipeline issues and optimize performance across environments.

Skills

SQL

Python

Data pipelines

ETL design

Tools

Spark

AWS

Snowflake

dbt

Airflow

Git

Jenkins

Job description

Tata Consultancy Services Limited in Sydney seeks an experienced Data Engineer to design, build and optimize scalable data pipelines across cloud platforms. You will work on Omnia-based processing, PySpark, SQL transformations, and leverage AWS services and Snowflake to enable reliable data delivery.

The role requires 8+ years in data engineering, with strong Python and SQL expertise, plus hands-on experience with Spark, dbt, Airflow and CI/CD practices.