Senior Data Engineer

CareCone Group; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

CareCone Group in Sydney seeks an experienced Senior Data Engineer to design, build, and support scalable data pipelines and curated datasets on AWS, working with analytics, data science, and business stakeholders.

The role focuses on batch and near real-time processing, transforming data with SQL, Python, PySpark, and Spark, and maintaining data quality and operational documentation in a large-scale enterprise environment.

Qualifications

• 8–10 years Data Engineer experience in enterprise environments.
• Advanced SQL with performance tuning and complex joins.
• Hands-on AWS data engineering across S3, Glue, Redshift, Athena, EMR, dbt.
• Strong Python with PySpark/Spark.
• Experience with Teradata and Siebel CRM datasets.
• Knowledge of data warehousing concepts: dimensional modelling, partitioning, incremental loads, CDC.
• Experience with Airflow for workflow orchestration.
• Strong communication with stakeholders to translate requirements into data deliverables.
• Telco industry experience is highly desirable.

Responsibilities

• Design, develop, and maintain batch and near real-time data pipelines on AWS.
• Build ETL/ELT workflows using AWS Glue, S3, Redshift, Athena, EMR, dbt, and Airflow.
• Ingest data from databases, APIs, files, and event streams into raw, cleansed, and curated layers.
• Develop transformation logic using SQL, Python, PySpark, and Spark.
• Implement data quality checks, reconciliation controls, monitoring, and alerting.
• Support DataOps and DevOps practices including version control, CI/CD, testing, releases, and production support.
• Maintain technical documentation including data flows, mappings, job schedules, runbooks, and operational procedures.

Skills

8–10 years Data Engineer experience

SQL proficiency

Python programming

Data architecture & pipelines

Stakeholder communication

Tools

AWS data services

dbt

Airflow

PySpark

Spark

Teradata

Siebel CRM

Job description

We are looking for an experienced Senior Data Engineer to join our team in Sydney. This is a hands-on role for someone who can design, build, and support scalable data pipelines and curated datasets on AWS while working across modern data engineering practices.

About the Role

The ideal candidate will bring strong SQL and Python capability, solid experience with AWS-native data services, and the ability to take ownership of complex data pipelines in a large-scale enterprise environment. You will work closely with analytics, data science, and business stakeholders to deliver reliable, high-quality data solutions.

What You’ll Be Doing

• Design, develop, and maintain batch and near real-time data pipelines on AWS.
• Build ETL/ELT workflows using AWS Glue, S3, Redshift, Athena, EMR, dbt, and Airflow.
• Ingest data from databases, APIs, files, and event streams into raw, cleansed, and curated layers.
• Develop transformation logic using SQL, Python, PySpark, and Spark.
• Implement data quality checks, reconciliation controls, monitoring, and alerting.
• Support DataOps and DevOps practices including version control, CI/CD, testing, releases, and production support.
• Maintain technical documentation including data flows, mappings, job schedules, runbooks, and operational procedures.

What We’re Looking For

• 8–10 years’ experience as a Data Engineer in enterprise-scale environments.
• Advanced SQL skills including query optimisation, complex joins, window functions, and performance tuning.
• Strong hands-on AWS data engineering experience across S3, Glue, Redshift, Athena, EMR, and dbt.
• Strong Python programming skills with PySpark and/or Spark experience.
• Experience with Teradata and Siebel CRM datasets.
• Good understanding of data warehousing concepts including dimensional modelling, partitioning, incremental loads, and CDC.
• Experience with workflow orchestration tools such as Airflow.
• Strong communication skills with the ability to work closely with stakeholders and translate requirements into data deliverables.
• Telco industry experience is highly desirable.