Azure Data Engineer: Scale Data Pipelines & Big Data

Cognizant; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Cognizant is seeking an experienced Azure Data Engineer with strong hands-on expertise in PySpark, Azure Synapse Analytics, SQL, and Big Data technologies. You will design, develop, optimize, and support scalable data pipelines and analytics solutions across Microsoft Azure and Big Data platforms.

Responsibilities include building ETL/ELT workflows, supporting Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, and related services, and ensuring data governance and production support.

Qualifications

• 3+ years of practical experience with Azure Synapse Analytics and Azure cloud data services.
• Hands-on experience in PySpark, Spark SQL, Python and SQL for data pipeline development.
• Experience with Big Data tools such as Spark, Hadoop, Hive, Kafka, Sqoop, HBase.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Azure Synapse Analytics.
• Build and optimize ETL/ELT workflows for large-volume data.
• Develop and support Azure Synapse pipelines, notebooks, SQL scripts, and data transformation logic.
• Collaborate with architects, analysts, QA, DevOps and client stakeholders to deliver robust data solutions.

Skills

PySpark

Azure Synapse Analytics

Python

Tools

Spark SQL

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

SQL

Hadoop

Job description

Cognizant is seeking an experienced Azure Data Engineer with strong hands-on expertise in PySpark, Azure Synapse Analytics, SQL, and Big Data technologies. You will design, develop, optimize, and support scalable data pipelines and analytics solutions across Microsoft Azure and Big Data platforms.

Responsibilities include building ETL/ELT workflows, supporting Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, and related services, and ensuring data governance and production support.