Senior Data Engineer, Azure Spark & Big Data

Cognizant; Sydney; On-site; AUD 80,000 - 90,000; Full time

Job summary

Cognizant is seeking an experienced Data Engineer to design and optimize large-scale data systems in Banking and Financial Services. You will leverage Spark, PySpark, Spark SQL, HDFS, ADLS2, and Azure Synapse to build scalable ingestion, transformation, and processing pipelines.

Strong SDLC, Agile/Waterfall, and mentoring experience are expected. The role emphasizes data governance, security best practices, and working with cross-functional stakeholders to deliver high-quality enterprise

Qualifications

• Experience delivering data engineering solutions for large-scale banking data.
• Strong SDLC experience with Agile/Waterfall methodologies.
• Proven ability to design and optimize data pipelines and workflows.

Responsibilities

• Collaborate with cross-functional teams to design scalable data pipelines.
• Develop and optimize data ingestion, transformation, and processing using Spark and HiveQL.
• Configure, schedule, and manage enterprise data workflows with Control-M.
• Mentor teammates and contribute to technical governance and documentation.

Skills

Apache Spark

PySpark

Spark SQL

HDFS

Azure Synapse Analytics

Azure Data Lake Storage

Databricks

Python

HiveQL

CI/CD

Education

DP-203 Data Engineering

Databricks Data Engineer

AI-related certifications (IBM/Azure)

Cognizant Certification – Prompt & Context Engineering

AI Security & Governance (Securiti)

Tools

Bitbucket

Jenkins

Git

BMC Control-M

ServiceNow

Job description

Cognizant is seeking an experienced Data Engineer to design and optimize large-scale data systems in Banking and Financial Services. You will leverage Spark, PySpark, Spark SQL, HDFS, ADLS2, and Azure Synapse to build scalable ingestion, transformation, and processing pipelines.

Strong SDLC, Agile/Waterfall, and mentoring experience are expected. The role emphasizes data governance, security best practices, and working with cross-functional stakeholders to deliver high-quality enterprise