Associate

Cognizant; Sydney; On-site; AUD 80,000 - 90,000; Full time

Job summary

Cognizant is seeking an experienced Data Engineer to design and optimize large-scale data systems in Banking and Financial Services. You will leverage Spark, PySpark, Spark SQL, HDFS, ADLS2, and Azure Synapse to build scalable ingestion, transformation, and processing pipelines.

Strong SDLC, Agile/Waterfall, and mentoring experience are expected. The role emphasizes data governance, security best practices, and working with cross-functional stakeholders to deliver high-quality enterprise

Qualifications

• Experience delivering data engineering solutions for large-scale banking data.
• Strong SDLC experience with Agile/Waterfall methodologies.
• Proven ability to design and optimize data pipelines and workflows.

Responsibilities

• Collaborate with cross-functional teams to design scalable data pipelines.
• Develop and optimize data ingestion, transformation, and processing using Spark and HiveQL.
• Configure, schedule, and manage enterprise data workflows with Control-M.
• Mentor teammates and contribute to technical governance and documentation.

Skills

Apache Spark

PySpark

Spark SQL

HDFS

Azure Synapse Analytics

Azure Data Lake Storage

Databricks

Python

HiveQL

CI/CD

Education

DP-203 Data Engineering

Databricks Data Engineer

AI-related certifications (IBM/Azure)

Cognizant Certification – Prompt & Context Engineering

AI Security & Governance (Securiti)

Tools

Bitbucket

Jenkins

Git

BMC Control-M

ServiceNow

Job description

What makes Cognizant a unique place to work? The combination of rapid growth and an unique place international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.

At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.

Position Summary

Experienced Data Engineer with over 7+ years of expertise in designing, developing, and optimizing large-scale data engineering solutions within Banking and Financial Services domains. Proficient in Apache Spark, PySpark, SparkSQL, HDFS, Hive, ADLS2, Azure Synapse Analytics, Python, and HBase, with strong experience in building scalable data ingestion, transformation, and processing frameworks. Microsoft Certified DP-203: Azure Data Engineer Associate, demonstrating expertise in designing and implementing data integration, storage, processing, monitoring, and security solutions in Azure environments. Extensive experience working across complete Software Development Life Cycle (SDLC) phases using Agile and Waterfall methodologies. Skilled in performance tuning, troubleshooting, production support, root cause analysis, and delivering high-quality solutions in complex enterprise environments. Proven track record of leading technical initiatives, mentoring team members, driving successful production implementations, and collaborating with cross-functional stakeholders to deliver business-critical projects on time and with high quality. Recognized for strong analytical thinking, problem-solving capabilities, customer focus, and commitment to continuous learning and innovation.

Mandatory Skills

• Skills/Tools: Apache Spark, PySpark, Spark SQL, HDFS, ADLS2, Azure Synapse Analytics, ServiceNow, Enterprise Control-M, BT-Control-M.
• Cloud & Data Platforms: Azure Data Lake Storage (ADLS2), Azure Synapse Analytics, Databricks.
• Programming Languages: Python, HiveQL, Spark SQL.
• Databases: Hive, MySQL.
• Build & Deployment Tools: Bitbucket, Jenkins, CI/CD Pipeline Implementation.
• Job Scheduling Tools: BMC Control-M.
• Monitoring & Troubleshooting: Spark Logs Analysis, Root Cause Analysis, Production Support.
• ITSM Tools: ServiceNow.
• Security & Compliance: Data Governance, Security Best Practices, Change Management.
• Domain Expertise: Banking and Financial Services.

Roles And Responsibilities

• Collaborate with cross-functional teams to analyze, design, and implement scalable data engineering solutions.
• Design, develop, and optimize enterprise-grade data processing pipelines using PySpark and Spark SQL.
• Build and maintain scalable data ingestion, transformation, and aggregation frameworks leveraging Spark DataFrames, Hive, HDFS, and ADLS2.
• Perform Spark performance tuning and optimization to improve resource utilization and processing efficiency.
• Develop complex Spark SQL and HiveQL queries to support business-critical data processing requirements.
• Design and implement robust data transformation logic while adhering to coding standards and best practices.
• Investigate, troubleshoot, and resolve production issues through detailed log analysis and root cause identification.
• Drive operational excellence by implementing proactive monitoring and reliability improvements.
• Configure, schedule, and manage enterprise data workflows using BMC Control-M.
• Manage source code versioning and collaboration through Git and Bitbucket.
• Create, review, and implement Change Requests (CRQs) in accordance with organizational governance processes.
• Maintain comprehensive technical documentation, deployment procedures, and operational support artifacts.
• Support production releases and platform upgrade activities while ensuring service continuity.
• Mentor junior developers and provide technical guidance to team members.

Qualifications/Certifications

• DP-203 Data Engineering.( https://learn.microsoft.com/api/credentials/share/en-us/KirankumarM-6415/51F75659117B3D95?sharingId=2625DA67DB3FD434)
• Data Engineering with Databricks
• IBM Skill Badge – Artificial Intelligence
• Cognizant Certification – Prompt and Context Engineering
• AI Security & Governance by Securiti

Salary Range: 80k-90k

Date of Posting: 3/11/2026

Cognizant is committed to providing Equal Employment Opportunities.

Successful candidates will be required to undergo a background check.