Associate

Cognizant Technology Solutions Corporation; Sydney; On-site; AUD 80,000 - 90,000; Full time

Job summary

Cognizant Technology Solutions Corporation is seeking an Experienced Data Engineer with 7+ years in designing and optimizing large-scale data platforms for Banking and Financial Services. Proficiency in Spark, PySpark, Spark SQL, HDFS, ADLS2, Azure Synapse, Python, Hive, and DBMSs, plus DP-203 certification, is required.

Collaboration across SDLC via Agile/Waterfall is expected. The role involves building scalable pipelines, tuning performance, and leading critical data initiatives with

Qualifications

• 7+ years of experience in designing, developing, and optimizing large-scale data engineering solutions.

Responsibilities

• Collaborate with cross-functional teams to analyze, design, and implement scalable data engineering solutions.
• Design, develop, and optimize enterprise-grade data processing pipelines using PySpark and Spark SQL.
• Build and maintain scalable data ingestion, transformation, and aggregation frameworks leveraging Spark DataFrames, Hive, HDFS, and ADLS2.
• Perform Spark performance tuning and optimization to improve resource utilization and processing efficiency.
• Develop complex Spark SQL and HiveQL queries to support business-critical data processing requirements.
• Design and implement robust data transformation logic while adhering to coding standards and best practices.
• Investigate, troubleshoot, and resolve production issues through detailed log analysis and root cause identification.
• Drive operational excellence by implementing proactive monitoring and reliability improvements.
• Configure, schedule, and manage enterprise data workflows using BMC Control-M.
• Manage source code versioning and collaboration through Git and Bitbucket.
• Create, review, and implement Change Requests (CRQs) in accordance with organizational governance processes.
• Maintain comprehensive technical documentation, deployment procedures, and operational support artifacts.
• Support production releases and platform upgrade activities while ensuring service continuity.
• Mentor junior developers and provide technical guidance to team members.

Skills

Apache Spark

PySpark

Spark SQL

HDFS

ADLS2

Azure Synapse Analytics

ServiceNow

Control-M

Bitbucket

Jenkins

CI/CD Pipeline

Education

DP-203 Data Engineer

Databricks

AI Security & Governance

Tools

Git

Bitbucket

Jenkins

CI/CD

Job description

What makes Cognizant a unique place to work? The combination of rapid growth and an unique place international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.

At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.

Position Summary

Experienced Data Engineer with over 7+ years of expertise in designing, developing, and optimizing large-scale data engineering solutions within Banking and Financial Services domains. Proficient in Apache Spark, PySpark, SparkSQL, HDFS, Hive, ADLS2, Azure Synapse Analytics, Python, and HBase, with strong experience in building scalable data ingestion, transformation, and processing frameworks. Microsoft Certified DP-203: Azure Data Engineer Associate, demonstrating expertise in designing and implementing data integration, storage, processing, monitoring, and security solutions in Azure environments. Extensive experience working across complete Software Development Life Cycle (SDLC) phases using Agile and Waterfall methodologies. Skilled in performance tuning, troubleshooting, production support, root cause analysis, and delivering high-quality solutions in complex enterprise environments. Proven track record of leading technical initiatives, mentoring team members, driving successful production implementations, and collaborating with cross-functional stakeholders to deliver business-critical projects on time and with high quality. Recognized for strong analytical thinking, problem-solving capabilities, customer focus, and commitment to continuous learning and innovation.

Mandatory Skills

1. Skills/Tools:Apache Spark, PySpark, Spark SQL, HDFS, ADLS2, Azure Synapse Analytics, ServiceNow, Enterprise Control-M, BT-Control-M.
2. Cloud & Data Platforms: Azure Data Lake Storage (ADLS2), Azure Synapse Analytics, Databricks.
3. Programming Languages: Python, HiveQL, Spark SQL.
4. Databases: Hive, MySQL.
5. Build & Deployment Tools: Bitbucket, Jenkins, CI/CD Pipeline Implementation.
6. Job Scheduling Tools: BMC Control-M.
7. Monitoring & Troubleshooting: Spark Logs Analysis, Root Cause Analysis, Production Support.
8. ITSM Tools: ServiceNow.
9. Security & Compliance: Data Governance, Security Best Practices, Change Management.
10. Domain Expertise: Banking and Financial Services.

Roles And Responsibilities

1. Collaborate with cross-functional teams to analyze, design, and implement scalable data engineering solutions.
2. Design, develop, and optimize enterprise-grade data processing pipelines using PySpark and Spark SQL.
3. Build and maintain scalable data ingestion, transformation, and aggregation frameworks leveraging Spark DataFrames, Hive, HDFS, and ADLS2.
4. Perform Spark performance tuning and optimization to improve resource utilization and processing efficiency.
5. Develop complex Spark SQL and HiveQL queries to support business-critical data processing requirements.
6. Design and implement robust data transformation logic while adhering to coding standards and best practices.
7. Investigate, troubleshoot, and resolve production issues through detailed log analysis and root cause identification.
8. Drive operational excellence by implementing proactive monitoring and reliability improvements.
9. Configure, schedule, and manage enterprise data workflows using BMC Control-M.
10. Manage source code versioning and collaboration through Git and Bitbucket.
11. Create, review, and implement Change Requests (CRQs) in accordance with organizational governance processes.
12. Maintain comprehensive technical documentation, deployment procedures, and operational support artifacts.
13. Support production releases and platform upgrade activities while ensuring service continuity.
14. Mentor junior developers and provide technical guidance to team members.

Qualifications/Certifications

1. DP-203 Data Engineering.(https://learn.microsoft.com/api/credentials/share/en-us/KirankumarM-6415/51F75659117B3D95?sharingId=2625DA67DB3FD434)
2. Data Engineering with Databricks
3. IBM Skill Badge – Artificial Intelligence
4. Cognizant Certification – Prompt and Context Engineering
5. AI Security & Governance by Securiti

Salary Range: 80k-90k

Date of Posting: 3/11/2026

For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.