Cloud Data Engineer

Cognizant; Sydney; Presencial; AUD 90.000 - 100.000; Jornada completa

Descripción de la vacante

Cognizant Technology Solutions Corporation in Australia seeks a results-driven Data Engineer to design, build, and optimize scalable data pipelines across cloud and distributed systems.

You will apply Python, PySpark, and SQL for ingestion, transformation, and analytics, collaborate with cross-functional teams, and contribute to data quality, governance, and cost efficiency across diverse banking and corporate data sources.

Formación

• Databricks Certified Data Engineer Associate.
• SQL (Advance) - HackerRank.
• Python (Basic) – HackerRank.

Responsabilidades

• Build and maintain scalable data pipelines using cloud services for ingestion, transformation, and storage.
• Develop data products that integrate customer data from multiple sources into unified profiles.
• Create metadata-driven frameworks to ensure data quality, consistency, and governance.
• Write Pyspark, and Spark SQL scripts to perform complex data transformations, ensuring data pipelines are efficient, scalable, and optimized for analytics and reporting.
• Support ETL processes by fixing errors, improving resiliency, and ensuring data integrity across reports and dashboards.
• Monitor data platforms, respond to alerts, and optimize pipelines for efficiency and cost reduction.
• Perform root cause analysis (RCA) for job failures and ensure stability after releases.
• Collaborate with onsite and offshore teams to coordinate tasks, align processes, and deliver projects smoothly.
• Participate in design reviews, implementation walkthroughs, and production deployments.
• Apply governance best practices to maintain security, lineage, and compliance with organizational and regulatory standards.
• Work closely with stakeholders and architects to capture requirements and deliver reliable solutions.
• Use Atlassian tools (Jira, Confluence, Bitbucket) for project management, documentation, and collaboration.
• Lead projects through effective planning, prioritization, and team coordination to ensure successful delivery.

Conocimientos

PySpark

Spark SQL

SAS

Databricks

Java

Python

Power BI

QlikView

Automation

Web scraping

IBM Sterling

Educación

Databricks Certified Data Engineer Associate

SQL Advanced

Python Basics

Herramientas

Hive

Oracle

SSMS

Azure

Databricks

AWS

Bitbucket

GitHub

Jenkins

Control-M

DataBricks Workflows

Spark Logs

Descripción del empleo

What makes Cognizant a unique place to work? The combination of rapid growth and an unique place international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.

At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.

Position Summary

Results-driven Data Engineer with expertise in designing, building, and optimizing scalable data pipelines across cloud and distributed systems. Skilled in Python, PySpark, and SQL for data ingestion, transformation, and integration, with a strong focus on improving efficiency, reducing costs, and ensuring data quality. Experienced in metadata-driven frameworks, ETL process enhancements, and governance practices to deliver clean, reliable data for analytics and reporting. Adept at collaborating with cross-functional teams, monitoring platform performance, and making continuous improvements to support business growth and decision-making.

Mandatory Skills

• Skills/Tools: Py-spark, Spark SQL, SAS, Databricks, Java, Python, Power Bi, Qlikview, Automation (RPA), web-scraping, IBM Sterling

• Database: Hive, Oracle, SSMS, etc

• Cloud Platform: Azure services, Databricks, AWS

• Language: Python, Java

• Ci/CD Tools: Bitbucket, Github and Jenkins

• Job Scheduler: Control-M, DataBricks workflows

• Monitoring and Logging: Skills in using monitoring tools and analysing the root cause using Spark Logs

• Security and Compliance: Understanding of security best practices and compliance requirements

• Business Domain Knowledge: Banking: Basel 4, Regulatory Reporting

Roles And Responsibilities

• Build and maintain scalable data pipelines using cloud services for ingestion, transformation, and storage.

• Develop data products that integrate customer data from multiple sources into unified profiles.

• Create metadata-driven frameworks to ensure data quality, consistency, and governance.

• Write Pyspark, and Spark SQL scripts to perform complex data transformations, ensuring data pipelines are efficient, scalable, and optimized for analytics and reporting.

• Support ETL processes by fixing errors, improving resiliency, and ensuring data integrity across reports and dashboards.

• Monitor data platforms, respond to alerts, and optimize pipelines for efficiency and cost reduction.

• Perform root cause analysis (RCA) for job failures and ensure stability after releases.

• Collaborate with onsite and offshore teams to coordinate tasks, align processes, and deliver projects smoothly.

• Participate in design reviews, implementation walkthroughs, and production deployments.

• Apply governance best practices to maintain security, lineage, and compliance with organizational and regulatory standards.

• Work closely with stakeholders and architects to capture requirements and deliver reliable solutions.

• Use Atlassian tools (Jira, Confluence, Bitbucket) for project management, documentation, and collaboration.

• Lead projects through effective planning, prioritization, and team coordination to ensure successful delivery.

Qualifications/Certifications

Databricks Certified Data Engineer Associate

SQL (Advance) - HackerRank

Python (Basic) – HackerRank

Salary Range: 90k-100k

Date of Posting: 3/11/2026

For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers . Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.