Lead Data Engineer

Cognizant; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Cognizant Technology Solutions Corporation seeks an experienced Data Engineer to design, build, and optimize scalable cloud data platforms and analytics pipelines. The ideal candidate will have hands-on expertise with Amazon Redshift, Fivetran, Databricks, and dbt, plus strong SQL and data modeling.

Join Cognizant to collaborate with analysts, data scientists and business stakeholders while delivering trusted data products at scale in a dynamic, global IT services environment.

Qualifications

• Experience in data engineering, data warehousing and ETL/ELT development.
• Advanced SQL skills and dimensional data modeling.
• Production experience with Amazon Redshift and performance tuning.
• Experience implementing Fivetran-based ingestion pipelines.
• Proficiency with Databricks, Spark and Delta Lake.
• Strong proficiency with dbt models, tests and deployment workflows.
• Proficiency in Python or another data engineering language.
• Experience with Git, CI/CD, orchestration, monitoring and cloud security fundamentals.
• Strong analytical, troubleshooting and stakeholder-management skills.

Responsibilities

• Design and maintain reliable batch and streaming data pipelines.
• Build and optimize data warehouse solutions on Redshift, including schema design and performance tuning.
• Configure and manage Fivetran connectors and transformations for ingestion.
• Develop Databricks notebooks and pipelines using Spark and Delta Lake.
• Create modular, tested, and documented dbt transformations.
• Implement data quality checks, lineage, observability, security and governance controls.
• Collaborate with analysts, data scientists, product teams and stakeholders to translate requirements into data products.
• Troubleshoot pipeline failures and automate monitoring to improve platform reliability.
• Participate in code reviews, release management and engineering best practices.

Skills

Data engineering

Data warehousing

SQL

Amazon Redshift

Fivetran

Databricks

Apache Spark

dbt

Python

Git

CI/CD

Data quality

Tools

Airflow

Databricks Workflows

AWS S3

Job description

Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology innovation, deep industry and business process expertise, and a global, collaborative workforce that embodies the future of work. Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 2000, and the Fortune 500 and is ranked among the top performing and fastest growing companies in the world.

Our Culture:

Your passion, integrity and experience are integral to Cognizant's success. You will join a dynamic and expanding global leader in IT and Business consultancy where you will be valued for who you are. We take pride in our partnership with our clients, so your ability to add value and provide exceptional service to our clients is fundamental to your success. In return, you will be presented with opportunities to develop your career and collaborate with talented colleagues in a supportive, diverse environment.

At Cognizant we recognize that companies that are open and welcoming to a multi-culturally diverse workforce will thrive with fresh perspectives and collaborative knowledge. Cognizant focuses on promoting & increasing gender diversity and providing a workplace which encourages great participation and an equal playing field, where merit and accomplishment are the only criteria for success.

Job Summary:

We are seeking an experienced Data Engineer to design, build, and optimize scalable cloud data platforms and analytics pipelines. The ideal candidate will have hands-on expertise with Amazon Redshift, Fivetran, Databricks, and dbt, along with strong SQL, data modeling, and data quality practices.

Key Responsibilities:

• Design, develop, and maintain reliable batch and streaming data pipelines.
• Build and optimize data warehouse solutions on Amazon Redshift, including schema design, workload management, query performance, and cost efficiency.
• Configure and manage Fivetran connectors, transformations, monitoring, and incident resolution for source-to-warehouse ingestion.
• Develop scalable data processing workflows and notebooks in Databricks using Spark and Delta Lake.
• Create modular, tested, and documented transformation models using dbt.
• Implement data quality checks, lineage, observability, security, and governance controls.
• Partner with analysts, data scientists, product teams, and business stakeholders to translate requirements into trusted data products.
• Troubleshoot pipeline failures, resolve data issues, and improve platform reliability through automation and monitoring.
• Participate in code reviews, release management, and continuous improvement of engineering standards.

Required Qualifications:

• Strong hands-on experience in data engineering, data warehousing, and ETL/ELT development.
• Advanced SQL skills and experience with relational and dimensional data modeling.
• Production experience with Amazon Redshift, including distribution styles, sort keys, performance tuning, and operational maintenance.
• Experience implementing and supporting Fivetran-based ingestion pipelines.
• Proficiency with Databricks, Apache Spark, and Delta Lake.
• Strong experience with dbt models, tests, macros, documentation, and deployment workflows.
• Proficiency in Python or another data engineering language.
• Experience with Git, CI/CD, orchestration, monitoring, and cloud security fundamentals.
• Strong analytical, troubleshooting, communication, and stakeholder-management skills.

Preferred Qualifications:

• Experience with AWS services such as S3, IAM, Glue, Lambda, and CloudWatch.
• Knowledge of data cataloging, lineage, privacy, access control, and governance practices.
• Experience with an orchestration platform such as Apache Airflow or Databricks Workflows.
• Relevant AWS, Databricks, or dbt certification.

Benefits:

Joining Cognizant will give you the opportunity to learn and collaborate with some of the most talented people in the industry, while having your finger on the pulse of emerging industry trends and working on the cutting edge of technology in your field of expertise. We recognize that our people perform at their best when they feel valued as significant contributors and that is why at Cognizant, taking care of our employees is a priority:

You can pursue innovative career tracks and opportunities here

You can enhance your professional development through education and dedicated training

We’ll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future.