Lead Data Engineer

Cognizant; Teaneck Township (NJ); On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Career growth

Training programs

Benefits package

Job summary

Cognizant in Australia seeks an experienced Lead Data Engineer to design, build and optimize scalable Big Data solutions on Azure. You will lead data pipelines, mentor engineers, and collaborate with architects, product owners and operations to deliver robust data platforms.

The role requires strong Spark, PySpark/Scala or Java, Python, SQL and Azure Synapse Analytics expertise, plus hands-on experience with Databricks, Kafka and data governance.

Qualifications

• Experience delivering Big Data solutions on Azure cloud.
• Proven ability to lead data engineering teams.
• Strong design and performance optimization skills.

Responsibilities

• Lead end-to-end design and delivery of Big Data pipelines and data processing solutions.
• Provide technical leadership, review designs and code, enforce best practices.
• Identify and resolve complex performance, quality and production issues.
• Collaborate with architects, product owners, QA, DevOps and support teams.
• Drive defect fixes during QA, UAT, production validation and warranty phases.

Skills

Big Data

Spark

Python

SQL

Azure Synapse

Databricks

Kafka

HDFS

Scala/Java

Leadership

Communication

Tools

Azure Data Factory

Azure Data Lake Storage

Hive

Cloudera Manager

Job description

Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology innovation, deep industry and business process expertise, and a global, collaborative workforce that embodies the future of work. Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 2000, and the Fortune 500 and is ranked among the top performing and fastest growing companies in the world.

Our Culture:

Your passion, integrity and experience are integral to Cognizant's success. You will join a dynamic and expanding global leader in IT and Business consultancy where you will be valued for who you are. We take pride in our partnership with our clients, so your ability to add value and provide exceptional service to our clients is fundamental to your success. In return, you will be presented with opportunities to develop your career and collaborate with talented colleagues in a supportive, diverse environment.

At Cognizant we recognize that companies that are open and welcoming to a multi-culturally diverse workforce will thrive with fresh perspectives and collaborative knowledge. Cognizant focuses on promoting & increasing gender diversity and providing a workplace which encourages great participation and an equal playing field, where merit and accomplishment are the only criteria for success.

Job Summary:

We are seeking an experienced Lead Data Engineer to lead the design, development, optimization, and implementation of scalable Big Data solutions, data pipelines, Azure Synapse Analytics solutions, and Azure Cloud-based data engineering platforms.

Responsibilities :

• Lead end-to-end design and delivery of Big Data pipelines, frameworks, reusable components, and data processing solutions as per business and technical requirements.
• Provide technical leadership to developers and engineers, review designs and code, and ensure adherence to engineering best practices.
• Identify, analyse, and resolve complex Big Data performance, scalability, data quality, and production issues independently.
• Collaborate with architects, product owners, business stakeholders, QA, DevOps, and support teams across design, build, testing, deployment, and post-production support.
• Drive defect fixes during QA, UAT, production validation, and warranty phases while ensuring timely delivery and high-quality outcomes

Skills Required:

• Strong technical leadership, analytical, problem-solving, and decision-making skills to deliver complex Big Data and Azure Cloud data engineering solutions.
• Extensive hands‑on experience with Spark, PySpark, Scala or Java, Python, SQL, Hive, Kafka, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, Databricks, and distributed data processing frameworks.
• Ability to design scalable batch and streaming data pipelines on Azure Cloud, optimize data workloads, troubleshoot production issues, and guide engineering teams on best practices.
• Strong knowledge of HDFS, MapReduce, Hive, Impala, Tez, Sqoop, Oozie, HBase, Cassandra, MongoDB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, Ambari, and Azure Cloud technologies.
• Independent high-level design ownership and technical leadership across Big Data delivery initiatives.
• Strong communication skills with the ability to influence engineering teams, architects, business stakeholders, QA, DevOps, and production support teams.
• Ability to manage stakeholder expectations, drive delivery governance, mentor team members, and ensure quality engineering outcomes

Benefits:

• You can pursue innovative career tracks and opportunities here
• You can enhance your professional development through education and dedicated training
• We’ll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future.

Joining Cognizant will give you the opportunity to learn and collaborate with some of the most talented people in the industry, while having your finger on the pulse of emerging industry trends and working on the cutting edge of technology in your field of expertise.

We recognize that our people perform at their best when they feel valued as significant contributors and that is why at Cognizant, taking care of our employees is a priority:

About Cognizant:

Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full‑stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast‑changing world. See how at cognizant.ai or @cognizant.

Additional employment information

Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [e-mail] for roles based in the Americas or [e-mail] for roles based in India.