Data Engineer

HCLTech - Australia and New Zealand; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

HCLTech in Australia and New Zealand is seeking a Data Engineer in Sydney to design and operate data pipelines using Snowflake, PySpark, Python and SQL. You will build scalable collections pipelines and work with cross-functional teams to ensure robust data workflows.

You will mentor Senior Data Engineers and Data Engineers, define data contracts and schema evolution, and establish production monitoring, CI/CD and data quality controls to support payments-related data initiatives.

Qualifications

• Experience in enterprise data architecture and systems integration.
• Proficient with Snowflake data warehousing and PySpark/Spark.
• Strong Python and advanced SQL skills, and knowledge of AWS.

Responsibilities

• Design the Snowflake and PySpark architecture for collections pipelines.
• Lead integration efforts and model data for collections use cases.
• Define data contracts and schema evolution standards.
• Establish automated data quality and reconciliation controls.
• Design restartable, idempotent and recoverable pipelines.
• Optimize Snowflake and PySpark workloads and monitor pipelines.
• Lead technical reviews and data investigations; mentor engineers.
• Collaborate with Cards MOD, PCC and platform teams.

Skills

Enterprise architecture and systems

Snowflake

PySpark / Spark

Python & SQL

AWS

Data contracts & schema evolution

APIs & distributed systems

CI/CD & production engineering

Job description

“We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000+ people across 54 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud.

“The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version of themselves that they can be.

“Are you ready to be an important part of this ever-transformational journey?

Key responsibilities:

• You will design the Collections Snowflake and PySpark architecture.
• You will lead integration
• You will model HPS card and account data for Collections use cases.
• You will define data contracts and schema-evolution standards.
• You will establish automated data-quality and reconciliation controls.
• You will design restartable, idempotent and recoverable pipelines.
• You will optimise Snowflake and PySpark workloads.
• You will establish production monitoring and data-pipeline observability.
• You will lead technical reviews and complex data investigations.
• You will mentor Senior Data Engineers and Data Engineers.
• You will work closely with Cards MOD, PCC and platform teams.

Essential skills

• Enterprise architecture and systems integration.
• Strong Snowflake experience.
• PySpark / Spark.
• Python and advanced SQL.
• AWS.
• Data contracts and schema evolution.
• APIs and distributed systems.
• CI/CD and production engineering.

Highly regarded

• Cards or payments modernisation.
• HPS / PowerCARD.
• Collections technology.
• Experian PowerCurve Collections.
• Large financial-services migrations.
• DHP or similar enterprise AWS platforms

Why Us

We are one of the fastest-growing large tech companies in the world, with offices in 50+ countries across the globe and 219,000 employees

• Our company is extremely diverse with 165 nationalities represented
• We offer the opportunity to work with colleagues across the globe
• We offer a virtual-first work environment, promoting a good work-life integration and real flexibility
• We offer comprehensive benefits for all employees
• We are a certified great place to work and a top employer in 17 countries, offering a positive work environment that values employee recognition and respect

Equality & Opportunity for All

Representing 165 nationalities across the globe, we pride ourselves on being an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, Aboriginal and Torres Strait Islander people or any other protected classification, in accordance with federal, state, and/or local law.

Candidate Data Privacy Notice | HCL Technologies

We are committed to respecting your privacy and for the protection of your personal data. Your personal data will be collected and processed in line with our candidate privacy notice: https://www.hcltech.com/candidate-privacy-notice. This privacy notice will help you to understand what personal data we collect about you, how we use this personal data, and what rights you have regarding your personal data. By replying to this email or submitting any personal data to HCLTech, you acknowledge that you have read and understood the candidate privacy notice and have provided your consent to the processing of your data for recruitment purposes as described in the privacy notice”.