AWS Data Engineer

HCLTech - Australia and New Zealand; Sydney; On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Virtual-first environment

Flexible work

Comprehensive benefits

Global opportunities

Job summary

HCLTech Australia is seeking an AWS Data Engineer - Scale Migration Specialist to join our Data Team to drive the successful migration of on-premise Hadoop big data infrastructure to AWS, ensuring scalability, performance, and data integrity throughout the process.

The AWS Data Engineer will be a key player in our Ninja Team, responsible for designing, developing, and implementing data processing and migration strategies.

Qualifications

• Strong SQL skills and data modeling expertise.
• Experience with dbt Core for transformations.
• Proficiency in Python and AWS cloud services.
• Hands-on with Snowflake and Airflow for ETL pipelines.
• Knowledge of AWS Lambda, S3, ECS, MWAA and data catalogs.

Responsibilities

• Build and maintain dbt transformation models across pipeline layers.
• Write Snowflake SQL for complex transformations and deduplication.
• Develop and debug Airflow DAGs on AWS ECS.
• Contribute to Lambda-based ingestion and S3 event handling.
• Maintain source-to-target mapping and align with data specs.
• Support onboarding of downstream consumers via data sharing.
• Participate in code reviews and write data quality tests.

Tools

Snowflake

Airflow

AWS ECS

Lambda

S3

MWAA

Glue Catalogs

Lake Formation

SQS

EventBridge

GitHub Actions

Iceberg

Job description

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000+ people across 54 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud.

The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version of themselves that they can be.

At HCLTech Australia, we value the unique perspective and contributions of all individual and we actively encourage applications from Aboriginal and Torres Strait Islander people to apply for this role.

Are you ready to be an important part of this ever-transformational journey?

About the role

We are seeking AWS Data Engineer - Scale Migration Specialist to join our Data Team to drive the successful migration of on-premise Hadoop big data infrastructure to AWS, ensuring scalability, performance, and data integrity throughout the process.

The AWS Data Engineer will be a key player in our Ninja Team, responsible for designing, developing, and implementing data processing and migration strategies. The role involves working with various big data technologies and AWS services to facilitate a seamless transition from on-premise Hadoop to a cloud-based environment. This includes data migration, optimization, and integration tasks to ensure robust and scalable data solutions.

What you'll be doing

• Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
• Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
• Developing and debugging Apache Airflow DAGs on AWS ECS
• Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
• Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
• Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
• Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
• Strong SQL
• Proficiency with dbt Core
• Apache Iceberg Table format (Nice to have)
• AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
• Experience with fixed-format or structured financial data files
• CICD with Github Actions.

Why Us

We are one of the fastest-growing large tech companies in the world, with offices in 50+ countries across the globe and 219,000 employees.

• Our company is extremely diverse with 165 nationalities represented.
• We offer the opportunity to work with colleagues across the globe.
• We offer a virtual-first work environment, promoting a good work-life integration and real flexibility.
• We offer comprehensive benefits for all employees.
• We are a certified great place to work and a top employer in 17 countries, offering a positive work environment that values employee recognition and respect.

Equality & Opportunity for All

Representing 165 nationalities across the globe, we pride ourselves on being an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, Aboriginal and Torres Strait Islander people or any other protected classification, in accordance with federal, state, and/or local law.