AWS Data Engineer — Hadoop-to-Cloud Migration Specialist

HCLTech - Australia and New Zealand; Sydney; On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Virtual-first environment

Flexible work

Comprehensive benefits

Global opportunities

Job summary

HCLTech Australia is seeking an AWS Data Engineer - Scale Migration Specialist to join our Data Team to drive the successful migration of on-premise Hadoop big data infrastructure to AWS, ensuring scalability, performance, and data integrity throughout the process.

The AWS Data Engineer will be a key player in our Ninja Team, responsible for designing, developing, and implementing data processing and migration strategies.

Qualifications

• Strong SQL skills and data modeling expertise.
• Experience with dbt Core for transformations.
• Proficiency in Python and AWS cloud services.
• Hands-on with Snowflake and Airflow for ETL pipelines.
• Knowledge of AWS Lambda, S3, ECS, MWAA and data catalogs.

Responsibilities

• Build and maintain dbt transformation models across pipeline layers.
• Write Snowflake SQL for complex transformations and deduplication.
• Develop and debug Airflow DAGs on AWS ECS.
• Contribute to Lambda-based ingestion and S3 event handling.
• Maintain source-to-target mapping and align with data specs.
• Support onboarding of downstream consumers via data sharing.
• Participate in code reviews and write data quality tests.

Tools

Snowflake

Airflow

AWS ECS

Lambda

S3

MWAA

Glue Catalogs

Lake Formation

SQS

EventBridge

GitHub Actions

Iceberg

Job description

HCLTech Australia is seeking an AWS Data Engineer - Scale Migration Specialist to join our Data Team to drive the successful migration of on-premise Hadoop big data infrastructure to AWS, ensuring scalability, performance, and data integrity throughout the process.

The AWS Data Engineer will be a key player in our Ninja Team, responsible for designing, developing, and implementing data processing and migration strategies.