Senior Data Engineer (Dev Background)

Nuage Technology Group; Melbourne; Hybrid; AUD 78,000 - 112,000; Full time

Job summary

Nuage Technology Group is helping a high-volume, real-time consumer business in Melbourne recruit data engineers for a major AWS data migration. The role is a 6-month rolling contract with hybrid work, three days per week in Melbourne CBD, and requires full working rights.

You’ll join a global program delivering large-scale data pipelines and complex SQL transformations. You’ll work with Databricks on AWS data services, streaming with Kafka/MSK, and contribute to the migration of

Qualifications

• Experience building large-scale data pipelines on AWS and Databricks.
• Strong SQL skills with complex transformations.
• Experience with streaming data using Kafka/MSK.
• Proven track record migrating enterprise data.

Responsibilities

• Build and optimise large-scale data pipelines on AWS and Databricks.
• Write advanced SQL transformations and complex joins.
• Work on streaming pipelines with Kafka/MSK in production.
• Contribute to a global migration program.

Skills

Databricks

Advanced SQL

AWS data services

Kafka / MSK streaming

Enterprise data migration

Tools

AWS Glue

Redshift

Athena

EMR

Kinesis

Lake Formation

Job description

Our client is a high volume, real time consumer business in Melbourne. They’re in the middle of a major global AWS data migration and are looking for engineers to get stuck in!

The gig

• 6-month rolling contract (most of the team have been there for years)
• Hybrid, 3 days a week in the Melbourne CBD
• Must have full working rights

What you’ll be doing

• Building and optimising large-scale data pipelines on AWS and Databricks
• Writing heavy SQL transformation: complex joins and business logic, not just landing data and basic cleansing
• Working on streaming pipelines with Kafka / MSK
• Contributing to a large, global migration program

What you’ll bring

• Strong, current Databricks experience
• AWS data services (Glue, Redshift, Athena, EMR, Kinesis, MSK, Lake Formation)
• Advanced SQL, with real depth in complex transformation
• Kafka / MSK streaming in production
• Proven enterprise data migration experience

Nice to have

• Python
• Power BI and ETL tooling
• Mix of batch and streaming experience