AWS Data Platform Engineer — Cloudera-to-AWS Migration

Mane Consulting; Sydney; Vor Ort; AUD 130.000 - 210.000; Vollzeit

Zusammenfassung

Mane Consulting is seeking a Data Platform Engineer for a 12-month contract within our Technology team in Sydney. The role focuses on AWS Glue, Lake Formation, and EMR, migrating customers from Cloudera to AWS native data services to achieve seamless transitions and optimal performance.

Responsibilities include ensuring data integration, building automation for migrations, and collaborating with data and platform engineers to drive cohesive delivery while contributing to incident response plans

Qualifikationen

• Experience with AWS Glue, Lake Formation, EMR, and related services (S3, Redshift, Athena).
• Hands-on experience migrating from Cloudera to AWS, especially involving HMS.
• Proficiency in Python, Bash, YAML, and Infrastructure as Code tools.
• Analytical mindset with a proactive approach to troubleshooting and optimization.
• Able to translate complex technical concepts for diverse audiences.
• Collaborative spirit with a track record of working effectively in cross-functional teams.

Aufgaben

• Ensure smooth data integration across platforms while maintaining integrity and performance.
• Build robust automation for data migration and synchronization workflows.
• Partner with data engineers, platform engineers, and stakeholders to drive cohesive delivery.
• Contribute to incident response plans and platform certification documentation.

Kenntnisse

AWS Glue

Lake Formation

EMR

S3

Redshift

Athena

Python

Bash

YAML

Infrastructure as Code

Troubleshooting

Communication

Cross-functional teams

Tools

Terraform

CloudFormation

Jobbeschreibung

Mane Consulting is seeking a Data Platform Engineer for a 12-month contract within our Technology team in Sydney. The role focuses on AWS Glue, Lake Formation, and EMR, migrating customers from Cloudera to AWS native data services to achieve seamless transitions and optimal performance.

Responsibilities include ensuring data integration, building automation for migrations, and collaborating with data and platform engineers to drive cohesive delivery while contributing to incident response plans