Data Platform Engineer

Mane Consulting; Sydney; On-site; AUD 130,000 - 210,000; Full time

Job summary

Mane Consulting is seeking a Data Platform Engineer for a 12-month contract within our Technology team in Sydney. The role focuses on AWS Glue, Lake Formation, and EMR, migrating customers from Cloudera to AWS native data services to achieve seamless transitions and optimal performance.

Responsibilities include ensuring data integration, building automation for migrations, and collaborating with data and platform engineers to drive cohesive delivery while contributing to incident response plans

Qualifications

• Experience with AWS Glue, Lake Formation, EMR, and related services (S3, Redshift, Athena).
• Hands-on experience migrating from Cloudera to AWS, especially involving HMS.
• Proficiency in Python, Bash, YAML, and Infrastructure as Code tools.
• Analytical mindset with a proactive approach to troubleshooting and optimization.
• Able to translate complex technical concepts for diverse audiences.
• Collaborative spirit with a track record of working effectively in cross-functional teams.

Responsibilities

• Ensure smooth data integration across platforms while maintaining integrity and performance.
• Build robust automation for data migration and synchronization workflows.
• Partner with data engineers, platform engineers, and stakeholders to drive cohesive delivery.
• Contribute to incident response plans and platform certification documentation.

Skills

AWS Glue

Lake Formation

EMR

S3

Redshift

Athena

Python

Bash

YAML

Infrastructure as Code

Troubleshooting

Communication

Cross-functional teams

Tools

Terraform

CloudFormation

Job description

Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey! We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team. This pivotal role demands a seasoned professional with robust expertise in AWS Glue, AWS Lake formation. This is your opportunity to make a profound impact in in migrating customers from Cloudera to AWS native data services, ensuring a seamless transition and optimal performance.

Key Responsibilities:

• Ensure smooth data integration across platforms while maintaining integrity and performance.
• Build robust automation for data migration and synchronization workflows.
• Partner with data engineers, platform engineers, and stakeholders to drive cohesive delivery.
• Contribute to incident response plans and platform certification documentation.

Required Skills and Experience:

• Proven experience with AWS Glue, Lake Formation, EMR, and related services (S3, Redshift, Athena).
• Hands-on experience migrating from Cloudera to AWS, especially involving HMS.
• Proficiency in Python, Bash, YAML, and Infrastructure as Code tools.
• Analytical mindset with a proactive approach to troubleshooting and optimization.
• Able to translate complex technical concepts for diverse audiences.
• Collaborative spirit with a track record of working effectively in cross-functional teams.

Mane Consulting specialise in Data & Analytics.