Senior Data Engineer – Aws

Maltem Australia; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Flexible working practices

Ongoing training and development

Career progression discussions

Job summary

Maltem Australia is seeking a Senior Data Engineer for a Banking/Financial Services client. You’ll manage Big Data platforms on AWS (S3/EC2) with Spark, Hadoop (HDFS, Hive, Impala) and Presto, guided by Airflow.

This hybrid Sydney CBD role involves collaboration with multiple teams, continuous improvement, and a clear path for career progression, with remuneration offered for permanent or contractor arrangements.

Qualifications

• Experience with Hadoop ecosystem including HDFS, Hive and Impala.
• Experience with Spark and cloud enablement, setting up AWS services.
• Strong SQL scripting and Python programming experience.
• Airflow experience for job orchestration would be highly regarded.
• Growth mindset with problem solving and learning new technologies.
• Strong communication and stakeholder management across multiple teams.
• Ability to work in a hybrid fashion in Sydney CBD 2 days a week.
• Must have full working rights in Australia.

Responsibilities

• Run Spark jobs on AWS, using Airflow for orchestration and scheduling.
• Manage the AWS framework, governance and guardrails to enable growth.
• Collaborate with internal business/technical teams on cloud/data enablement solutions.
• Provide continuous improvement recommendations to stakeholders and platform owners.

Skills

AWS

Spark

Python

SQL

Airflow

Tools

Hadoop

HDFS

Hive

Impala

Presto

S3

EC2

Job description

Senior Data Engineer Opportunities at our Financial Services client

Working for a major Bank, you will have AWS, Spark, Hadoop Ecosystem (HDFS, Hive and Impala), Presto and Airflow experience

Maltem are a Data & Analytics Consultancy with a global clientele, focused on your development

Opportunity

As our new Senior Data Engineer in our Data and Analytics team, you’ll be working with one of our key Banking and Financial Services clients on a key Data Transformation project.

You will focus on managing key Big Data platforms using Hadoop (HDFS, Hive and Impala) on AWS. You’ll also:

• Run Spark jobs on AWS, using Apache Airflow for job orchestration and scheduling.
• Manage the AWS framework, governance and guardrails to allow the services to grow.
• Work in partnership with internal business and technical teams, to provide further solutions to their cloud and data enablement challenges.
• Make continuous improvement recommendations, to positively impact your stakeholders and platform owners.

We need you to have

You’ll have a demonstrable background working as a Senior Data Engineer with AWS cloud services such as S3 and EC2. You’ll also have:

• Experience with the Hadoop Ecosystem especially HDFS, Hive and Impala.
• Experience with Spark and a history of cloud enablement, setting up AWS services.
• You will naturally be highly experienced with SQL scripting and have good Python language experience.
• Experience of working with Airflow as a job orchestration tool, would be highly regarded.
• Growth mindset, always looking to solve problems and learn new technologies.
• Strong communication and stakeholder management abilities, to work seamlessly with multiple internal stakeholders and their requirements.
• Ability to work in a hybrid fashion in Sydney CBD 2 days a week.
• Must have full working rights (Citizenship, Permanent Residency, Visa with no restrictions) in Australia.

At Maltem, we can offer you

• Opportunity to work with global brands, yet for a consultancy that really values and develops its people.
• Flexible working practices designed to enhance your work-life balance, so you can focus on family and friends.
• Attractive remuneration based on either permanent packages or contractor rates (role dependent).
• Chance to gather at our professional meetups, receive ongoing training and development and formal quarterly career progression meetings.
• Work overseas/ anywhere in the world with Maltem, allowing you the flexibility to take life in your stride.
• Opportunities to work on Consultancy, Advisory and greenfield projects, adding variety to your career experience.

About Us

Maltem was created in 2001 in Paris and expanded to Asia-Pacific-Sydney in 2018. We are a Consultancy with over 1200 Consultants worldwide, across 13 offices and 5 regions. We’re passionate about our four specialist pillars; Data Analytics, IT Development, Change & Project and Infrastructure Services.

We are a vibrant culture, based on creating professional communities of practice that take care of each other and foster a culture of sharing, openness and support. This is at the heart of our vision and our success in this endeavour, can be seen with our "Happy at Work Award 2021" for employee satisfaction, resulting from 15 professional meetups a year and 850 days of training delivered to 250 people in 2021.

We look forward to sharing our vision with you! Find out more here and become a 'Maltemian': https://maltem.com.au/

So, are you ready to join us?