Data Engineer | Databricks

Mane Consulting; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

Mane Consulting is seeking a Data Engineer to lead day-to-day data and analytics support, collaborating with product owners, data architects, and stakeholders to drive impactful decisions. You will design analytics software, perform data transformations, and present findings within a cross-functional team.

The role emphasizes hands-on data engineering, SQL development, and experience with DataBricks and cloud platforms. Melbourne-based, data-driven environment.

Qualifications

• Bachelor's or Master's degree in Mathematics, Statistics or Computer Science.
• 4+ years of Data Engineering experience.
• Experience with DataBricks is essential.
• Azure, Data Factory, Synapse, Power BI is an advantage.
• Demonstrated use of data management tools such as DataBricks and Apache Spark.
• Prior experience with Azure or AWS.

Responsibilities

• Designing new advanced analytics software solutions.
• Provide technical guidance and migration plans to bring on-prem SSIS/SQL Server assets to a Big Data Cloud Platform.
• Write SQL to create easily consumable datasets for reporting and analysis.
• Analysis, design, coding, performance tuning, and implementation of new solutions.
• Foster and grow relationships with distributed data analytics hubs across the business.
• Transform and manipulate large datasets for analysis.
• Create and present clear oral and written reports on findings.

Skills

Data Engineering

SQL

Spark

Education

Bachelor's/Master's in Mathematics, Statistics or Computer Science

Tools

DataBricks

Azure

Data Factory

Synapse

Power BI

Apache Spark

AWS

Job description

Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Engineer to collaborate a highly respected team. In this role, you will spearhead day-to-day data and analytics support for the diverse cross-functional with Product owners, Data Architect's, and stakeholders. Seize this chance to harness your expertise and drive impactful decisions within a thriving, forward-looking organization at the forefront of innovation

Main Responsibilities:

• Designing new advanced analytics software solutions
• Providing technical guidance and into the development of migration plans to bring existing traditional data warehouse assets SSIS and SQL Server from on premise environments into our Big Data Cloud Platform
• Write SQL to create easily consumable datasets for team-members' use in reporting and analysis
• Analysis, design, coding, performance tuning, and implementation of new solutions
• Fostering and growing collaborative relationships with a growing group of distributed data analytics hubs across the business
• Transform and manipulate the large data-sets to suit the desired analysis
• Create and present clear oral and written reports on the findings

Key Skills and Experience:

• Bachelor or Masters Degree in Mathematics, Statistics or Computer Science
• 4+ years of Data Engineering experience
• Experience with DataBricks is essential
• Experience with Azure, Data Factory, Synapse, Power BI is an advantage.
• Demonstrated use of data management tools such as DataBricks, and Apache Spark
• Prior experience with Azure or AWS