Data Engineer | Databricks

Mane; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

Mane is seeking a Data Engineer to join a data-driven team in Melbourne. You will drive day-to-day data and analytics support, collaborating with Product Owners, Data Architects, and stakeholders to enable impactful decision-making.

You will design analytics software solutions, migrate on-prem assets to a cloud platform, write SQL for consumable datasets, and perform design, coding, and performance tuning across large data sets, fostering cross-functional collaboration.

Qualifications

• Bachelor or Master in Mathematics, Statistics or Computer Science.
• 4+ years of Data Engineering experience.
• Experience with DataBricks is essential.
• Azure, Data Factory, Synapse, Power BI are advantageous.
• Experience with DataBricks and Apache Spark demonstrated.

Responsibilities

• Design advanced analytics software solutions.
• Provide technical guidance for migrating assets to cloud (SSIS/SQL Server on-premise to Big Data Cloud).
• Write SQL to create consumable datasets for reporting and analysis.
• Analyze, design, code, tune performance and implement new solutions.
• Foster collaboration with distributed data analytics hubs.
• Transform large datasets for analysis and present findings.

Skills

Data engineering

SQL

DataBricks

Azure

Synapse

Power BI

Apache Spark

AWS

Education

Bachelor or Master in Math/Stats/CS

Tools

DataBricks

Apache Spark

SQL Server

Job description

Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Engineer to collaborate a highly respected team. In this role, you will spearhead day-to-day data and analytics support for the diverse cross-functional with Product owners, Data Architect’s, and stakeholders. Seize this chance to harness your expertise and drive impactful decisions within a thriving, forward-looking organization at the forefront of innovation

Main Responsibilities:

• Designing new advanced analytics software solutions
• Providing technical guidance and into the development of migration plans to bring existing traditional data warehouse assets SSIS and SQL Server from on premise environments into our Big Data Cloud Platform
• Write SQL to create easily consumable datasets for team-members’ use in reporting and analysis
• Analysis, design, coding, performance tuning, and implementation of new solutions
• Fostering and growing collaborative relationships with a growing group of distributed data analytics hubs across the business
• Transform and manipulate the large data-sets to suit the desired analysis
• Create and present clear oral and written reports on the findings

Key Skills and Experience:

• Bachelor or Masters Degree in Mathematics, Statistics or Computer Science
• 4+ years of Data Engineering experience
• Experience with DataBricks is essential
• Experience with Azure, Data Factory, Synapse, Power BI is an advantage.
• Demonstrated use of data management tools such as DataBricks, and Apache Spark
• Prior experience with Azure or AWS