Data Engineer | Databricks

Mane Consulting; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Mane Consulting in Sydney is seeking a Data Engineer to lead day-to-day data and analytics support, collaborating with Product owners, Data Architects and stakeholders to drive informed decisions.

You will design analytics solutions, migrate on-prem SSIS/SQL Server assets to our Big Data Cloud Platform, write SQL for consumable datasets, and transform large datasets for analysis.

Qualifications

• Bachelor or Masters Degree in Mathematics, Statistics or Computer Science.
• 4+ years of Data Engineering experience.
• Experience with DataBricks is essential.
• Experience with Azure, Data Factory, Synapse, Power BI is an advantage.
• Demonstrated use of data management tools such as DataBricks, and Apache Spark.
• Prior experience with Azure or AWS.

Responsibilities

• Designing new advanced analytics software solutions.
• Providing technical guidance and into the development of migration plans to bring existing traditional data warehouse assets SSIS and SQL Server from on premise environments into our Big Data Cloud Platform.
• Write SQL to create easily consumable datasets for team-members’ use in reporting and analysis.
• Analysis, design, coding, performance tuning, and implementation of new solutions.
• Fostering and growing collaborative relationships with a growing group of distributed data analytics hubs across the business.
• Transform and manipulate the large data-sets to suit the desired analysis.
• Create and present clear oral and written reports on the findings.

Skills

4+ years data engineering

DataBricks

Apache Spark

Azure

AWS

Power BI

Education

Bachelor or Masters Degree in Mathematics, Statistics or Computer Science

Job description

Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Engineer to collaborate a highly respected team. In this role, you will spearhead day-to-day data and analytics support for the diverse cross-functional with Product owners, Data Architect’s, and stakeholders. Seize this chance to harness your expertise and drive impactful decisions within a thriving, forward-looking organization at the forefront of innovation

Main Responsibilities:

• Designing new advanced analytics software solutions
• Providing technical guidance and into the development of migration plans to bring existing traditional data warehouse assets SSIS and SQL Server from on premise environments into our Big Data Cloud Platform
• Write SQL to create easily consumable datasets for team-members’ use in reporting and analysis
• Analysis, design, coding, performance tuning, and implementation of new solutions
• Fostering and growing collaborative relationships with a growing group of distributed data analytics hubs across the business
• Transform and manipulate the large data-sets to suit the desired analysis
• Create and present clear oral and written reports on the findings

Key Skills and Experience:

• Bachelor or Masters Degree in Mathematics, Statistics or Computer Science
• 4+ years of Data Engineering experience
• Experience with DataBricks is essential
• Experience with Azure, Data Factory, Synapse, Power BI is an advantage.
• Demonstrated use of data management tools such as DataBricks, and Apache Spark
• Prior experience with Azure or AWS