Azure Databricks Data Engineer - Hybrid Sydney CBD

AC3; Sydney; Hybrid; AUD 203,000 - 221,000; Full time

Benefits offered by this job

Hybrid work

Office in Sydney CBD

ASAP start

Job summary

AC3 is seeking an experienced Data Engineer to help migrate a client to Azure Cloud and modernise the platform using Databricks Medallion architecture.

You will create data pipelines, model data and build scalable data platforms while collaborating with analytics teams to visualise insights. Requires 5+ years in data engineering, SQL/Python and cloud data platforms. Hybrid work in Sydney with 2 days in the office per week, ASAP start.

Qualifications

• 5+ years of experience as a Data Engineer.
• Experience building processes that transform, structure and extract value from data.
• Experience in machine learning, data mining, math and statistical modelling and analysis.
• Knowledge of data platform concepts: data lakes, data warehousing, big data processing and real-time processing.
• Scheduling and monitoring of ETL/ELT workflows.
• Proficient in SQL, Python, SQL Server, NoSQL and Oracle databases.

Responsibilities

• Create and maintain data pipelines and infrastructure using diverse storage technologies.
• Develop scalable data platforms using APIs and quality frameworks to handle increasing data volume.
• Help establish data mining, data modelling and data protection processes and standards.
• Create data models in Databricks and Medallion architecture.
• Create clear data visualisations to communicate findings to stakeholders.
• Collaborate with the data and analytics team to enhance data models.
• Assist with building and optimising data pipelines and infrastructure.

Skills

Data transformation

ETL/ELT scheduling

Data modeling

Data mining

Statistical analysis

Cloud data platforms

Collaboration

Education

Bachelor’s Degree in Data Science or related field

Tools

Databricks

ADF

Logic Apps

Data Lake Gen2

Python

SQL Server

NoSQL

Oracle

Job description

AC3 is seeking an experienced Data Engineer to help migrate a client to Azure Cloud and modernise the platform using Databricks Medallion architecture.

You will create data pipelines, model data and build scalable data platforms while collaborating with analytics teams to visualise insights. Requires 5+ years in data engineering, SQL/Python and cloud data platforms. Hybrid work in Sydney with 2 days in the office per week, ASAP start.