Data Engineer - Delta Lake Medallion & DataOps Expert

MSWA; Western Australia; On-site; AUD 80,000 - 110,000; Full time

Benefits offered by this job

Generous salary packaging

Retail discounts

Flexible Working Options

Ongoing training and development

Job summary

An organization dedicated to neurological care is looking for a skilled Data Engineer in Western Australia. You will design and maintain data pipelines and help build a data platform that enhances analytics and insights. Qualifications include proficiency in Python and SQL, and experience with data integration. This role offers flexible working options and a supportive team culture, as well as a comprehensive salary packaging and ongoing development opportunities.

Qualifications

• Hands-on experience with Microsoft Fabric or Databricks.
• Proven experience building Medallion architecture on Delta Lake.
• Experience integrating data via APIs and multiple source systems.
• Strong understanding of data modelling techniques.

Responsibilities

• Ingest and integrate data from various source systems.
• Design and build secure data pipelines.
• Monitor and optimize data pipelines for performance.
• Create and maintain documentation for data processes.

Skills

Data integration

Data pipeline development

Python (PySpark)

SQL

Data modelling

Problem-solving

Education

Undergraduate Degree in Computer Science

Tools

Microsoft Fabric

Databricks

Power BI

Azure DevOps

SSMS

Job description

An organization dedicated to neurological care is looking for a skilled Data Engineer in Western Australia. You will design and maintain data pipelines and help build a data platform that enhances analytics and insights. Qualifications include proficiency in Python and SQL, and experience with data integration. This role offers flexible working options and a supportive team culture, as well as a comprehensive salary packaging and ongoing development opportunities.