Azure Data Engineering Lead: Scalable Pipelines & Quality

Indigenous Business Australia; Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Indigenous Business Australia is seeking a Technical Lead, Data Engineering to design scalable data pipelines and systems, and to collaborate with architecture to select technologies aligned with ArchitectureStrategy. You will write code, develop data workflows and support the Reporting and Analytics Community of Practice.

You will ensure pipelines perform optimally, address bottlenecks, and collaborate on data privacy, security and compliance.

Qualifications

• Design scalable, efficient and reliable data pipelines.
• Collaborate with architecture for technology choices and ArchitectureStrategy alignment.
• Write code and develop data workflows for the Reporting and Analytics Community of Practice.

Responsibilities

• Ensure data pipelines and systems perform optimally and identify bottlenecks.
• Collaborate to ensure data privacy, security, and compliance in processing and storage.
• Coordinate with third parties to troubleshoot data pipelines, infrastructure, and incidents; identify root causes.

Skills

Data Engineering

System Design

Leadership

Tools

Python

SQL

Airflow

Job description

Indigenous Business Australia is seeking a Technical Lead, Data Engineering to design scalable data pipelines and systems, and to collaborate with architecture to select technologies aligned with ArchitectureStrategy. You will write code, develop data workflows and support the Reporting and Analytics Community of Practice.

You will ensure pipelines perform optimally, address bottlenecks, and collaborate on data privacy, security and compliance.