Technical Lead, Data Engineering (Azure)

Indigenous Business Australia; Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Indigenous Business Australia is seeking a Technical Lead, Data Engineering to design scalable data pipelines and systems, and to collaborate with architecture to select technologies aligned with ArchitectureStrategy. You will write code, develop data workflows and support the Reporting and Analytics Community of Practice.

You will ensure pipelines perform optimally, address bottlenecks, and collaborate on data privacy, security and compliance.

Qualifications

• Design scalable, efficient and reliable data pipelines.
• Collaborate with architecture for technology choices and ArchitectureStrategy alignment.
• Write code and develop data workflows for the Reporting and Analytics Community of Practice.

Responsibilities

• Ensure data pipelines and systems perform optimally and identify bottlenecks.
• Collaborate to ensure data privacy, security, and compliance in processing and storage.
• Coordinate with third parties to troubleshoot data pipelines, infrastructure, and incidents; identify root causes.

Skills

Data Engineering

System Design

Leadership

Tools

Python

SQL

Airflow

Job description

As the Technical Lead, Data Engineering, you will:

• Be responsible for designing scalable, efficient and reliable data pipelines and systems.
• Work alongside the architecture function to make decisions about choiceof technologies, tools and architecture that aligns to the ArchitectureStrategy.
• Write code, develop data workflows and support the Reporting and AnalyticsCommunity of Practice, contribution directly to the implementation of data solutions.
• Ensure that data pipelines and systems perform optimally, including identifyingbottle necks, inefficiencies and implementing improvements.
• Collaborate alongside the data and cyber security functions to ensure that dataprivacy, security and compliance is met within data processing and storage.
• Collaborating with our Third Parties, coordinate and lead troubleshootingactivities related to data pipelines, infrastructure, and incidents. Identifying rootcauses and implementing solutions.
• Keep appropriate documentation, ensuring it is up to date, contributingto knowledge sharing and management of key person risk.
• Stay abreast of emerging technologies and trend in data engineering and analyticsto make informed decisions by adopting new tools and practices.
• Oversee data quality ensuring that data is accurate, consistent and meets theneeds of the data consumer.

This role sits within IBA's Information Technology - Data Engineering team.

A full outline of the role and responsibilities is available in the position statement.