Azure Data Engineering Lead: Scalable Pipelines & Security

Indigenous Business Australia; Canberra; On-site; AUD 150,000 - 210,000; Full time

Job summary

Indigenous Business Australia is seeking a Technical Lead, Data Engineering within the Information Technology – Data Engineering team. You will design scalable pipelines and systems and help decide on technologies in line with the ArchitectureStrategy.

You will write code, develop data workflows and support analytics communities, aiming for optimal performance while ensuring data privacy and security. You will coordinate with third parties to troubleshoot data pipelines and incidents and keep

Qualifications

• Design scalable, efficient data pipelines and systems.
• Collaborate with Architecture to choose technologies and architecture.
• Write code, develop data workflows and support analytics communities.
• Ensure pipelines perform optimally, identifying bottlenecks and improvements.
• Collaborate with data and cyber security to meet data privacy and compliance.
• Coordinate with third parties to troubleshoot data pipelines, infrastructure and incidents.
• Keep documentation up to date and promote knowledge sharing.
• Stay abreast of emerging data engineering trends to adopt new tools.
• Oversee data quality to meet data consumer needs.

Responsibilities

• Be responsible for designing scalable, efficient and reliable data pipelines and systems.
• Work alongside the architecture function to make decisions about choice of technologies, tools and architecture that aligns to the ArchitectureStrategy.
• Write code, develop data workflows and support the Reporting and Analytics Community of Practice, contribution directly to the implementation of data solutions.
• Ensure that data pipelines and systems perform optimally, including identifying bottlenecks, inefficiencies and implementing improvements.
• Collaborate alongside the data and cyber security functions to ensure that data privacy, security and compliance is met within data processing and storage.
• Collaborating with our Third Parties, coordinate and lead troubleshooting activities related to data pipelines, infrastructure, and incidents. Identifying root causes and implementing solutions.
• Keep appropriate documentation, ensuring it is up to date, contributing to knowledge sharing and management of key person risk.
• Stay abreast of emerging technologies and trend in data engineering and analytics to make informed decisions by adopting new tools and practices.
• Oversee data quality ensuring that data is accurate, consistent and meets the needs of the data consumer.

Job description

Indigenous Business Australia is seeking a Technical Lead, Data Engineering within the Information Technology – Data Engineering team. You will design scalable pipelines and systems and help decide on technologies in line with the ArchitectureStrategy.

You will write code, develop data workflows and support analytics communities, aiming for optimal performance while ensuring data privacy and security. You will coordinate with third parties to troubleshoot data pipelines and incidents and keep