Data Engineer

Halo Labs; City of Brisbane; Remote; AUD 80,000 - 110,000; Full time

Benefits offered by this job

Dedicated learning budget

Performance bonuses

Comprehensive wellbeing support

Flexible remote work

Travel opportunities to client locations

Job summary

An innovative firm is seeking a skilled Data Engineer to join their remote-first team. This role involves designing and enhancing data frameworks, collaborating with stakeholders, and implementing scalable data pipelines using cutting-edge Azure technologies. With a focus on mentorship and technical guidance, you will play a pivotal role in fostering skill development within the analytics community. Enjoy exceptional perks such as a dedicated learning budget and comprehensive wellbeing support while working in an inclusive environment that values diversity and innovation. If you're passionate about data and ready to make an impact, this opportunity is for you.

Qualifications

• Hands-on experience with Azure Cloud Services and Databricks.
• Proficiency in SQL, Python, and PySpark for data processing.
• Strong understanding of data warehousing and ETL/ELT processes.

Responsibilities

• Design and enhance PySpark frameworks for data solutions.
• Collaborate with stakeholders to deliver data-driven solutions.
• Build and deploy scalable data pipelines using Azure services.

Skills

Azure Cloud Services

Databricks

Python

PySpark

SQL

Data Engineering

ETL/ELT processes

Data Architecture

DevOps Practices

Education

Degree in Computer Science

Degree in Data Science

Degree in IT

Tools

Azure Data Factory

Azure SQL Server

Azure Storage

Power BI

Tableau

Azure DevOps

Job description

Get AI-powered advice on this job and more exclusive features.

Halo Labs is a future focused, end-to-end data solutions firm - transforming tomorrow, today. Our intelligent and secure technology systems and data driven solutions drive meaningful outcomes and unlock lasting value.

Why work at Halo Labs?

• Leading Innovation: We don’t just solve problems; we illuminate a never-ending stream of innovation.
• Exceptional Perks: Enjoy outstanding perks like a dedicated learning budget, performance bonuses, and comprehensive wellbeing support.
• Remote-First Organisation: Experience the perks of remote work while having the flexibility to travel to client locations throughout Australia.
• Inclusive and Engaging: Celebrate diversity in a welcoming space that thrives on new ideas and open conversations, all in a respectful environment.
• Inspiring Origins: With a compelling founder story, we are a customer-focused, culture-first organisation.

About the Role:

• Framework Development: Design, develop, and enhance in-house PySpark frameworks to ensure standardised implementations and promote reusability across projects.
• Mentorship: Provide technical guidance and mentorship to junior team members, fostering skill development within the analytics community.
• Stakeholder Collaboration: Collaborate with internal and external stakeholders to deliver high-quality, data-driven solutions that meet business needs.
• Data Analysis & Engineering: Conduct exploratory data analysis and design end-to-end data engineering solutions, including ETL/ELT pipelines using Azure Data Framework,Databricks, and other Azure services.
• Pipeline Implementation: Build, test, and deploy scalable data pipelines using Python, PySpark, and Azure services, ensuring adherence to best practices for automated testing, documentation, and CI/CD via Azure DevOps (Git, Azure Pipelines).
• Platform Monitoring: Monitor and support batch operations for the Data and Insights Platform, ensuring reliability and performance.

About You:

• Cloud Expertise: Hands-on experience with Azure Cloud Services, includingDatabricks, Azure Data Factory, Azure SQL Server, and Azure Storage.
• Databricks Proficiency: Strong experience withDatabricksfor big data processing.
• Leveraging Databricks notebooks for collaborative data engineering and analytics.
• Utilising Databricks clusters for scalable and efficient data processing.
• Data Engineering Tools: Proficiency in SQL, Python, and PySpark for data processing and pipeline development.
• Data & Analytics Concepts: Strong understanding of data warehousing, data lakes, ETL/ELT processes, and visualisation/reporting tools (Power BI, Tableau) to drive business value.
• Data Architecture: Deep knowledge of data architecture, data modelling, data marts, and metadata management best practices.
• Modern Data Platforms: Minimum 3 years of experience working with modern data platforms (AWS, Azure) and data engineering, with a focus on Agile delivery methodologies.
• DevOps Practices: Expertise in Azure DevOps, including Git for version control and Azure Pipelines for CI/CD.
• Education: Degree in Computer Science, Data Science, IT, or a related field

While Queensland-based candidates are preferred, outstanding applicants from other locations will also be considered.

You’re interested in this exciting opportunity and feel you’re the right fit please click “apply”

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Business Consulting and Services

Referrals increase your chances of interviewing at Halo Labs by 2x

Sign in to set job alerts for “Data Engineer” roles.

Herston, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 1 month ago

Software Development Engineer - Internship

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 1 month ago

Software Development Graduate (2025, Stores)

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 4 weeks ago

Software Engineer (Typescript/React/Node/AWS)

Brisbane, Queensland, Australia 2 months ago

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 3 weeks ago

Brisbane, Queensland, Australia 1 month ago

Full Stack Web Developer (Flexible Location)

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 3 weeks ago

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 4 weeks ago

Brisbane, Queensland, Australia 4 days ago

Brisbane, Queensland, Australia 1 month ago

Brisbane, Queensland, Australia 1 week ago

Intermediate Software Engineering - Product & Technology

Brisbane, Queensland, Australia 3 days ago

Software Engineer/Team Lead (Typescript/Node/React/AWS)

Brisbane, Queensland, Australia 3 months ago

Brisbane, Queensland, Australia 4 days ago

Software Engineers - AI Team (Typescript/React/Node/AWS)

Brisbane, Queensland, Australia 3 weeks ago

Senior Software Engineer Brisbane, Sydney, Melbourne

Brisbane, Queensland, Australia 1 day ago

Software Development Engineer - Internship

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 4 days ago

Software Engineer - Solutions Engineering

Brisbane, Queensland, Australia 1 week ago

Brisbane City, Queensland, Australia 1 day ago

Brisbane, Queensland, Australia 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.