Freelance Data Scraping Engineer (Python)

Mindrift; Toowoomba Regional; Remote; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Dedicated learning budget

Performance bonuses

Wellbeing support

Job summary

You will work in a remote-first environment with travel to client locations across Australia, contributing to architecture discussions and implementing CI/CD pipelines for automated deployment and testing of data workloads.

Qualifications

• Strong hands-on experience with Azure Databricks and Databricks platform
• Advanced proficiency in Python, PySpark, and SQL for large-scale data processing
• Experience building production-ready data pipelines and ETL/ELT workflows

Responsibilities

• Design, develop, and maintain reusable in-house PySpark frameworks across SaaS platform
• Architect scalable ETL/ELT pipelines in Azure and AWS
• Build distributed data processing with Python and PySpark on Databricks
• Develop batch and real-time ingestion pipelines from healthcare systems and external platforms
• Design secure data integration patterns (APIs, SFTP, webhooks) ensuring data integrity

Skills

Azure Databricks

Python

PySpark

SQL

APIs

CI/CD

Azure DevOps

Education

Degree in Computer Science, Engineering, Data Science, or related field

Tools

Databricks

Job description

Job Description

About Us

Halo Labs is a future focused, end-to-end data solutions firm – transforming tomorrow, today. Our intelligent and secure technology systems and data driven solutions drive meaningful outcomes and unlock lasting value.

Why work at Halo Labs?

Leading Innovation: We don’t just solve problems; we illuminate a never-ending stream of innovation.

Exceptional Perks: Enjoy outstanding perks like a dedicated learning budget, performance bonuses, and comprehensive wellbeing support.

Remote-First Organisation: Experience the perks of remote work while having the flexibility to travel to client locations throughout Australia.

Inclusive and Engaging: Celebrate diversity in a welcoming space that thrives on new ideas and open conversations, all in a respectful environment.

Inspiring Origins: With a compelling founder story, we are a customer-focused, culture-first organisation.

About the role

• Design, develop, and maintain reusable in-house PySpark frameworks to enforce standardised data engineering patterns across the SaaS platform
• Architect and implement scalable, production-grade ETL/ELT pipelines across Azure and AWS environments
• Build distributed data processing solutions using Python and PySpark on Databricks
• Develop batch and near real-time ingestion pipelines integrating third‑party clinical systems, healthcare APIs, and external enterprise platforms
• Design secure data integration patterns (REST APIs, SFTP, event‑driven ingestion, webhooks) ensuring compliance and data integrity
• Work closely with Software Engineers to embed data services directly into the SaaS product architecture
• Contribute to backend system design discussions to ensure data layer scalability, observability, and performance
• Implement CI/CD pipelines using Azure DevOps, Git, and Azure Pipelines for automated deployment and testing of data workloads
• Apply infrastructure‑as‑code and environment management best practices across Azure and AWS
• Optimise Spark jobs, cluster configurations, and storage strategies for performance and cost efficiency
• Design and maintain robust data models, including dimensional models and SaaS‑oriented data schemas
• Implement data validation, monitoring, and alerting to ensure pipeline reliability and production stability
• Provide technical mentorship and enforce engineering standards across the analytics and data engineering team

About you

• Strong hands‑on experience with Azure services including Databricks, Azure Data Factory, Azure SQL, Azure Storage, and Azure DevOps
• Practical experience with AWS services relevant to modern data platforms (S3, Lambda, RDS, Glue, IAM, etc.)
• Advanced proficiency in Python, SQL, and PySpark for large‑scale distributed data processing
• Deep experience configuring and managing Databricks clusters for scalable big data workloads
• Experience building production‑ready data pipelines in a SaaS or product‑led engineering environment
• Strong understanding of cloud‑native data architecture, including data lakes, lakehouse architecture, and modular pipeline design
• Experience integrating with third‑party systems via APIs and secure data exchange mechanisms
• Exposure to healthcare or regulated data environments, including handling sensitive data securely
• Strong knowledge of data modelling, metadata management, and data governance principles
• Experience implementing automated testing frameworks for data pipelines
• Solid understanding of DevOps practices including Git workflows, branching strategies, and CI/CD automation
• Degree in Computer Science, Engineering, Data Science, or related technical field

Earn money from Home by Participating in Surveys - Data Entry - Customer Service Representative - Part‑time

We are trying to find people across the country to join paid surveys.

We provide you the chance to gain additional earnings at home (remotely) and additionally to determine your own involvement schedule. At this work, you will be doing numerous tasks such as data entry, doing e‑mail response, reviews, studies as well as other online tasks.

This work from home opportunity is really rewarding and will help shape the market as well as influence brand‑new products involving market. Sometimes you will also get to see items prior to the public and also take part in evaluating them. You'll be helping companies gather information to help forecast trends and also influence future organisation choices based on the info provided.

• Earn by taking polls
• Various payment methods, including Paypal, direct check, or online digital gift card codes
• Part‑time
• Work remotely and gain extra income from home.

Earn at Home by Taking Polls -Data Entry Clerk - Customer Service Rep - Work From Home & Part Time

We are looking for people nationwide to participate in polls.

We offer you the opportunity to earn extra income from home (teleworking) and also to decide your own participation schedule. At this job, you will be performing various tasks such as data entry, performing email response, reviews, polls and other online projects.

This work at home opportunity is very rewarding and will help shape the marketplace and influence new products coming to market. In some cases you will even get to see products before the general public and even participate in testing them. You’ll be helping companies collect data to help forecast trends and make future business decisions based on the information provided.

• - Earn by taking surveys
• Various payment methods, including Paypal, direct check, or online virtual gift card codes
• - Part Time

Earn cash at Home by Participating in Paid Studies - Data Entry agent - Customer Service Agent - Part‑time

We are seeking people across the country to join paid surveys.

We provide you the chance to make extra income from home (remotely) and also to choose your own participation schedule. At this task, you will be executing various jobs such as data entry, executing email response, evaluations, studies and other on‑line tasks.

This work from home possibility is extremely rewarding and also will certainly help shape the industry and affect new products coming to market. Sometimes you will even get to see products prior to the public and also take part in testing them. You'll be helping firms accumulate data to help forecast trends and influence future business choices based upon the info provided.

• - Earn money taking polls. Up to $35 per completed survey!
• Different payment methods, including Paypal, straight check, or on‑line digital gift card codes
• - Part Time
• - Work remotely and earn additional income at home.

Data entry clerks originate from all different backgrounds including, data entry, telemarketing, customer support, sales, clerical, assistant, administrative assistant, assistant, call facility, part‑time.

The DevOps Team at Enosi is responsible for the development of Enosi’s Powertracer Platform. At Enosi, the developers also own the operational support of the platform.

We have rewritten Powertracer to scale to over a hundred thousand households, businesses and generation sources, trading their energy and delivering traceability of supply to customers. At this scale we will be responsible for delivering the trading and tracing between supply and demand of electrical energy in the gigawatt hours a year range.

If you are ready to challenge an industry that has long lagged behind the innovation curve, and be part of driving emissions to true zero, we want to hear from you.

We are looking for recent university graduates, with a degree in software engineering, electrical engineering, telecommunications engineering or computer science, or if you have undertaken an alternative “learn to code”. You will join us as an Associate Engineer, with six month rotations in the different engineering domains:

• Infrastructure and observability engineering
• At the completion of the three rotations, you will have the opportunity to progress to a software or infrastructure engineer role in an area that interests you (notwithstanding business needs).

Examples of problems you’ll be solving

• Introducing new React components to Powertracer’s frontend
• Owning the introduction of new API features in our microservices
• Integrating new API features from microservices through the GraphQL interface for presentation in the front end
• Refining the observability capabilities across all services, including the front end
• Refactoring Terraform modules used in the deployment of infrastructure an applications

You are great because…

• You’ve completed your degree or coursework in software engineering or related field
• You’ve shown your interest in your career path through personal projects that go beyond the requirements of your education program
• You may have some professional software engineering experience, between one and two years
• You understand the importance of maintaining source code, in particular using git repositories (we’re a Github team)
• You are aware of the software development life cycle, particularly in a culture of continuous deployment (we love Buildkite)
• You understand the importance of clear documentation, and are willing to contribute to it
• You’ve had experience working with cloud service providers (we use AWS, but the principles apply across the major providers)
• You’ve learnt a little (or a lot) about how Terraform can make life easier
• You’ve learnt a little (or a lot) about Go, and how it can be leveraged in serverless and container solutions
• You’ve learnt a little (or a lot) about React and GraphQL, especially if you’ve built some projects with it
• You’ve spent time working with Atlassian’s Jira and Confluence products
• You’re comfortable working remotely, communicating primarily over Slack (chat, voice and video)

You can show us your technical experience

We will want to understand more about your skills, including your engineering track record, experience across the software development lifecycle, agile methods, devops, incorporation of testing. Having some example work that could be reviewed would be appreciated.

We are looking for people who are motivated to participate in paid research across the country and local areas. Join this Work from Home Australia Market Research Panel Today.

You have two options when it comes to paid research : you can either take part in person or online. This is a great way for you to make extra income at home as data entry clerk.

Compensation:

Work from home and take surveys to earn Money.

There are many payment options, including PayPal, direct checks, and online virtual gift cards codes.

Opportunities to earn rewards.

Responsibilities:

Take part with work from home surveys/studies by following written and oral instructions.

Participate in research focus groups.

Each panel receives a complete written study.

If products or services are provided, you must actually use them.

Needs:

• You must have a working camera on your smart