Senior Big Data Backend Engineer - Remote-First Databricks

Binance; Port Macquarie; Remote; AUD 120,000 - 160,000; Full time

Benefits offered by this job

Learning budget

Performance bonuses

Wellbeing support

Remote-first with travel across AU

Job summary

We are seeking a data engineer to design, develop, and maintain PySpark-based pipelines across Azure and AWS, build scalable Databricks workloads, and mentor the analytics team in best practices for data quality and observability.

Qualifications

• Degree in CS, engineering, data science, or related field.
• Strong Python, SQL, and PySpark experience.
• Experience building production data pipelines in SaaS or product teams.
• Familiarity with Azure and AWS cloud data services.
• Knowledge of data modelling, data governance, and metadata management.

Responsibilities

• Design, develop, and maintain PySpark-based data pipelines across Azure and AWS.
• Architect scalable ETL/ELT solutions for SaaS platforms.
• Build Databricks workloads and optimize Spark performance.
• Implement secure data integration using APIs, SFTP, and webhooks.
• Collaborate with software engineers to embed data services in the product.
• Establish CI/CD pipelines for data workloads and infrastructure as code.

Skills

Python

SQL

PySpark

Databricks

Azure

AWS

CI/CD

DevOps

Data modeling

Data governance

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Tools

Databricks

Azure Data Factory

Azure SQL

Azure Storage

S3

Lambda

RDS

Glue

IAM

Job description

We are seeking a data engineer to design, develop, and maintain PySpark-based pipelines across Azure and AWS, build scalable Databricks workloads, and mentor the analytics team in best practices for data quality and observability.