Senior Backend Data Engineer - Spark, PySpark ETL (Remote)

Binance; North Lismore; Remote; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Learning budget

Performance bonuses

Wellbeing support

Job summary

Join a remote-first organisation with a focus on innovation and strong learning budgets, offering performance bonuses and wellbeing support. A degree in a technical field is required and collaboration with software engineers is essential.

Qualifications

• Proven experience designing and building scalable ETL/ELT pipelines.
• Hands-on with Databricks and PySpark in production.
• Experience with cloud data architectures (lakehouse, data lakes).
• Experience in healthcare or regulated data environments is a plus.
• Strong data modeling and governance understanding.

Responsibilities

• Design, develop, and maintain reusable PySpark frameworks.
• Architect scalable ETL/ELT pipelines across Azure and AWS.
• Build distributed data processing using Python/PySpark on Databricks.
• Develop ingestion pipelines from third-party systems and APIs.
• Ensure data integrity with secure integration patterns.
• Collaborate with software engineers to embed data services.
• Implement CI/CD for data workloads with Azure DevOps.
• Mentor team and uphold engineering standards.

Skills

Python

PySpark

SQL

Data Modeling

Distributed Data Processing

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Tools

Databricks

Azure Data Factory

Azure SQL

Azure Storage

Azure DevOps

AWS S3

AWS Lambda

AWS Glue

Job description

Join a remote-first organisation with a focus on innovation and strong learning budgets, offering performance bonuses and wellbeing support. A degree in a technical field is required and collaboration with software engineers is essential.