Remote Senior Backend Engineer - Big Data & Spark

Binance; Albury City; Remote; AUD 120,000 - 170,000; Full time

Benefits offered by this job

Learning budget

Performance bonus

Wellbeing support

Job summary

The role emphasizes secure data integration, collaboration with software engineers, and implementing CI/CD for data workloads. Remote-first with Australian travel to client sites as needed.

Qualifications

• Degree in Computer Science, Engineering, Data Science, or related technical field.

Responsibilities

• Design, develop, and maintain reusable in-house PySpark frameworks for standardized data engineering patterns.
• Architect and implement scalable ETL/ELT pipelines across Azure and AWS.
• Build distributed data processing solutions using Python and PySpark on Databricks.
• Develop batch and near real-time ingestion pipelines integrating healthcare systems and external platforms.
• Design secure data integration patterns ensuring compliance and data integrity.
• Collaborate with Software Engineers to embed data services into the SaaS product architecture.
• Contribute to backend design for scalable data layers, observability, and performance.
• Implement CI/CD pipelines using Azure DevOps, Git, and Azure Pipelines for automated deployment.
• Apply infrastructure-as-code across Azure and AWS.
• Optimize Spark jobs, clusters, and storage strategies for performance and cost.
• Design data models including dimensional models and SaaS schemas.
• Implement data validation, monitoring, and alerting for pipeline reliability.
• Provide technical mentorship and enforce engineering standards.

Skills

Python

SQL

PySpark

Data modeling

ETL/ELT design

CI/CD

Cloud data architecture

Education

Degree in Computer Science, Engineering, Data Science, or related technical field

Tools

Azure Databricks

Azure Data Factory

Azure SQL

Azure Storage

Azure DevOps

AWS S3

Databricks

Job description

The role emphasizes secure data integration, collaboration with software engineers, and implementing CI/CD for data workloads. Remote-first with Australian travel to client sites as needed.