Senior Backend Engineer – Big Data & Spark (Remote)

Binance; Queensland; Remote; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Learning budget

Performance bonuses

Wellbeing support

Job summary

You will work on ingestion pipelines with third-party systems, design secure data integration patterns, and collaborate with engineers to embed data services into the product while optimising performance and reliability.

Qualifications

• Experience with Azure Databricks and Azure Data Factory.
• Proficient in Python, SQL, and PySpark for distributed data processing.
• Experience building production-ready data pipelines in a SaaS/product environment.
• Strong understanding of cloud-native data architectures (lakehouse, data lakes).
• Degree in Computer Science, Engineering, Data Science, or related field.

Responsibilities

• Design, develop, and maintain reusable in-house PySpark frameworks for standardised data patterns.
• Architect and implement scalable ETL/ELT pipelines across Azure and AWS.
• Build distributed data processing solutions using Python and PySpark on Databricks.
• Develop ingestion pipelines integrating third-party clinical systems and healthcare APIs.
• Design secure data integration patterns ensuring data integrity and compliance.
• Collaborate with software engineers to embed data services in the SaaS product.

Skills

Azure Databricks

PySpark

Python

SQL

Data pipelines

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Tools

Azure Data Factory

AWS S3

Git / CI-CD tools

Job description

You will work on ingestion pipelines with third-party systems, design secure data integration patterns, and collaborate with engineers to embed data services into the product while optimising performance and reliability.