Senior Backend Engineer - Big Data & PySpark (Remote)

Binance

Mackay Regional

Remote

AUD 140,000 - 170,000

Full time

4 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Dedicated learning budget

Performance bonuses

Comprehensive wellbeing support

Job summary

You will collaborate with software engineers to embed data services into the product and enhance data layer performance, observability, and reliability while applying infrastructure-as-code practices across cloud environments.

Qualifications

Hands-on experience with Azure Databricks and data factory services.
Strong Python, SQL, and PySpark for large-scale data processing.
Experience building production-grade ETL/ELT pipelines in cloud environments.
Experience with data lakes, lakehouse architecture, and modular pipelines.
Experience integrating with third-party systems via secure APIs.

Responsibilities

Design, develop, and maintain reusable PySpark frameworks for standardized data engineering.
Architect and implement scalable ETL/ELT pipelines across Azure and AWS.
Build distributed data processing solutions on Databricks using Python and PySpark.
Develop ingestion pipelines integrating healthcare APIs and external platforms.
Design secure data integration patterns ensuring data integrity.
Collaborate with software engineers to embed data services into the SaaS product.
Contribute to backend design for scalable data layer, observability, and performance.
Implement CI/CD pipelines for automated deployment and testing of data workloads.
Apply infrastructure-as-code and environment management across cloud providers.
Optimize Spark jobs, cluster configs, and storage strategies.