Azure Databricks Data Engineer: Real-Time ETL Pipelines

Renaissance Infosystems Pte Ltd; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Renaissance Info Systems is hiring a Data Engineer for Azure Databricks in Sydney. You will design, build, and optimize scalable data pipelines using Spark (Scala) and SQL, and implement ETL/ELT processes on Azure Databricks.

The role requires hands-on development experience with real-time data integration, data warehousing concepts, and CI/CD practices. Permanent, on-site position based in Sydney.

Qualifications

• Proven hands-on experience with Azure Databricks, Spark (Scala) and SQL to design data pipelines.
• Strong Python skills and ability to implement ETL/ELT processes on the Azure platform.
• Experience with real-time/near real-time data integration and CI/CD pipelines.

Skills

Azure Databricks

Scala Spark

SQL

Python

Tools

Databricks

Data warehousing

Azure

GitHub

Job description

Renaissance Info Systems is hiring a Data Engineer for Azure Databricks in Sydney. You will design, build, and optimize scalable data pipelines using Spark (Scala) and SQL, and implement ETL/ELT processes on Azure Databricks.

The role requires hands-on development experience with real-time data integration, data warehousing concepts, and CI/CD practices. Permanent, on-site position based in Sydney.