Databricks Tech Lead

Nityo Infotech Limited; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

Nityo Infotech Limited is seeking a Senior Data Engineer in Sydney, Australia. You will lead engineering pods, drive Databricks-based data pipelines, and shape ingestion architectures for structured and unstructured data.

We value expert PySpark, cloud platform experience (AWS/Azure/GCP), and strong data modeling skills. Stakeholder liaison and translating complex architectures into business value are essential for success in this role.

Qualifications

• 6+ years in data engineering with leadership experience.
• Proficiency in PySpark and Databricks SQL.
• Experience building configurable data ingestion frameworks.
• Strong cloud experience with AWS, Azure or GCP.
• Expertise in data modeling, SCD and data context software practices.
• Excellent stakeholder management and ability to translate tech to business value.

Skills

Data engineering

Leadership

PySpark

Databricks SQL

Data ingestion

AWS

Azure

GCP

Data modeling

SCD

Software engineering

Stakeholder management

Education

Databricks Certification (Data Engineer)

Tools

Kafka

dbt

Delta Live Tables (DLT)

Job description

• Experience: 6+ years in Data Engineering, with at least 3–4 years of hands-on technical leadership experience leading engineering pods.
• Core Databricks & Spark: Advanced proficiency in PySpark and Databricks SQL.
• Ingestion Expertise: Proven experience building custom or highly configurable data ingestion frameworks for structured and unstructured data.
• Cloud Platforms: Strong experience working with AWS, Azure, or GCP cloud-native services (e.g., S3, ADLS).
• Engineering Standards: Deep understanding of data modeling (star/snowflake schemas), SCD (Slowly Changing Dimensions), and software engineering principles in a data context.
• Soft Skills: Excellent stakeholder management and the ability to translate complex technical architectures into business value.

Preferred Qualifications

• Experience with Kafka, dbt, or Delta Live Tables (DLT).
• Databricks Certified Data Engineer Associate/Professional credentials