Senior Data Engineer — Azure Databricks & ETL Pipelines

Tech Mahindra; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

Tech Mahindra is seeking a seasoned Data Engineer in Australia to design, build, and scale data platforms and ETL pipelines using PySpark, SQL, and Azure Databricks.

With 5+ years of experience, you will develop end-to-end data ingestion, transformation, and data warehousing solutions, optimize performance, and ensure data quality.

You will work closely with architects, testers, and business stakeholders on cloud-based projects, including ADLS, Airflow, and Spark-powered solutions.

Qualifications

• 5+ years of hands-on data engineering experience.
• Proficient in designing scalable ETL/ELT pipelines.
• Strong knowledge of data warehousing concepts and modeling.

Responsibilities

• Design, build and maintain scalable data platforms and pipelines.
• Collaborate with stakeholders to deliver robust data solutions in cloud environments.

Skills

PySpark

SQL

Data Warehousing

ETL/ELT Development

Data Modeling

Data Integration

Tools

Databricks

Airflow

Azure

ADLS

Spark

Job description

Tech Mahindra is seeking a seasoned Data Engineer in Australia to design, build, and scale data platforms and ETL pipelines using PySpark, SQL, and Azure Databricks.

With 5+ years of experience, you will develop end-to-end data ingestion, transformation, and data warehousing solutions, optimize performance, and ensure data quality.

You will work closely with architects, testers, and business stakeholders on cloud-based projects, including ADLS, Airflow, and Spark-powered solutions.