261312 : Developer Programmer

Tech Mahindra; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

Tech Mahindra is seeking a seasoned Data Engineer in Australia to design, build, and scale data platforms and ETL pipelines using PySpark, SQL, and Azure Databricks.

With 5+ years of experience, you will develop end-to-end data ingestion, transformation, and data warehousing solutions, optimize performance, and ensure data quality.

You will work closely with architects, testers, and business stakeholders on cloud-based projects, including ADLS, Airflow, and Spark-powered solutions.

Qualifications

• 5+ years of hands-on data engineering experience.
• Proficient in designing scalable ETL/ELT pipelines.
• Strong knowledge of data warehousing concepts and modeling.

Responsibilities

• Design, build and maintain scalable data platforms and pipelines.
• Collaborate with stakeholders to deliver robust data solutions in cloud environments.

Skills

PySpark

SQL

Data Warehousing

ETL/ELT Development

Data Modeling

Data Integration

Tools

Databricks

Airflow

Azure

ADLS

Spark

Job description

Designation / Job title :

261312-Developer Programmer

Primary or Mandatory skills :-

• PySpark
• SQL
• Data Warehousing
• ETL/ELT Development
• Data Modeling
• Data Integration

Good to have skills :

Databricks, SQL, Python, Data warehousing concepts

Detailed Job description : -

• Experienced Data Engineer with 5+ years of expertise in designing, developing, and maintaining scalable data platforms and ETL pipelines. Specialized in Azure Cloud technologies, Databricks, PySpark, SQL, and Big Data processing. Proven experience in building end-to-end data ingestion and transformation frameworks, handling large-scale datasets, ensuring data quality, and optimizing performance.
• Worked extensively on Azure Databricks, ADLS, Airflow, and Spark-based solutions for enterprise clients, including 1.5 years of onsite engagement with Optus Australia. Skilled in data migration, data warehousing, pipeline orchestration, cloud modernization, and analytics enablement. Experienced in collaborating with business stakeholders, architects, testers, and cross-functional teams to deliver robust data solutions.