Data Platform Engineer - Python, Spark, Databricks & AWS

Tech Mahindra; Australia; On-site; AUD 120,000 - 160,000; Full time

Job summary

Tech Mahindra in Australia is seeking a Developer Programmer with strong experience in Enterprise Data Warehouse solutions and modern big data stacks. The role requires expertise in Python, PySpark, Java, Databricks, DBT, AWS, Tableau and Power BI, and Airflow.

You will collaborate with IT and business teams to analyze requirements, design scalable data solutions, and drive implementation in a fast-paced environment across on-premise and cloud platforms.

Qualifications

• Minimum 4 years of experience in Enterprise Data Warehouse solutioning.
• Exposure to Databricks and Big Data stacks like Cloudera or HBase.
• Strong SQL analytical skills and data modeling experience.
• Experience with Databricks and DBT in production.
• Knowledge of Power BI and Tableau for data visualization.
• Experience working in Agile delivery and with ERP/BI integration.

Responsibilities

• Involve in business requirement gatherings, analysis of requirements, design and solution walkthroughs.
• Lead workshops to identify gaps between solution and business requirements with IT teams.
• Optimize Spark-based data processing; leverage Python/Scala for data transformation.
• Develop and maintain ETL/ELT pipelines; support CI/CD for data apps.
• Prepare technical documentation, test strategies, and performance tuning.

Skills

Python

PySpark

Java

SQL

Spark

Power BI

Tools

DBT

AWS

Tableau

Databricks

Airflow

Job description

Tech Mahindra in Australia is seeking a Developer Programmer with strong experience in Enterprise Data Warehouse solutions and modern big data stacks. The role requires expertise in Python, PySpark, Java, Databricks, DBT, AWS, Tableau and Power BI, and Airflow.

You will collaborate with IT and business teams to analyze requirements, design scalable data solutions, and drive implementation in a fast-paced environment across on-premise and cloud platforms.