Senior Big Data Engineer - PySpark, Databricks & BI

Tech Mahindra

Sydney

On-site

AUD 130,000 - 180,000

Full time

7 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Tech Mahindra in Sydney is seeking a Developer Programmer with strong hands-on experience in enterprise data warehouse solutions and big data stacks. You will work with Python, PySpark, Java, and DBT to design and optimize data pipelines that feed analytics platforms.

Knowledge of Databricks, Tableau or Power BI, and Azure or AWS will help you implement scalable solutions. You will collaborate with business and IT teams, contribute to test plans, and help advance the DevOps pipeline for CI/CD in

Qualifications

Minimum 4 years of experience in Enterprise Data Warehouse solutions.
Experience with Databricks and Big Data stacks such as Cloudera, HBase Analytics tools like Python, PySpark.
Strong SQL analytical skills.
Experience in Databricks and DBT.
Knowledge in Power BI.
Knowledge of Airflow scheduling is a plus.
Involvement in gathering requirements, analysis, design, solution walkthroughs, workshops and identifying gaps with Business & IT.
Basic knowledge in Spark leveraging Scala or Python and optimizing Spark applications.

Responsibilities

Involve in business requirement gatherings, analysis of requirements, design, solution walkthroughs, workshops and identify gaps in solution with Business & IT team.
Prepare test strategy, test plans, reports, manuals and other documentation on the status, operation and maintenance of Data warehousing applications.
Work on DevOps pipeline and tooling to support CI/CD processes.
Collaborate in an Agile delivery model.