Senior Data Engineer: Scalable Pipelines & AI-Driven Data

Commonwealth Bank; City of Melbourne; On-site; AUD 120,000 - 170,000; Full time

Job summary

Commonwealth Bank is seeking a Staff Data Engineer in Melbourne to design and deliver scalable, secure data solutions across pipelines, ontologies and data products. You will automate development, deployment, testing and ongoing management of dashboards and analytics.

You will mentor engineers, implement data quality and governance, and lead complex data projects leveraging Python and SQL with cloud platforms and MLOps awareness.

Qualifications

• Strong experience in data engineering and large-scale data platforms.
• Advanced Python and/or R programming with strong SQL capability.
• Experience building production-grade batch or streaming pipelines.
• Experience automating data and analytical product lifecycles.
• Experience with data modeling, ontologies or semantic data layers.
• Exposure to MLOps and productionisation of ML models.

Responsibilities

• Design and build scalable batch, streaming and analytical data pipelines.
• Transform data into trusted, reusable datasets for dashboards.
• Create curated data layers and reusable data products for analytics.
• Automate the dashboard data lifecycle, including testing and deployment.
• Build CI/CD pipelines using GitHub Actions.
• Design data models, ontologies and common data definitions.
• Implement data matching, entity resolution, and data cleansing.
• Ensure data solutions meet security, privacy, resilience and governance.
• Lead engineering standards and mentor engineers.

Skills

Data engineering

Python

SQL

CI/CD

GitHub Actions

Big data

MLOps

Data modelling

Cloud platforms

Mentoring

Security & governance

Automation

Entity resolution

Tools

GitHub Actions

Job description

Commonwealth Bank is seeking a Staff Data Engineer in Melbourne to design and deliver scalable, secure data solutions across pipelines, ontologies and data products. You will automate development, deployment, testing and ongoing management of dashboards and analytics.

You will mentor engineers, implement data quality and governance, and lead complex data projects leveraging Python and SQL with cloud platforms and MLOps awareness.