Expression Of Interest – Site Engineer I Data Centre

Cpb; Sydney; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Monthly Lifestyle Allowance

Novated Leasing

Loyalty Leave

Inclusive Parental Leave Policy

Work From Anywhere

Job summary

INGRITY is seeking an experienced Data Engineer to join a major financial services organisation undergoing a significant data modernisation program. You’ll work in a modern Databricks environment, building scalable data pipelines and transforming complex datasets, supporting migration of legacy data platforms to a cloud-based lakehouse architecture.

You will collaborate with data engineers, analysts and stakeholders, ensuring data quality, testing and performance optimisation within a hybrid

Qualifications

• Strong hands‑on experience with Databricks, PySpark and SQL.
• Experience with dbt, Delta Lake and lake house architecture.
• Proven experience developing and maintaining ETL/ELT pipelines.
• Experience with cloud platforms, ideally Azure or AWS.
• Understanding of CI/CD, data testing and production support.
• Experience in insurance or financial services highly regarded.
• Exposure to AI‑assisted development tools such as GitHub Copilot or Databricks Genie advantageous.

Responsibilities

• Design, develop and optimise data pipelines using Databricks, Python/PySpark and SQL.
• Build and maintain data transformations using dbt and Delta Lake.
• Develop scalable data models across Bronze, Silver and Gold layers.
• Support data migration from legacy platforms, including SAS.
• Implement data quality checks, testing and performance optimisation.
• Collaborate with data engineers, analysts and business stakeholders.

Skills

Databricks

PySpark

SQL

dbt

Delta Lake

Lakehouse

ETL/ELT pipelines

Azure or AWS

insurance / financial services

GitHub Copilot or Databricks Genie

Tools

Python

Job description

Location & Contract

Location: Sydney / Brisbane (Hybrid)

Contract: 12 Months

Industry: Financial Services / Insurance

Key Responsibilities

• Design, develop and optimise data pipelines using Databricks, Python/PySpark and SQL .
• Build and maintain data transformations using dbt and Delta Lake .
• Develop scalable data models across Bronze, Silver and Gold layers.
• Support data migration from legacy platforms, including SAS.
• Implement data quality checks, testing and performance optimisation.
• Collaborate with data engineers, analysts and business stakeholders.

Skills & Experience

• Strong hands‑on experience with Databricks, PySpark and SQL .
• Experience with dbt, Delta Lake and lake house architecture .
• Proven experience developing and maintaining ETL/ELT pipelines.
• Experience with cloud platforms, ideally Azure or AWS .
• Understanding of CI/CD, data testing and production support.
• Experience in insurance or financial services highly regarded.
• Exposure to AI‑assisted development tools such as GitHub Copilot or Databricks Genie advantageous.

Why Join?

• Modern Databricks and cloud technology environment.
• Collaborative engineering team with hybrid flexibility.
• Opportunity to contribute to AI‑enabled data engineering practices.

Essential Criteria

1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. 50%
2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL. 25%
3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. 25%

Desirable Criteria

1. Experience working with Azure Data Factory and Databricks.
2. Experience/Knowledge of working with Data Lake and Lakehouses.

Additional Requirements

• Australian Citizens residing in Australia only respond.
• Must hold a valid Baseline security clearance or be willing and eligible to obtain one.
• To be considered for this position, candidates must be legally authorised to work in Australia on a permanent basis without any restrictions.

Additional Local Benefits

• Monthly Lifestyle Allowance: Contribution towards health and wellbeing activities like gym memberships.
• Novated Leasing: Pre‑tax car leasing benefit for new and used cars.
• Loyalty Leave: Receive an additional day of leave on your 3rd, 4th, and 5th work anniversaries, accumulating up to a maximum of 3 extra days of leave per year.
• Inclusive Parental Leave Policy: 12 weeks of primary carer’s leave and 4 weeks of secondary carer’s leave.
• Work From Anywhere: In addition to our hybrid working policy, we also offer 20 days of working from anywhere per year. Ideal for an extended trip to get away from the city or visiting loved ones.

Ingrity – Data Engineer Opportunity

INGRITY is seeking an experienced Data Engineer to join a major financial services organisation undergoing a significant data modernisation program.

You’ll work within a modern Databricks environment, building scalable data pipelines, transforming complex datasets and supporting the migration of legacy data platforms to a cloud‑based lakehouse architecture.

Key Responsibilities

• Design, develop and optimise data pipelines using Databricks, Python/PySpark and SQL .
• Build and maintain data transformations using dbt and Delta Lake .
• Develop scalable data models across Bronze, Silver and Gold layers.
• Support data migration from legacy platforms, including SAS.
• Implement data quality checks, testing and performance optimisation.
• Collaborate with data engineers, analysts and business stakeholders.

Skills & Experience

• Strong hands‑on experience with Databricks, PySpark and SQL .
• Experience with dbt, Delta Lake and lake house architecture .
• Proven experience developing and maintaining ETL/ELT pipelines.
• Experience with cloud platforms, ideally Azure or AWS .
• Understanding of CI/CD, data testing and production support.
• Experience in insurance or financial services highly regarded.
• Exposure to AI‑assisted development tools such as GitHub Copilot or Databricks Genie advantageous.

Why Join?

• Modern Databricks and cloud technology environment.
• Collaborative engineering team with hybrid flexibility.
• Opportunity to contribute to AI‑enabled data engineering practices.

Responsibilities

• Embedded within one of our line‑of‑business data and reporting teams, you will collaborate with stakeholders to understand their data objectives and champion the use and evolution of the central data platform.
• You will work within a domain‑aligned data product team consisting of line‑of‑business data owners and SMEs working alongside engineering resources provided by Technology.
• You will be hands‑on in the ingestion of ASX’s core data assets by the product teams, their curation into source‑aligned data products and the creation of consumable products in the form of files, reports, dashboards and APIs.
• You will form part of a data engineering practice and community that will design and drive the adoption of standards, frameworks and best practices.
• You will ensure data pipelines and products are designed and built to be run within a critical market infrastructure environment by the persistent product teams who build them.

Your Experience and Qualifications

• A hands‑on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics and distribution.
• Good knowledge of data modelling and how to structure data within a data warehousing environment, while following best practice data management standards.
• Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
• Experience in real time streaming using Confluence Kafka and AWS services.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift and DataZone.
• Experience in Data visualisation tools such as Tableau/Power BI/QuickSight.
• Solid experience in Python, Spark and Terraform/Terragrunt.

Your Experience and Qualifications (repeated section)

• A hands‑on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics and distribution.
• Good knowledge of data modelling and how to structure data within a data warehousing environment, while following best practice data management standards.
• Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
• Experience in real time streaming using Confluence Kafka and AWS services.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift and DataZone.
• Experience in Data visualisation tools such as Tableau/Power BI/QuickSight.
• Solid experience in Python, Spark and Terraform/Terragrunt.

Nice to Have

• Experience working within a platform/product operating model where frameworks and development kits are leveraged to achieve standardisation, re‑use and scale.
• A working knowledge of data mesh/data product concepts with federated data ownership at the domain‑level but operating on centralised platforms and governance.
• Experience working in Capital Markets domain and understanding of derivative products.

Responsibilities (duplicate)

• Embedded within one of our line‑of‑business data and reporting teams, you will collaborate with stakeholders to understand their data objectives and champion the use and evolution of the central data platform.
• You will work within a domain‑aligned data product team consisting of line‑of‑business data owners and SMEs working alongside engineering resources provided by Technology.
• You will be hands‑on in the ingestion of ASX’s core data assets by the product teams, their curation into source‑aligned data products and the creation of consumable products in the form of files, reports, dashboards and APIs.
• You will form part of a data engineering practice and community that will design and drive the adoption of standards, frameworks and best practices.
• You will ensure data pipelines and products are designed and built to be run within a critical market infrastructure environment by the persistent product teams who build them.

Your Experience and Qualifications (duplicate)

• A hands‑on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics and distribution.
• Good knowledge of data modelling and how to structure data within a data warehousing environment, while following best practice data management standards.
• Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
• Experience in real time streaming using Confluence Kafka and AWS services.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift and DataZone.
• Experience in Data visualisation tools such as Tableau/Power BI/QuickSight.
• Solid experience in Python, Spark and Terraform/Terragrunt.

Nice to Have (duplicate)

• Experience working within a platform/product operating model where frameworks and development kits are leveraged to achieve standardisation, re‑use and scale.
• A working knowledge of data mesh/data product concepts with federated data ownership at the domain‑level but operating on centralised platforms and governance.
• Experience working in Capital Markets domain and understanding of derivative products.

Any stakeholders

At ASX Group, we support flexible working and offer hybrid working options. Even if our roles are advertised as full‑time, we encourage you to apply if you are interested in part‑time or other flexible working arrangements.

We will arrange for successful candidates to have background checks, including reference and police checks, completed as part of the on‑boarding process.

To be considered for this position, candidates must be legally authorised to work in Australia on a permanent basis without any restrictions.

Focus on Hiring

We make hiring decisions based on your skills, capabilities and experience, and how you’ll help us to live our values. We encourage you to apply even if you don’t meet all the criteria of this role.

If you need any adjustments during the application or interview process to help you present your best self, please let us know.

ASX: Powering Australia's financial markets

When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a fair and dynamic marketplace for all.

In your new role, you’ll be part of a leading global securities exchange with a strong brand. We are known for being a trusted market operator and an exciting data hub.