Data Engineer

Colonial First State; Sydney; On-site; AUD 120,000 - 150,000; Full time

Benefits offered by this job

Birthday leave

Employer superannuation

Life leave 3 days a year

Mental health support app (Sonder)

Health insurance with BUPA

Counselling services

Job summary

Colonial First State (CFS) is seeking a Data Engineer within the AI & Data division in Sydney. You will design, build and operate scalable data products, focusing on high availability, performance and security of data environments.

Role requires strong Python, PySpark and SQL skills, and experience with Azure Databricks, ADF, Unity Catalog and Terraform to manage CI/CD pipelines and data pipelines. This is a hands-on role within a high-impact data team.

Qualifications

• Proven experience as a data engineer with scalable, secure data products.
• Experience with cloud-based data platforms and governance.
• Knowledge of Databricks and Azure data services is essential.

Responsibilities

• Provide technical solutions to enhance data engineering capabilities.
• Ensure high availability, performance, and security of data environments.
• Develop and productionize code artefacts; maintain documentation and tests.
• Collaborate with project teams to review code changes and adhere to standards.
• Deliver data warehouse solutions aligned with stakeholder needs.

Skills

Data engineering

Azure Databricks

Python

PySpark

SQL

CI/CD pipelines

Terraform

Databricks Unity Catalog

Azure Data Factory

ADLS

Security controls

Data governance

Data model implementation

Data orchestration

Cloud

Tools

Azure DevOps

GitHub

Terraform

Job description

Are you ready to be part of an organisation that values expertise, passion and diversity? At CFS we know that the foundation of our success lies in our exceptional people. We believe in celebrating individuality, have a passion for high performance and creating an environment where you can unleash your full potential. Our people enable us to make a difference and deliver exceptional experiences to help our customers achieve financial freedom.

Your Team

The AI & Data division is charged with transforming CFS through end-to-end delivery of data programs and projects. AI & Data closely works across the whole of CFS to bring together the capabilities needed to deliver change that matters to our customers and to our people. This role is part of the Group Data & Analytics domain, a high-impact team with accountability spanning across the Data Engineering space.

Your Responsibilities

• Your role will provide technical solutions to enhance our data engineering capabilities, ensuring high availability, performance, and security of our data environments.
• Resolve any challenges using domain knowledge and contribute to engineering outputs to a production level quality, through the production of code artefacts.
• This role combines operational mindset with a focus on data engineering solutions to drive insight and decision-making capabilities across the organisation.
• Collaborate with project teams to review and guide code changes, ensuring alignment with best practices and architectural standards.
• Produce engineering outcomes that meet the teams Ways of Working including all documentation, unit testing coverage, code within quality scores, completing acceptance target.
• Alignment to technology frameworks and processes agreed by the team that are used within the engagement.
• Collaborating with stakeholders across the organisation to understand their data requirements and ensure that the data warehouse meets their needs.

Your Capability and Experience

• Proven experience as a data engineer with relevant experience in designing, building and managing scalable, secure and high-performance data products
• Understanding of cloud-based data engineering principles, data governance and modern data platform architectures.
• Experience with Azure Databricks, Databricks Unity Catalog, Databricks AI suite, Azure Data Factory, ADLS and Azure Functions.
• Proven ability to develop and manage CI/CD pipelines (Azure DevOps/GitHub), Terraform for application deployments.
• Skilled in Python, PySpark, DataFrames and SQL for data engineering, including reusable libraries and scalable ingestion patterns.
• Familiarity with data orchestration and large-scale ingestion patterns
• Experience in Data Model implementation.
• Knowledge of data governance, metadata management, data lineage, and information security controls.
• Knowledge of medallion architecture in Databricks
• Familiarity with Databricks AI features such as AI workload optimisation and model inference
• Experience in Financial services sector

What to Expect

At CFS, you'll be working among the very best in the wealth management industry. It's an inspiring environment that encourages development and celebrates success. Other things to look forward to:

• Additional day for your birthday
• Access to CFS Employer Super
• Life Leave - 3 days per annum
• Access to Sonder who provides human-powered medical, mental health and safety support through one easy-to-use app enabling you to get support whenever and wherever you need.
• Access to Corporate rates with BUPA Health Insurance
• Confidential coaching and counselling services supporting life, mind, body, relationships, work and family to assist you in taking charge of your own health and wellbeing

CFS Culture

At CFS we are committed to creating a thriving environment where individuals can flourish. We believe that success is built upon strong teams, and we are dedicated to celebrating uniqueness, championing individuality and supporting a diverse and inclusive workforce. We believe that when you can truly be yourself, you can unlock your full potential.

Please note, CFS requires all candidates to have full work rights in Australia.

Where we have preferred candidates, background checks (including Police, Employment, Bankruptcy checks, ASIC banned and disqualified persons) will be completed prior to the final preferred candidate's employment being confirmed. The outcomes of the background checks do not preclude the preferred candidate, however, they will be assessed against the inherent requirements of the role.

This role is based on Gadigal Land (Sydney).