Data Engineer

Optus Enterprise; Australia; Hybrid; AUD 110,000 - 170,000; Full time

Benefits offered by this job

Employee discounts

Flexible/hybrid work

On-site facilities

Parental leave

Wellbeing support

Training and development

Job summary

Optus, a leading Australian telecommunications company, is seeking a Data Engineer to build scalable data platforms powering scam detection capabilities. You will design and operate data pipelines from telecom event data, enabling trusted insights for fraud prevention and customer protection.

The role emphasizes hands-on SQL/Python with Databricks and Delta Lake, and collaboration with ML and software teams.

Qualifications

• 3+ years designing and operating production-grade data pipelines at scale.

Responsibilities

• Build and maintain scalable data ingestion pipelines for high-volume telecom event data.
• Design and manage Bronze, Silver and Gold Delta Lake architectures.
• Develop data transformation pipelines for scam detection and ML models.
• Ensure data quality with validation, monitoring, and schema management.
• Optimize Databricks and Delta Lake environments for scalability and reliability.
• Implement data governance controls including lineage, access, and retention policies.
• Collaborate with ML Engineers, Software Engineers and stakeholders to deliver data solutions.

Skills

SQL

Python

Databricks

Spark/PySpark

Delta Lake

Data pipelines

Data governance

Cross-functional collaboration

Tools

Databricks

Apache Spark

Delta Lake

Job description

Optus is an Australian telecommunications company, delivering more than 11 million services to our customers every day across mobile, broadband, and digital solutions.

Join us as a Data Engineer and play a pivotal role in building the data foundation that powers Optus' next-generation scam detection capabilities. Working within the Data Protection & Email Security team, you'll design and operate scalable data platforms that transform vast volumes of telecommunications event data into trusted insights, helping identify, prevent and disrupt scams before they impact customers. This role is ideally suited to an experienced data engineer from a fraud, financial crime, AML or scam prevention background who is passionate about using data to solve real-world customer protection challenges.

What You’ll Do

• Build and maintain scalable data ingestion pipelines that process high-volume telecommunications event data and power the Scams Workbench platform.
• Design and manage Bronze, Silver and Gold Delta Lake architectures, ensuring reliable and efficient delivery of trusted data assets.
• Develop data transformation and enrichment pipelines that support scam detection, machine learning models and analyst investigations.
• Drive data quality and reliability through automated validation, monitoring, alerting, anomaly detection and schema management practices.
• Optimise the performance, scalability and operational health of Databricks and Delta Lake environments to meet growing platform demands.
• Implement secure data governance controls, including lineage, access management, auditability and compliance requirements for sensitive customer data.
• Collaborate closely with ML Engineers, Software Engineers, Data Office teams and Scam Prevention stakeholders to deliver data solutions that improve scam detection outcomes and protect customers.

What makes you perfect for the role?

• Minimum 3+ years' experience designing, building and operating production-grade data ingestion, transformation and orchestration pipelines at scale.
• Proven experience building data products, platforms or pipelines within scam prevention, fraud detection, financial crime, AML, transaction monitoring, or a closely related risk environment.
• Strong understanding of fraud and scam detection use cases, with the ability to translate business requirements into reliable data flows, detection features, rules, alerts and analyst-ready datasets.
• Hands‑on expertise in SQL and Python, with practical experience in Databricks, Apache Spark/PySpark and Delta Lake, or equivalent modern data platforms.
• Experience working with high-volume, streaming or near real‑time event data using technologies and ingestion frameworks.
• Demonstrated ownership of data quality and reliability, including validation, anomaly detection, schema evolution, data contracts, monitoring, alerting and observability practices.
• Strong knowledge of data governance and security practices, including managing sensitive customer, telecommunications or financial data with appropriate access controls, audit logging, lineage and retention policies.

What’s in it for you?

• Competitive remuneration and employee discounts. Make life easier (and more affordable) with $80 monthly credit and 25% off Optus products and unique shopping discounts with our retail partners.
• Flexible working arrangements with opportunities to work three days in the office, two days remote or home.
• Vibrant and collaborative office campus that includes cafes, convenience store, chill out zones, GP, post office, gym, and on‑site childcare centre.
• Competitive leave policies, including additional 'Connected’ days to focus on culture, family, health, community, or whatever is important to you.
• We support growing families with inclusive, carer‑neutral paid Parental Leave of up to 16 weeks.
• Direct your own development and build future‑ready skills with Optus U’s industry‑focused micro‑credentials, developed with La Trobe and Macquarie Universities.
• Build meaningful connections through employee‑led networks and diversity initiatives including Culture Connect, Elevate Women, Disability Network and Express Yourself (LGBTQIA+).
• Put your wellbeing first with free access to counselling and support services, 24/7 — in‑person, by phone, SMS, or video.
• Free Optus bus from Macquarie University Metro Station (every 6-8 minutes); morning and afternoon.

At Optus, we are strengthened by others and that means valuing diversity and saying ‘yes’ to embracing individual differences. We are committed to ensuring that our application process provides an equal employment opportunity to all job seekers, including individuals from diverse gender, cultural and linguistic backgrounds, individuals with a disability, individuals identifying as being part of the LGBTQIA+ community, individuals who may have served in the armed forces or who identify as Aboriginal and/or Torres Strait Islander. We also want to do our best to make our recruitment process inclusive. If you require any adjustments or accessibility support to participate fairly and equitably in the recruitment process, please email [e-mail] or call 1800 309 170. We're here to help. When you contact us, please advise your preferred method of contact and we will be in touch within 48 hours.

For more information on Diversity, Inclusion & Belonging at Optus, please visit https://www.optus.com.au/about/inclusion-diversity