Senior Data Engineer

Quantium; Hyderabad; On-site; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Flexible Work Arrangements

Continuous Learning

Group and Health Insurance

Supportive Environment

Job summary

Quantium, a world leader in data science, seeks a Senior Data Engineer to design and implement data pipelines on Google Cloud Platform. You will contribute to end-to-end data solutions, review code, and mentor engineers in a fast-paced agile environment.

You will work with stakeholders to estimate epics, refine backlogs, and ensure scalable, secure applications across frontend and backend, aligning with AI-enabled initiatives.

Qualifications

• 5+ years of experience designing, developing, and implementing end-to-end data solutions on Google Cloud Platform or a comparable cloud platform.
• Strong proficiency in SQL and Python for data engineering workloads.
• Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.
• Solid understanding of data warehousing concepts and data modelling techniques.
• Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub.
• Familiarity with version control (Git) and CI/CD practices.
• Understanding of GNU/Linux systems and shell scripting (Bash).
• Bachelor's degree in Computer Science, Information Technology, or a related discipline.
• Comfortable working in a fast-paced agile development environment.
• Strong problem-solving and analytical skills.
• Good written and verbal communication skills in English.

Responsibilities

• Write production-quality code aligned to team standards, including appropriate unit and integration tests.
• Design and implement data pipelines that ingest, transform, and serve large-scale structured and unstructured datasets.
• Review code and test cases produced by others, ensuring changes satisfy business requirements, follow best practices, and integrate cleanly with the existing codebase.
• Provide constructive feedback to other team members on code quality, design patterns, and testing approaches.
• Collaborate with other Lead and Senior Engineers to produce high-level designs and technical architectures for larger pieces of work.
• Validate technical designs and estimates produced by other team members.
• Merge reviewed code into release branches, resolve conflicts, and manage deployments to production and non-production environments.

Skills

SQL

Python

ETL/ELT

BigQuery

Airflow

Data modelling

Git

GNU/Linux

Bash

English communication

Education

Bachelors in CS/IT

Tools

BigQuery

Dataflow

Airflow

Argo Workflows

Pub/Sub

Terraform

Docker

Kubernetes

Job description

Job Description:

Who is Quantium?

Quantium is a world leader in data science and artificial intelligence. Established in Australia in 2002, Quantium is a global team of more than 1,200 people across 14 locations with a unique blend of capabilities across product and consulting services to help businesses unlock value from data and analytics. Quantium partners with the worlds largest corporations to forge a better, more intelligent world.

How will you make an impact?

• Write production-quality code aligned to team standards, including appropriate unit and integration tests
• Design and implement data pipelines that ingest, transform, and serve large-scale structured and unstructured datasets
• Review code and test cases produced by others, ensuring changes satisfy business requirements, follow best practices, and integrate cleanly with the existing codebase
• Provide constructive feedback to other team members on code quality, design patterns, and testing approaches
• Collaborate with other Lead and Senior Engineers to produce high-level designs and technical architectures for larger pieces of work
• Validate technical designs and estimates produced by other team members
• Merge reviewed code into release branches, resolve conflicts, and manage deployments to production and non-production environments

Operations & Reliability

• Troubleshoot production issues and raise / prioritise bug tickets to drive resolution
• Proactively monitor pipeline health, data quality, and system performance — acting to report and resolve issues before they impact downstream consumers
• Provide support for periodic ETL processes that run outside standard Hyderabad business hours (aligned to Australian time zones), ensuring SLAs are met

Planning & Collaboration

• Work with business stakeholders and technical leads to define, scope, and estimate new epics
• Contribute to backlog refinement sessions, breaking down epics into well-defined user stories that deliver incremental business value
• Work closely with Product Owners to ensure the backlog is prioritised to maximise business value while managing technical debt
• Contribute to sprint planning, daily stand-ups, sprint reviews, and retrospectives to maintain a culture of continuous improvement within the squad

Mentoring & Development

• Coach and mentor more junior engineers to support their technical growth and professional development
• Support the Lead Data Engineer in identifying development opportunities and aligning work assignments to team members longer-term career objectives

• Lead the technical design and architecture of AI-enabled applications, ensuring scalability, performance and security across both frontend and backend systems.
• Drive end-to-end delivery of enterprise-grade software solutions for major clients, taking accountability for quality, timeliness and alignment with client expectations.
• Act as a technical consulting partner to client stakeholders, representing Quantiums engineering capability in senior conversations and translating strategic AI ambitions into executable delivery roadmaps.
• Establish and embed repeatable methodologies, engineering standards and AI delivery playbooks that can scale across multiple client engagements.
• Lead and develop a team of engineers, fostering capability growth, engineering excellence and a strong delivery culture aligned to Quantiums capability framework.
• Collaborate with product managers, delivery managers and data science teams to translate business requirements into well-architected technical solutions.
• Own and drive the engineering roadmap for assigned products and client platforms, balancing technical debt reduction with feature and AI capability development.
• Champion the adoption of AI-first engineering practices, modern cloud-native architectures and responsible AI principles across client and internal teams.
• Lead technical discovery sessions, architecture reviews and design forums for major features, system components and AI integration patterns.
• Contribute to Quantiums broader engineering community through knowledge sharing, thought leadership and participation in cross-team technical initiatives.

The superpowers youll be bringing to the team:

Core Experience

• 5+ years of experience designing, developing, and implementing end-to-end data solutions (storage, integration, processing, access) on Google Cloud Platform or a comparable cloud platform
• Strong proficiency in SQL and Python for data engineering workloads
• Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data
• Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions)
• Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub (or equivalent tools on other cloud platforms)
• Familiarity with version control (Git) and CI/CD practices
• Understanding of GNU/Linux systems and shell scripting (Bash)
• Bachelors degree in Computer Science, Information Technology, or a related discipline
• Comfortable working in a fast-paced agile development environment
• Strong problem-solving and analytical skills
• Good written and verbal communication skills in English

Desirable

• Experience with infrastructure-as-code tools (e.g. Terraform)
• Familiarity with containerisation technologies (e.g. Docker, Kubernetes)
• Exposure to data quality frameworks, data observability tooling, or data governance practices
• Proficiency with AI-assisted development tooling (e.g. GitHub Copilot, Claude Code, Cursor) and a demonstrated ability to incorporate these tools thoughtfully into day-to-day engineering workflows to improve productivity and code quality
• Experience working with cross-functional stakeholders across multiple time zones
• Prior experience mentoring junior engineers in a squad or team setting
• Commercial awareness, with the ability to connect technical work to business outcomes

What could your Quantium Experience look like?

Working at Quantium will allow you to challenge your imagination. You will get to solve complex problems using rigor, precision, and by asking great questions – but it also means you can think big, outside the box, and push your problem-solving skills to the max.

By joining the Quantium team, you’ll get to:

• Forge your path: Shape your career journey with opportunities to move across different teams or offices
• Find your kind: Embrace diversity and connect with like-minded professionals
• Make an impact: Drive transformational outcomes for leading FMCG clients through data-driven solutions

Benefits and Perks:

• Flexible Work Arrangements: Achieve work-life balance with hybrid and flexible work arrangements
• Continuous Learning: Access to the Analytics Community, fostering development, thought leadership, and technical excellence through collaboration and best practice sharing
• Group and Health Insurance: Comprehensive coverage for you and your loved ones
• Supportive Environment: Modern, flexible, and supportive workplace dedicated to powering possibilities for our team members, clients, and partners

Quantium’s recruitment process involves the collection and use of personal information. Please click on the link "Privacy" for Quantium’s Collection Notice. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.

Quantium’s recruitment process involves the collection and use of personal information, see our Candidate Data Collection Notice for more information. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.