Senior Data Engineer

Octopus Deploy; Australia; Hybrid; AUD 120,000 - 170,000; Full time

Benefits offered by this job

25 days annual leave

Paid parental leave (12 weeks)

Generous health care (including dental

Stock options

Open compensation handbook

Job summary

Octopus Deploy is seeking a Data Engineer to shape the future of our Data Platform, serving both our internal teams and customers. You’ll own end-to-end development, from architecture to monitoring, and tackle AI-driven context engineering challenges in a DevOps-centered environment.

You will collaborate with organisational leaders, product managers, designers, and customer engineers to deliver data-driven insights, while maintaining a culture that values autonomy, transparency, and high trust.

Qualifications

• End-to-end data platform development including architecture, ingestion, transformation, security, and CI/CD.
• Experience handling real-time and streaming data with systems like Kafka or Flink.
• Collaborate with Leaders, PMs, Designers, and Customer Engineers to deliver data for insights.
• Strong opinions and pragmatic approach to technical decisions and high-quality solutions.
• Operate and maintain reliable, performant, and cost-effective data platforms.

Responsibilities

• Ownership of the end-to-end development lifecycle for new data-platform capabilities.
• Redefine analytics in a world with AI, addressing non-determinism, scale, and cost.
• Collaborate with stakeholders to model and deliver data for insights.
• Contribute to technical discussions with clear, evidence-based positions.
• Ensure the platform runs reliably, with performance and cost controls.

Skills

Data engineering

Python

SQL

Azure

AWS

Snowflake

Databricks

Kafka

ClickHouse

AI awareness

Tools

Apache Iceberg

DuckDB

ClickHouse

Spark

dbt

Job description

Octopus Deploy sets the standard for Continuous Delivery, empowering software teams to deliver value in an agile way. Over 4,000 organizations globally – including Ubisoft, Xero, Stack Overflow, NASA, and Disney – rely on our Continuous Delivery, GitOps, and release orchestration solutions.

Founded in Australia in 2012, our team of over 300 Octonauts now spans the globe. We combine high growth and big ambitions with a sustainable, balanced working environment. Our revenue has grown consistently between 20–50% every year for the past 9 years, and we’ve been profitable for 10 out of the past 12 years. Octopus now provides the industry's most comprehensive Continuous Delivery solution for organizations operating at scale.

We’ve been remote-first since 2015 and work with an uncommon level of transparency. You can read our public handbook to learn how we work. We have a transparent approach to compensation that ensures people doing the same work with the same skill get paid the same, with well-defined career pathways. We foster a supportive, collaborative, and high-trust environment. We leave our job titles at the door and focus on doing what’s best for our customers and team. Our leaders never shy away from answering the tough questions at our all‑hands calls or in 1:1s. We conduct interviews and onboarding virtually as part of being a remote‑first company.

Role Summary

Are you a Data Engineer who thrives at the intersection of data and software engineering? Are you excited about the impact of AI and context engineering in the world of data? We want you to shape the future of our Data Platform that serves both our internal organisation and our customers.

We're part of the Platform group at Octopus and are looking for a Data Engineer to join our small, nimble team. If you've always wanted the freedom and autonomy to build the best Data Platform in a DevOps-centred organisation, we'd love to hear from you!

What You’ll Be Doing:

• Taking ownership of the end-to-end development lifecycle of new data‑platform capabilities – solution architecture and design, instrumentation → ingestion → transformation, security, CI/CD and instrumenting the monitoring of it.


• Redefining how Analytics works in a world of AI, shifting from managing not just data, but building innovative solutions to manage context and AI Agents. Tackling challenges like non‑determinism and managing the impact of scale and cost that AI based systems have.


• Collaborating with stakeholders, such as Organisational Leaders, Product Managers, Designers, Customer Engineers to model and deliver data to be used for insights – pair with your colleagues to get the right results.


• Bringing your strong opinions, loosely held for technical discussions and strategies to ensure high‑quality solutions and alignment with company goals.


• Managing the operational day‑to‑day of the platform – ensuring it’s reliable, performant and cost effective.

We're looking for someone like you who

• 3+ years and demonstrable experience as a data (or software‑engineer), explicitly building Data Platform capabilities, using modern cloud based technology (Azure/AWS, Snowflake, Databricks, Clickhouse etc). You come with a strong understanding of data engineering and principles.


• You have a firm grasp on languages used predominately in the data‑engineering landscape, preferably proficiency in SQL and strong Python experience.


• Lived experience working with the latest in data, this might include working with technology like Apache Iceberg, new‑age data‑stores (DuckDB, Clickhouse) or building pro‑active analytics with agents.


• Background in working on real‑time and streaming based problems – you have experience in the likes of Kafka, Flink or near‑real‑time OLAP databases like Clickhouse, RisingWave and Interactive Tables (Snowflake).


• A genuine and enthusiastic interest in the way data‑engineering is evolving alongside artificial intelligence systems. This includes a desire to stay abreast of the latest advancements, experiment with AI based solutions, and actively participate in advancing our Data Platform and keeping it at the cutting edge of AI.


• You come with a pragmatic approach to the idea of self‑service analytics and data‑as‑a‑product, along with other data‑mesh like principles.


• You enjoy working in a “you built it, you run it” culture, where teams take pride in the quality of their work and the availability of their systems.


• You enjoy collaborating with other people to solve problems, challenging each other to discover the best solution for a problem using a balance of passion, pragmatism, and empathy.


• You are a results‑oriented person, focused on iteratively delivering valuable things to your customers, willingly changing direction based on clear and transparent business information, and someone who helps others do the same.

Nice to have:

• You've already built or worked on AI based solutions, such as creating agents.


• Strong familiarity with the software‑engineering discipline, you might have had your hands in instrumenting telemetry or events before and building the pipelines. Experience being hands‑on doing this in Python, C# or Typescript is a bonus.


• Experience with frameworks like Spark or dbt.


• You're knowledgeable and able to work within data‑modelling methodologies like Kimball.

Interview Process

[30 min] Meet a Talent Acquisition team member, where you’ll learn more about life at Octopus and the role. We’ll give you a glimpse into the organization structure and how we work, and ask questions to understand your suitability for the role.

[30 min] Meet our Engineering Manager and Lead Data Engineer to explore your experience, the shape of the role, and the problems we’re hoping to solve together. We’ll ask questions to understand how your skills might complement our mission.

[60 min] You’ll architect a lightweight data‑engineering process (capture/ingestion → transformation → consumption) to provide data for self‑serving analytics. Then you’ll pair with the team to explain your design decisions, perform live coding and analysis using your solution, and work through follow‑up questions together.

Octopus has an internally open and transparent system for compensation . Any Octonaut can view the compensation for any role at any level. This ensures people doing the same work with the same skill get paid the same. Benefits include a minimum of 25 days annual leave, up to 10 days of paid sick and carers leave, 12 weeks of fully paid parental leave with flexible return options, generous health care including dental and vision for US based candidates, 401K matching/pension contributions depending on your location, and stock options.

• minimum of 25 days annual leave


• up to 10 days of paid sick and carers leave


• 12 weeks of fully paid parental leave with flexible return options


• generous health care including dental and vision for US based candidates


• 401K matching/pension contributions depending on your location


• stock options

If you join Octopus, you’ll be joining a high trust ,remote‑first team that helps over 150,000 peoplearound the world to deliver working software to production.

We’ve been around since 2012 and we’re used by over 25,000 companies, including ASOS, Xero, StackOverflow, NASA and Disney.

Growing, sustainable company

We’re profitable and long‑term oriented . And yet we’re growing quickly .It’s a unique opportunity to join a growing company without all the craziness. With that growth comes allkinds of opportunities for career progression and professional and personal development.

What to expect

What’s it really like here? We’ve made our internal handbook public, so you can see for yourself. It will answer many of the questions you might have.

Trust and autonomy to do the best work of your life, in work that makes a meaningful difference.

Along with a pro‑active salary review and feedback system.

As we grow, new opportunities to learn, advance and contribute are continuously opening.

Laptop & home office

Choose your own laptop and home office program.

Excellent health care, dental and vision. (US only)

Retirement

Work/life harmony

No crazy hours or arbitrary deadlines.

Paid parental leave for primary & secondary carers.