Data Engineer

Hatch; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Australian Payments Plus is hiring a Data Engineer in Sydney to design, build and productionise secure, scalable data pipelines across Snowflake and AWS. You will work with Python, SQL, APIs and real-time data to make payment data reliable and usable for products and insights.

The role involves building ingestion pipelines, governance and security practices, and participating in on-call rotations within an Agile team. This position is based in Sydney, AU.

Qualifications

• 2+ years hands-on data infrastructure experience in payments or financial services.
• Experience with Snowflake, DBT, Airflow, Kafka.
• Experience building data pipelines and integrations with Python and APIs.
• Strong SQL and NoSQL knowledge, data warehousing and large-scale manipulation.
• Knowledge of data governance, quality, and security.

Responsibilities

• Design, build, deploy and maintain scalable batch and real-time data pipelines.
• Ingest data from APIs, databases, files, event streams and third-party platforms.
• Design pipelines for reliability, scalability, performance and maintainability.
• Implement governance and security practices for payment data.
• Develop Snowflake objects and data models.
• Provide on-call support as part of a rotation.

Skills

Data engineering

Python

SQL

NoSQL

Agile

Collaboration

Tools

Snowflake

DBT

Airflow

Kafka

Job description

Data Engineer role with Australian Payments Plus based in Sydney, NSW, AU

Australian Payments Plus

Role Seniority - mid level

More about the Data Engineer role at Australian Payments Plus

Life @ AP+

We are one connected team in pursuit of one inspiring purpose - to unite people and technology to power better experiences. Each of us has a part to play in making that happen. You'll be encouraged to bring your big ideas forward and make a difference through your work. Taking steps forward in your career whilst still having room for fun, friendships, and flexibility in your daily life.

The Purpose

As a Data Engineer at AP+, you'll help turn the data flowing through Australia's payments ecosystem into trusted, usable assets that power products, insights and better decisions. This is a hands-on engineering role working with large and complex datasets to design, build and productionise secure, scalable data pipelines across our modern data platform. You'll work across Snowflake, AWS, Python, SQL, APIs and real-time data to help make payment and transaction data reliable, accessible and ready for what comes next.

Key Responsibilities The Role Owns

• Design, build, deploy and maintain scalable batch and real-time data pipelines that ingest, transform and make large, complex datasets available for business use.
• Build ingestion pipelines to integrate data from APIs, databases, files, event streams and third-party platforms.
• Design pipelines for reliability, scalability, performance and maintainability.
• Implement orchestration, observability, error handling, reconciliation and recovery mechanisms.
• Implement incremental processing, CDC and event-driven integration patterns as appropriate.
• Apply strong governance, security practices to payment and transaction data.
• Develop tables, views, schemas, stored procedures and other Snowflake data objects.
• Develop tests to validate data quality and transformation logic.
• Monitor and optimise pipeline and platform performance, troubleshoot technical issues.
• Provide On-call support as part of a rotational roster.

You’ll likely be a strong fit for this role if you have:

• 2+ years of hands-on experience building and maintaining enterprise or bank-grade data infrastructure, ideally in payments, banking or financial services.
• Prior experience in cloud databases like Snowflake, DBT, orchestration tools like airflow, event streaming platform like Kafka.
• Building and maintaining software components that are part of build pipelines.
• Strong experience with Snowflake, SQL and NoSQL data stores, including complex queries, transformations, data warehousing and large-scale data manipulation.
• Strong Python capability and experience building data pipelines and integrations using APIs, ETL/data processing technologies and cloud infrastructure such as AWS.
• A solid understanding of data modelling, data quality, reconciliation, governance and security when working with transaction or payment data.
• Experience connecting and operationalising data across warehouses, lakes, streaming platforms and analytics tools, with an eye for performance, scalability and reliability.
• A curious, collaborative engineering mindset - comfortable working autonomously in Agile teams, navigating ambiguity and partnering with analysts and business stakeholders to turn data into practical outcomes.

What Happens Next

At AP+, we believe in the power of passion, pride and purpose. Our team is driven by a shared mission to make a difference in the world of payments, and we're proud to work together towards this common goal.

We want to remove all barriers to inclusion, so if you need advice or support with your application, we're here to help. Please reach out to [e-mail]. We also encourage you to let us know your pronouns at any point during the recruitment process.

AP+ are not partnering with Recruitment agencies for this role.

Key Responsibilities

• Designing data pipelines
• Building ingestion pipelines
• Monitoring and optimizing performance

Key Strengths

• Data engineering
• Python
• SQL
• Cloud databases
• Data governance
• Agile methodology

A Final Note: This is a role with Australian Payments Plus not with Hatch.