Data Engineer

Hatch; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Australian Payments Plus in Sydney is seeking a mid-level Data Engineer to design and operate scalable data pipelines across Snowflake, AWS and real-time streams. You’ll transform payments data into trusted assets for products and insights, working with APIs, databases, and orchestration tools in a collaborative Agile environment.

You’ll partner with analysts and business stakeholders to ensure data quality, governance and secure data handling while supporting on-call duties as part of a

Qualifications

• 2+ years hands-on experience building enterprise data infrastructure.
• Experience with Snowflake, DBT, Airflow and Kafka in payments or finance.
• Strong Python, SQL and data transformation skills.
• Experience with APIs, ETL/ELT and cloud infrastructure (AWS).
• Understanding of data modelling, quality, governance and security.

Responsibilities

• Design, build, deploy and maintain scalable data pipelines (batch and real-time).
• Ingest data from APIs, databases, files and streams for business use.
• Ensure reliability, performance and maintainability of pipelines.
• Implement governance, security, monitoring and on-call support.
• Collaborate with analysts and stakeholders to turn data into outcomes.

Skills

Data engineering

Python

SQL

Snowflake

Airflow

Kafka

APIs

NoSQL data stores

AWS / Cloud

Data governance

Agile

Tools

Snowflake

DBT

Airflow

Kafka

Job description

This is a Data Engineer role with Australian Payments Plus based in Sydney, NSW, AU

Australian Payments Plus

Role Seniority - mid level

More about the Data Engineer role at Australian Payments Plus

Life @ AP+

We are one connected team in pursuit of one inspiring purpose – to unite people and technology to power better experiences. Each of us has a part to play in making that happen. You’ll be encouraged to bring your big ideas forward and make a difference through your work. Taking steps forward in your career whilst still having room for fun, friendships, and flexibility in your daily life.

We’re driven by our core values: lead with heart, learn for tomorrow and live our legacy. A purpose like ours takes the inspired impact of an incredible team. Ready to change the game? We’re ready to help you do it.

The Purpose

As a Data Engineer at AP+, you'll help turn the data flowing through Australia's payments ecosystem into trusted, usable assets that power products, insights and better decisions. This is a hands-on engineering role working with large and complex datasets to design, build and productionise secure, scalable data pipelines across our modern data platform. You'll work across Snowflake, AWS, Python, SQL, APIs and real-time data to help make payment and transaction data reliable, accessible and ready for what comes next.

Key Responsibilities The Role Owns

• Design, build, deploy and maintain scalable batch and real-time data pipelines that ingest, transform and make large, complex datasets available for business use.
• Build ingestion pipelines to integrate data from APIs, databases, files, event streams and third-party platforms.
• Design pipelines for reliability, scalability, performance and maintainability.
• Implement orchestration, observability, error handling, reconciliation and recovery mechanisms.
• Implement incremental processing, CDC and event-driven integration patterns as appropriate.
• Apply strong governance, security practices to payment and transaction data.
• Develop tables, views, schemas, stored procedures and other Snowflake data objects.
• Develop tests to validate data quality and transformation logic.
• Monitor and optimise pipeline and platform performance, troubleshoot technical issues.
• Provide On-call support as part of a rotational roster.

You’ll likely be a strong fit for this role if you have:

• 2+ years of hands-on experience building and maintaining enterprise or bank-grade data infrastructure, ideally in payments, banking or financial services.
• Prior experience in cloud databases like Snowflake, DBT, orchestration tools like Airflow, event streaming platform like Kafka.
• Building and maintaining software components that are part of build pipelines.
• Strong experience with Snowflake, SQL and NoSQL data stores, including complex queries, transformations, data warehousing and large-scale data manipulation.
• Strong Python capability and experience building data pipelines and integrations using APIs, ETL/data processing technologies and cloud infrastructure such as AWS.
• A solid understanding of data modelling, data quality, reconciliation, governance and security when working with transaction or payment data.
• Experience connecting and operationalising data across warehouses, lakes, streaming platforms and analytics tools, with an eye for performance, scalability and reliability.
• A curious, collaborative engineering mindset - comfortable working autonomously in Agile teams, navigating ambiguity and partnering with analysts and business stakeholders to turn data into practical outcomes.

AP+ are not partnering with Recruitment agencies for this role.

Before we jump into the responsibilities of the role. No matter what you come in knowing, you’ll be learning new things all the time and the Australian Payments Plus team will be there to support your growth.

Key Responsibilities

• Designing data pipelines
• Building ingestion pipelines
• Monitoring and optimizing performance

Key Strengths

• Data engineering
• Python
• SQL
• Cloud databases
• Data governance
• Agile methodology

Why Australian Payments Plus is partnering with Hatch on this role.

Hatch exists to level the playing field for people as they discover a career that’s right for them. So when you apply you have the chance to show more than just your resume.

A Final Note: This is a role with Australian Payments Plus not with Hatch.