Senior Data Engineer: High-Load Pipelines & Global Scale (Remote)

01.tech; Victoria; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Medical insurance including dental (on

Sports and wellness support

English lessons

Therapy sessions

Corporate library

Team events

Job summary

01.tech is seeking a senior data engineer with a strong Python and SQL background to design reliable data pipelines, handle large-scale data, and make strong technical decisions independently.

Responsibilities include building and maintaining Airflow DAGs, preparing data for analytics, optimizing queries in ClickHouse and MySQL, developing microservices for data processing, and deploying in high-load environments serving 100M+ users worldwide.

Qualifications

• 5+ years of professional Python development experience.
• Strong SQL skills and query optimization experience.
• Experience with ClickHouse and/or MySQL.
• Experience designing Python frameworks and libraries, plus profiling/performance optimization.
• Experience developing and working with OLAP systems.
• Hands-on experience with Airflow, Pandas, Kafka and/or RabbitMQ.
• Experience retrieving and processing data via APIs and FTP.
• Experience with Docker and Kubernetes.
• Ability to independently evaluate and choose technical solutions.
• Experience with high-load data processing and serving 100M+ users worldwide.

Responsibilities

• Build and maintain data pipelines and DAG workflows in Airflow.
• Prepare and transform data for analytics and business use cases.
• Work with ClickHouse and MySQL, optimize queries and analyze execution plans.
• Integrate with partner services and external data sources via APIs and FTP.
• Design and develop microservices for data processing.
• Work with high-load systems processing terabytes of data.
• Contribute to architecture and propose technical solutions to improve performance and scalability.

Skills

Python

SQL

Independent decisions

OLAP

High-load systems

Tools

Airflow

Pandas

Kafka

RabbitMQ

Docker

Kubernetes

ClickHouse

MySQL

Job description

01.tech is seeking a senior data engineer with a strong Python and SQL background to design reliable data pipelines, handle large-scale data, and make strong technical decisions independently.

Responsibilities include building and maintaining Airflow DAGs, preparing data for analytics, optimizing queries in ClickHouse and MySQL, developing microservices for data processing, and deploying in high-load environments serving 100M+ users worldwide.