Data Engineer IT & Data Development

01.tech; Australia; Remote; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Medical insurance coverage in multiple

Annual benefits allowance

Professional training reimbursement

Corporate digital library

Psychologist sessions

Relocation assistance

Job summary

01.tech is seeking a senior data engineer to build and optimize scalable data pipelines using Airflow. You will design microservices for data processing and work with ClickHouse, MySQL, and OLAP systems to support analytics at scale.

You will collaborate on high-load architectures, integrate with APIs/FTP sources, and leverage Docker/Kubernetes. Remote or modern office options are available, with generous benefits and relocation opportunities.

Qualifications

• 5+ years of professional Python development experience.
• Strong SQL skills and query optimization experience.
• Experience with ClickHouse and/or MySQL.
• Experience designing Python frameworks and libraries, and profiling/performance optimization.
• Experience developing OLAP systems.
• Hands-on with Airflow, Pandas, Kafka and/or RabbitMQ.
• Experience retrieving and processing data via APIs and FTP.
• Experience with Docker and Kubernetes.
• Ability to independently evaluate and choose technical solutions.
• Opportunity to work on large-scale products and contribute to their development.
• Autonomous, ownership-driven work style with trust and no micromanagement.
• Option to work fully remotely or from a modern office.
• Medical insurance coverage in countries where the company operates.
• Annual $2,000 benefits allowance after probation period.
• Partial reimbursement for professional training and conferences.
• Access to a corporate digital library.
• Company-funded weekly online sessions with a psychologist.
• Relocation opportunities to countries where the company has offices, with relocation assistance after probation.

Responsibilities

• Build and maintain data pipelines and DAG workflows in Airflow
• Prepare and transform data for analytics and business use cases
• Work with ClickHouse and MySQL, optimize queries, and analyze query execution plans
• Integrate with partner services and external data sources via APIs and FTP
• Design and develop microservices for data processing
• Work with high-load systems processing terabytes of data
• Contribute to architecture and propose technical solutions to improve performance and scalability

Skills

Python

SQL

Airflow

Kafka

RabbitMQ

Performance profiling

OLAP

APIs

Docker

Kubernetes

ClickHouse

MySQL

Tools

ClickHouse

MySQL

Pandas

Airflow

Docker

Kubernetes

Job description

• Build and maintain data pipelines and DAG workflows in Airflow
• Prepare and transform data for analytics and business use cases
• Work with ClickHouse and MySQL, optimize queries, and analyze query execution plans
• Integrate with partner services and external data sources via APIs and FTP
• Design and develop microservices for data processing
• Work with high-load systems processing terabytes of data
• Contribute to architecture and propose technical solutions to improve performance and scalability

Requirements

• 5+ years of professional Python development experience
• Strong SQL skills and hands-on experience with query optimization
• Experience with ClickHouse and/or MySQL
• Experience designing Python frameworks and libraries, as well as profiling and performance optimization
• Experience developing and working with OLAP systems
• Hands-on experience with Airflow, Pandas, Kafka and/or RabbitMQ
• Experience retrieving and processing data via APIs and FTP
• Experience with Docker and Kubernetes
• Ability to independently evaluate and choose technical solutions
• The opportunity to work on large-scale products and contribute to their development
• A flexible work environment built on autonomy, ownership, and trust, without micromanagement
• The option to work fully remotely or from a modern office
• Medical insurance coverage in countries where the company operates
• An annual $2,000 benefits allowance after the probation period, which can be used for health insurance upgrades, language learning, and sports activities
• Partial reimbursement for professional training, courses, and participation in industry conferences
• Access to a corporate digital library
• Company-funded weekly online sessions with a psychologist
• Relocation opportunities to countries where the company has offices, with relocation assistance available after the probation period, subject to approval