Senior Data Engineer

TMGM; Sydney; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work

Career growth opportunities

Snacks & beverages in office

Healthcare coverage

Smart casual dress code

Vibrant culture

Job summary

TMGM is seeking a Senior Data Engineer to lead architecture, scalability, and reliability of a high-throughput, real-time data ecosystem. You will oversee data infrastructure evolution using Kafka, RabbitMQ, Airflow, and ClickHouse to power mission-critical financial analytics.

Your role bridges complex business requirements with high-performance engineering, mentoring engineers and implementing robust monitoring for data integrity in fast-moving markets.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience in data engineering, with a strong background in designing and implementing ETL processes in cloud environments.
• Experience within the Finance or Trading technology sector, with a proven track record of handling real-time market or transactional data.
• Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
• Extensive SQL knowledge and experience.
• Excellent problem-solving skills and the ability to work collaboratively in a team environment.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Responsibilities

• Lead the design and evolution of highly scalable, fault-tolerant ETL/ELT pipelines.
• Dive the strategy for real-time messaging and stream processing using Kafka and RabbitMQ to ensure sub-second data availability.
• Act as the subject matter expert for ClickHouse, optimising complex schema designs, indexing strategies, and query performance for large-scale financial datasets.
• Oversee the deployment of data services within cloud environments, implementing advanced security protocols and data governance standards essential for the finance industry.
• Collaborate with senior leadership to align data strategy with business objectives. Mentor data engineers through code reviews and technical guidance.
• Implement advanced monitoring and automated recovery systems to ensure the integrity and quality of high-stakes financial data.

Skills

Python programming

ETL/ELT design

Data governance

Mentoring

Education

Bachelor's or Master's in Computer Science or Engineering

Tools

Kafka

RabbitMQ

Airflow

ClickHouse

Job description

TMGM is one of the fastest-growing CFD and Forex brokers in the Asia-Pacific region, trusted by over 150,000 clients globally. With a strong focus on innovation, client satisfaction, and regulatory compliance, we continue to expand our presence across international markets.

About The Role

As a Senior Data Engineer, you will be a technical leader responsible for the architecture, scalability, and reliability of our high-throughput, real-time data ecosystem. You will oversee the evolution of our data infrastructure, leveraging Kafka, RabbitMQ, Airflow, and ClickHouse to power mission-critical financial analytics. Your role is to bridge the gap between complex business requirements and high-performance engineering, ensuring our data pipelines can handle the rigours of real-time financial data processing.

About The Company

TMGM is one of the fastest-growing CFD and Forex brokers in the Asia-Pacific region, trusted by over 150,000 clients globally. With a strong focus on innovation, client satisfaction, and regulatory compliance, we continue to expand our presence across international markets.

About The Role

As a Senior Data Engineer, you will be a technical leader responsible for the architecture, scalability, and reliability of our high-throughput, real-time data ecosystem. You will oversee the evolution of our data infrastructure, leveraging Kafka, RabbitMQ, Airflow, and ClickHouse to power mission-critical financial analytics. Your role is to bridge the gap between complex business requirements and high-performance engineering, ensuring our data pipelines can handle the rigours of real-time financial data processing.

Requirements

Key Responsibilities

• Lead the design and evolution of highly scalable, fault-tolerant ETL/ELT pipelines.
• Dive the strategy for real-time messaging and stream processing using Kafka and RabbitMQ to ensure sub-second data availability.
• Act as the subject matter expert for ClickHouse, optimising complex schema designs, indexing strategies, and query performance for large-scale financial datasets.
• Oversee the deployment of data services within cloud environments, implementing advanced security protocols and data governance standards essential for the finance industry.
• Collaborate with senior leadership to align data strategy with business objectives. Mentor data engineers through code reviews and technical guidance.
• Implement advanced monitoring and automated recovery systems to ensure the integrity and quality of high-stakes financial data.
  

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience in data engineering, with a strong background in designing and implementing ETL processes within cloud environments.
• Experience within the Finance or Trading technology sector, with a proven track record of handling real-time market or transactional data.
• Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
• Extensive SQL knowledge and experience.
• Excellent problem-solving skills and the ability to work collaboratively in a team environment.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  

Benefits

• Hybrid working arrangement - 2 Days of remote work per week
• Opportunities for enriching career growth, including exposure to regional contexts
• Complimentary snacks and beverages available in the office pantry
• Healthcare coverage (medical, dental, optical), gym benefits
• Flexibility in smart casual dress code
• Young, vibrant and open work culture