Market Data Engineer: High-Frequency Pipelines

Metabit Technology LLC; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

Metabit Technology LLC is seeking a junior engineer to contribute to data engineering for high-frequency market data. The role involves implementing backfill processes, maintaining data pipelines, and supporting researchers with data needs across time-series datasets.

The ideal candidate has strong C++ and Python skills, experience with Linux, and a passion for financial trading systems. Prior exposure to Pandas/NumPy and distributed data processing is advantageous as you grow in a fast-paced,

Qualifications

• Solid coding proficiency in C++ and Python.
• Familiarity with Linux development environments.
• Experience with high-frequency tick data, time-series data, or large-scale distributed data processing is a plus.
• Familiarity with Python data processing libraries (Pandas, NumPy) preferred.

Responsibilities

• Data Engineering Implementation: Execute end-to-end backfill for high-frequency MBO historical data, handling raw PCAP processing to cleaning, standardization, and delivery.
• Data Pipeline Operations & Adaptation: Participate in daily operations of a high-volume data scheduling system (Dagster); monitor, troubleshoot, and recover/re-run as needed; adapt to protocol changes.

Skills

C++

Python

Linux

Time-series data

High-frequency data

Pandas/Numpy

Job description

Metabit Technology LLC is seeking a junior engineer to contribute to data engineering for high-frequency market data. The role involves implementing backfill processes, maintaining data pipelines, and supporting researchers with data needs across time-series datasets.

The ideal candidate has strong C++ and Python skills, experience with Linux, and a passion for financial trading systems. Prior exposure to Pandas/NumPy and distributed data processing is advantageous as you grow in a fast-paced,