Data Engineer, Multi-Asset Arbitrage

Balyasny Asset Management L.P.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Balyasny Asset Management L.P. in Singapore seeks an experienced data engineer to design, build, and grow the data plane for back-testing and other data-intensive applications. You will own ingestion, storage, and APIs, collaborating with quantitative engineers and researchers across a global team.

You will balance feasibility, stability, and scalability while delivering timely data solutions. The role requires 5+ years in data-intensive work and strong SQL, databases, and Python/Rust/C++

Qualifications

• 5+ years of work experience in a data-intensive capacity, building back-testing infrastructure or similar initiatives.
• Demonstratable expertise in SQL and databases, especially timeseries and big data stores.
• Strong skills in Python/Rust/C++ and at least one data-manipulation library/framework (e.g., Pandas, Polars, Dask, Vaex, PySpark)
• Strong debugging skills at all levels of the application stack and proven problem-solving ability
• Experience architecting and building data platforms / ETLs, ideally batch as well as streaming, data lake/warehouse/lakehouse patterns
• Experience with column-oriented data storage and serialization formats such as Parquet/Arrow
• Experience with code optimization and performance tuning
• Strong knowledge of the data components used in distributed applications (e.g., Kafka, Redis, or other messaging/caching tools)

Responsibilities

• Design, build, and grow the data plane for back-testing and other data-intensive applications.
• Handle Petabyte-level ingestion, ETL, data quality, storage, backfills, and consumption/API’s.
• Work closely with quantitative engineers and researchers.
• Collaborate in a global team environment to understand, engineer, and deliver on business requirements.
• Strike a balance along the dimensions of feasibility, stability, scalability, and time-to-market when delivering solutions.

Skills

SQL proficiency

Python programming

Distributed systems debugging

Data platform design

Big data and timeseries

Tools

Kafka

Redis

PySpark

Parquet/Arrow

Dask

Vaex

ClickHouse / Snowflake

Job description

The team is responsible for building, owning, and supporting a world-class data platform for our portfolio managers and their teams. We are building the suite of core components that will underpin the offering of this team for years to come. We are looking for an experienced and eager engineer to join our team in supporting this mandate.

Role Overview:

• Design, build, and grow the data plane for back-testing and other data-intensive applications
• Handle Petabyte-level ingestion, ETL, data quality, storage, backfills, and consumption/API’s
• Work closely with quantitative engineers and researchers
• Collaborate in a global team environment to understand, engineer, and deliver on business requirements
• Strike a balance along the dimensions of feasibility, stability, scalability, and time-to-market when delivering solutions

Qualifications & Requirements:

• 5+ years of work experience in a data-intensive capacity, building back-testing infrastructure or similar initiatives.
• Demonstratable expertise in SQL and databases, especially timeseries and big data stores.
• Strong skills in Python/Rust/C++ and at least one data-manipulation library/framework (e.g., Pandas, Polars, Dask, Vaex, PySpark)
• Strong debugging skills at all levels of the application stack and proven problem-solving ability
• Experience architecting and building data platforms / ETLs, ideally batch as well as streaming, data lake/warehouse/lakehouse patterns
• Experience with column-oriented data storage and serialization formats such as Parquet/Arrow
• Experience with code optimization and performance tuning
• Strong knowledge of the data components used in distributed applications (e.g., Kafka, Redis, or other messaging/caching tools)

Additional experience in the following areas is a plus:

• Prior experience with ClickHouse, Snowflake, or similar
• Work with financial instruments / software in areas such as research, risk management, portfolio management, reconciliation, order management, etc.
• Experience building application-level code e.g., REST APIs to expose business logic
• Prior usage of tooling such as Prometheus, Grafana, Sentry, etc. for distributed tracing and monitoring metrics
• Experience with distributed stateful stream processing (e.g., Kafka Streams, Flink, Arroyo)