Senior Data Engineer

Susquehanna International Group, LLP; Bala Cynwyd (PA); On-site; USD 140,000 - 190,000; Full time

Job summary

Susquehanna International Group, LLP is seeking a Data Engineer to join its Data Technologies team in Bala Cynwyd, PA. You will design, build, and support data pipelines that ingest and transform large-scale data into business-ready datasets for middle- and back-office operations.

You will work with Spark, Databricks, Snowflake, and other modern tools to enable scalable analytics, collaborate with cross-functional teams, and provide occasional off-hours support.

Qualifications

• 5+ years of experience in data engineering or distributed data processing.
• Strong experience with Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka.
• Strong Python development skills.
• Experience designing and optimizing high-volume data pipelines and data processing frameworks.
• Experience with query optimization and performance tuning in large-scale analytical environments.
• Industry experience within capital markets or financial services is required.

Responsibilities

• Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
• Architect and implement modern data platform solutions
• Build and optimize large-scale batch and streaming data processing workflows
• Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
• Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

Skills

Python

Spark

Databricks

Trino

Iceberg

Snowflake

Parquet

Apache Arrow

Kafka

Batch & Streaming

Job description

Overview

We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.

In this role, you will:

• Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
• Architect and implement modern data platform solutions
• Build and optimize large-scale batch and streaming data processing workflows
• Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
• Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

What we’re looking for

• 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
• Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
• Strong Python development skills required
• Experience designing and optimizing high-volume data pipelines and data processing frameworks
• Experience with query optimization and performance tuning in large-scale analytical environments
• Experience with on-premises data platforms preferred
• Industry experience within capital markets or financial services is required
• Domain knowledge particularly Operations and/or Compliance, is highly preferred
• Ability and flexibility to provide occasional off‑hours/weekend support