Senior Data Engineer: Python-Powered Scalable Pipelines

Susquehanna International Group, LLP; Bala Cynwyd (PA); On-site; USD 140,000 - 190,000; Full time

Job summary

Susquehanna International Group, LLP is seeking a Data Engineer to join its Data Technologies team in Bala Cynwyd, PA. You will design, build, and support data pipelines that ingest and transform large-scale data into business-ready datasets for middle- and back-office operations.

You will work with Spark, Databricks, Snowflake, and other modern tools to enable scalable analytics, collaborate with cross-functional teams, and provide occasional off-hours support.

Qualifications

• 5+ years of experience in data engineering or distributed data processing.
• Strong experience with Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka.
• Strong Python development skills.
• Experience designing and optimizing high-volume data pipelines and data processing frameworks.
• Experience with query optimization and performance tuning in large-scale analytical environments.
• Industry experience within capital markets or financial services is required.

Responsibilities

• Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
• Architect and implement modern data platform solutions
• Build and optimize large-scale batch and streaming data processing workflows
• Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
• Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

Skills

Python

Spark

Databricks

Trino

Iceberg

Snowflake

Parquet

Apache Arrow

Kafka

Batch & Streaming

Job description

Susquehanna International Group, LLP is seeking a Data Engineer to join its Data Technologies team in Bala Cynwyd, PA. You will design, build, and support data pipelines that ingest and transform large-scale data into business-ready datasets for middle- and back-office operations.

You will work with Spark, Databricks, Snowflake, and other modern tools to enable scalable analytics, collaborate with cross-functional teams, and provide occasional off-hours support.