Senior Data Engineer: Scalable Data Pipelines & Platforms

SIG Susquehanna; Pennsylvania; On-site; USD 120,000 - 160,000; Full time

Job summary

SIG Susquehanna is seeking a Data Engineer to join the Data Technologies team in Pennsylvania. The role focuses on designing and supporting scalable data pipelines and data products for middle- and back-office systems, and on building modern data platform solutions.

You will work with Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Arrow, Polars, and Kafka while applying strong Python development skills to deliver reliable, high-performance data workflows.

Qualifications

• 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing.
• Strong experience with Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and Kafka.
• Strong Python development skills.
• Experience designing and optimizing high-volume data pipelines and data processing frameworks.
• Experience with query optimization and performance tuning in large-scale analytical environments.
• Industry experience within capital markets or financial services is required.
• Domain knowledge particularly Operations and/or Compliance is highly preferred.
• Ability to provide occasional off-hours/weekend support.

Responsibilities

• Design, develop, and support scalable data pipelines and data products for middle- and back-office systems.
• Architect and implement modern data platform solutions.
• Build and optimize large-scale batch and streaming data processing workflows.
• Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements.
• Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance.

Skills

Python

Data pipelines

Large-scale data processing

Distributed data processing

Batch and streaming

Tools

Spark

Databricks

Trino

Iceberg

Snowflake

Parquet

Apache Arrow

Polars

Kafka

Job description

SIG Susquehanna is seeking a Data Engineer to join the Data Technologies team in Pennsylvania. The role focuses on designing and supporting scalable data pipelines and data products for middle- and back-office systems, and on building modern data platform solutions.

You will work with Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Arrow, Polars, and Kafka while applying strong Python development skills to deliver reliable, high-performance data workflows.