Senior Data Engineer

SIG

Bala Cynwyd (PA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Priorslab is hiring a Data Engineer to join the Data Technologies team. You will design, build, and support scalable data pipelines and platforms that ingest, process, and transform large-scale data into business-ready datasets.

The role emphasizes modern data architectures, distributed processing, and analytics at scale. You will collaborate with middle- and back-office teams, optimize pipelines, and ensure reliability and performance while supporting off-hours/weekend tasks as needed.

Qualifications

  • 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing.
  • Strong Python development skills.
  • Experience designing and optimizing high-volume data pipelines and data processing frameworks.
  • Experience with query optimization and performance tuning in large-scale analytical environments.
  • Experience with on-premises data platforms preferred.
  • Industry experience within capital markets or financial services is required.
  • Domain knowledge particularly Operations and/or Compliance, is highly preferred.
  • Ability and flexibility to provide occasional off-hours/weekend support.

Responsibilities

  • Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
  • Architect and implement modern data platform solutions
  • Build and optimize large-scale batch and streaming data processing workflows
  • Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
  • Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

Skills

Spark
Databricks
Trino
Iceberg
Snowflake
Parquet
Apache Arrow
Polars
Kafka
Python

Tools

Python
Spark
Databricks
Trino
Iceberg
Snowflake
Parquet
Apache Arrow
Polars
Kafka

Job description

Overview

We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.

In this role, you will:
  • Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
  • Architect and implement modern data platform solutions
  • Build and optimize large-scale batch and streaming data processing workflows
  • Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
  • Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

What we're looking for

  • 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
  • Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
  • Strong Python development skills required
  • Experience designing and optimizing high-volume data pipelines and data processing frameworks
  • Experience with query optimization and performance tuning in large-scale analytical environments
  • Experience with on-premises data platforms preferred
  • Industry experience within capital markets or financial services is required
  • Domain knowledge particularly Operations and/or Compliance, is highly preferred
  • Ability and flexibility to provide occasional off-hours/weekend support
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

SIG Susquehanna • Pennsylvania

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 110,000 - 170,000
Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

twentyAI • New York (NY)

On-site
USD 140,000 - 190,000
Senior Data Engineer: Build Scalable Data Platforms & Analytics
Senior Data Engineer: Build Scalable Data Platforms & Analytics

Compunnel Inc. • Durham (NC)

On-site
USD 100,000 - 130,000
Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Irvine (CA)

On-site
USD 180,000 - 240,000
Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Los Angeles (CA)

On-site
USD 140,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Gardner Resources Consulting, LLC • Dallas (TX)

On-site
USD 120,000 - 150,000
Sr. Data Engineer, Data Platform
Sr. Data Engineer, Data Platform

Mirion Technologies • United States

On-site
USD 120,000 - 160,000