Senior Data Platform Engineer - High-Throughput Trading

OP Recruiting; Chicago (IL); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) matching

Disability insurance

Life/AD&D

HSA

FSA

Job summary

OP Recruiting seeks a Senior Data Engineer to lead the Core Data Platform, transforming external feeds into analytics-grade data assets. You will partner with quantitative researchers and trading desks to build resilient pipelines and governance, ensuring data quality across batch and streaming workloads.

The role emphasizes enterprise-scale architecture, migration experience, and collaboration in a fast-paced financial environment with hybrid Chicago or New York work locations.

Qualifications

• 7+ years of enterprise data platform experience.
• Expert SQL and production-grade Python or Java skills.
• Strong data modeling and architecture judgment.
• Experience with orchestration tools and modern storage formats.
• Proven ability to lead data platform migrations and recoveries.
• Excellent communication in a fast-paced finance/trading environment.

Responsibilities

• Architect, construct, and maintain scalable data pipelines and centralized platform architecture supporting enterprise-wide analytics and quantitative trading workflows.
• Evaluate, ingest, and operationalize external vendor data feeds in collaboration with domain experts.
• Implement robust data governance frameworks, including access control, lineage, schema management, usage tracking, and automated quality metrics.
• Oversee operational stability of ingestion pipelines, managing schema updates, data backfills, dead-letter queue resolution, and rotating on-call support.
• Build automated monitoring and validation tools to preemptively detect and resolve data anomalies across batch and streaming pipelines.
• Drive continuous improvement of internal tooling and self-service capabilities to accelerate data discovery and integration for end users.

Skills

SQL

Python

Java

Data modeling

Communication

Tools

Airflow

Dagster

Prefect

Kubernetes

Argo Workflows

Job description

OP Recruiting seeks a Senior Data Engineer to lead the Core Data Platform, transforming external feeds into analytics-grade data assets. You will partner with quantitative researchers and trading desks to build resilient pipelines and governance, ensuring data quality across batch and streaming workloads.

The role emphasizes enterprise-scale architecture, migration experience, and collaboration in a fast-paced financial environment with hybrid Chicago or New York work locations.