Senior Data Ingestion Engineer: Pipelines & Data Quality

Chicago Trading Company; Chicago (IL); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

Time off

Insurance

Paid parental leave

Free meals

Wellness reimbursement

Job summary

Chicago Trading Company (CTC) is a premier proprietary trading firm focused on options market making, with a global reach across derivatives exchanges. We emphasize collaboration between traders, researchers, and engineers to deliver high-quality data products and robust infrastructure.

The role centers on owning and optimizing large-scale data pipelines, advancing data platform capabilities, and ensuring reliable data delivery for critical trading decisions in a hybrid work environment at CTC

Qualifications

• Experience building and operating large-scale data pipelines.
• Strong SQL and Python skills.
• Experience with at least one cloud provider (AWS/Azure/GCP).

Responsibilities

• Own the quality, reliability, and health of source data pipelines.
• Collaborate with Traders and Quant Researchers to understand needs and data use.
• Design the most reliable data-delivery method for stakeholders.
• Optimize pipelines to meet SLA and reduce compute/storage footprint.
• Migrate pipelines to modern data platforms and plan future migrations.
• Partner with data teams to improve platform functionality.
• Detect data quality issues and surface fixes before users see them.

Skills

SQL

Python

Large-scale pipelines

Cloud platforms

HPC workloads

Interpersonal skills

Tools

Iceberg

Delta

Trino

Spark

DuckDB

Job description

Chicago Trading Company (CTC) is a premier proprietary trading firm focused on options market making, with a global reach across derivatives exchanges. We emphasize collaboration between traders, researchers, and engineers to deliver high-quality data products and robust infrastructure.

The role centers on owning and optimizing large-scale data pipelines, advancing data platform capabilities, and ensuring reliable data delivery for critical trading decisions in a hybrid work environment at CTC