Senior Data Engineer — Trading Data Pipelines

Tradermath; Chicago (IL); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

Hybrid workplace model

Job summary

Chicago Trading Company (CTC) is seeking an engineer for the Data Ingest team in Chicago to build and maintain core data assets powering research platforms used across the firm. You will ensure high-quality data delivery for traders and researchers and design reliable data sourcing approaches.

You will collaborate with traders, quants, and data owners to migrate pipelines to modern platforms and reduce compute/storage footprints, while maintaining strong data quality and SLA commitments.

Qualifications

• Hands-on experience building and operating large-scale data pipelines.
• Strong software architecture and system design skills.
• Proficiency in SQL and Python.
• Experience with at least one major cloud provider (AWS/Azure/GCP).
• Ability to work in a collaborative, team environment.

Responsibilities

• Own the quality, reliability, and overall health of our source data pipelines.
• Work closely with Traders and Quant Researchers to understand their needs and how they use our final data products.
• Act as the data-delivery expert for your stakeholders, and design the most reliable and efficient way to source the data they need.
• Optimize existing pipelines to improve SLA for users and lower the compute and storage footprint across the firm.
• Migrate existing pipelines onto modern data platforms and hardware, and improve the process for future migrations.
• Collaborate with the broader data organization to improve our overall platform offering and functionality.
• Detect source data quality issues that lead to incorrect downstream metrics, and partner with data owners to build tools that surface and resolve these issues before users see them.

Skills

SQL

Python

Cloud computing

Large-scale pipelines

HPC workloads

Interpersonal skills

Data quality

Job description

Chicago Trading Company (CTC) is seeking an engineer for the Data Ingest team in Chicago to build and maintain core data assets powering research platforms used across the firm. You will ensure high-quality data delivery for traders and researchers and design reliable data sourcing approaches.

You will collaborate with traders, quants, and data owners to migrate pipelines to modern platforms and reduce compute/storage footprints, while maintaining strong data quality and SLA commitments.