Data Reliability Engineer: Real-Time Pipelines & APIs

Selby Jennings; Chicago (IL); On-site; USD 110,000 - 180,000; Full time

Job summary

Selby Jennings in Chicago seeks a Data Reliability Engineer to join a high-performance data engineering team supporting trading and research functions. The role blends data engineering, platform reliability, and operational support to ensure datasets, pipelines, and APIs remain accurate, scalable, and production-ready.

You will act as primary point of contact for data-related issues, monitor pipelines, and collaborate with data providers and business teams to resolve incidents and discrepancies.

Qualifications

• 3+ years of experience in Data Engineering, Data Reliability, Site Reliability Engineering, Software Engineering, or Data Operations.
• Strong Python development experience with data processing frameworks (Pandas, PyArrow, Spark).
• Experience building and supporting large-scale data pipelines and APIs.
• Strong data modeling, data quality, and data architecture knowledge.
• Experience with cloud data platforms and lakehouse technologies (Databricks, Delta Lake, AWS).

Responsibilities

• Act as the primary point of contact for data-related issues across trading, research, and business teams.
• Investigate and resolve data quality, availability, and freshness issues.
• Monitor data pipelines and real-time feeds; respond to alerts and incidents.
• Coordinate with external data providers to resolve feed issues and data discrepancies.
• Develop and maintain scalable ETL/ELT pipelines for real-time and analytical workloads.
• Build data quality frameworks and automated validation processes.
• Design and maintain normalized data models for financial and market datasets.
• Develop and support APIs delivering data to trading, research, and analytics platforms.
• Enhance platform observability, monitoring, and operational tooling.

Skills

Python

Data Engineering

APIs

Data Modeling

Cloud Data Platforms

Data Quality

Tools

Pandas

PyArrow

Spark

Databricks

Delta Lake

AWS

Job description

Selby Jennings in Chicago seeks a Data Reliability Engineer to join a high-performance data engineering team supporting trading and research functions. The role blends data engineering, platform reliability, and operational support to ensure datasets, pipelines, and APIs remain accurate, scalable, and production-ready.

You will act as primary point of contact for data-related issues, monitor pipelines, and collaborate with data providers and business teams to resolve incidents and discrepancies.