Real-Time Data Platform Engineer - Streaming & Scalable

Fintal Partners; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Fintal Partners in Chicago is seeking an experienced Data Platform Engineer to design and build scalable real-time and batch data infrastructure. You will partner with software engineers, quantitative researchers, and infrastructure teams to deliver robust data pipelines and analytics capabilities.

The role focuses on improving performance, reliability, and observability of production data systems, while shaping data architecture and ingestion strategies for large-scale markets data and trading

Qualifications

• Experience building production data platforms in distributed environments.
• Experience with real-time streaming and batch data pipelines.
• Strong programming skills in Python, Java, or SQL.
• Familiarity with modern data storage technologies (Iceberg, Databricks, S3, HDFS).
• Knowledge of Kubernetes, Docker, and cloud-native infrastructure.
• Solid Linux production operations understanding.
• Strong analytical mindset for data issue resolution.

Responsibilities

• Design and build scalable data infrastructure supporting real-time and batch workloads.
• Develop streaming and distributed data pipelines using modern Big Data technologies.
• Improve performance, reliability, and observability across production data systems.
• Collaborate with software engineers and researchers to optimize data architecture, storage, and ingestion strategies.
• Troubleshoot production issues and drive long-term platform stability improvements.
• Contribute to the evolution of the firm’s data ecosystem and engineering best practices.

Skills

Distributed data platforms

Kafka

Spark

Flink

Python

Java

SQL

Iceberg

Databricks

S3

HDFS

Kubernetes

Docker

Linux

Tools

Kafka

Spark

Flink

Iceberg

Databricks

S3

HDFS

Kubernetes

Docker

Job description

Fintal Partners in Chicago is seeking an experienced Data Platform Engineer to design and build scalable real-time and batch data infrastructure. You will partner with software engineers, quantitative researchers, and infrastructure teams to deliver robust data pipelines and analytics capabilities.

The role focuses on improving performance, reliability, and observability of production data systems, while shaping data architecture and ingestion strategies for large-scale markets data and trading