Senior Data Platform Engineer: Streaming & Big Data

LeoForce; Chicago (IL); On-site; USD 200,000 - 250,000; Full time

Job summary

LeoForce in Chicago, IL is seeking a Senior Data Engineer to drive the design and expansion of our data platform across diverse sources, enabling streaming, batch, and research workloads. You will work with Trading, Quant, Tech, and Operations teams to identify data production and consumption needs and deliver high-impact projects.

You will build and deploy large-scale batch and streaming pipelines using Kubernetes/EKS, Kafka/MSK, and Databricks/Spark, while mentoring junior engineers and

Qualifications

• BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent field.
• 5+ years of professional software development experience.
• Proficiency in Java or Scala; Python is a plus.
• Experience with data platforms and big data tech.
• Strong communication, analysis, and problem-solving skills.
• Hands-on AWS cloud development and deployment experience.

Responsibilities

• Build and expand data pipelines for batch and streaming workloads.
• Collaborate with Trading, Quant, Technology, and Operations teams.
• Design and implement data platform architecture across hybrid cloud.
• Mentor junior engineers on software and data engineering best practices.
• Develop automated data validation tests and ensure SLA adherence.
• Deliver clean, well-tested, well-documented code for mission-critical apps.

Skills

Java/Scala

Python

Data modeling

Analytical thinking

Problem-solving

Communication

Education

BS/MS/PhD in CS/Engineering/Physics/Math or equivalent

Tools

Delta Lake

Spark

Kubernetes

Kafka

ClickHouse

Presto/Trino

Databricks

Job description

LeoForce in Chicago, IL is seeking a Senior Data Engineer to drive the design and expansion of our data platform across diverse sources, enabling streaming, batch, and research workloads. You will work with Trading, Quant, Tech, and Operations teams to identify data production and consumption needs and deliver high-impact projects.

You will build and deploy large-scale batch and streaming pipelines using Kubernetes/EKS, Kafka/MSK, and Databricks/Spark, while mentoring junior engineers and