Lead Data Engineer, Market Data Platform

Geneva Trading; Chicago (IL); Hybrid; USD 180,000 - 250,000; Full time

Job summary

Geneva Trading in Chicago, IL is seeking a Data Engineering Manager to own market data platforms and analytical data systems. You will manage a small team, write production code, review designs, debug systems, and stay close to technical details.

The role emphasizes reliable, scalable data pipelines across multiple venues, supporting trading systems, research, and AI-driven tools. You will design KDB+/Q platforms, data contracts, and ensure data quality, latency vs durability tradeoffs, with

Qualifications

• At least 7 years of experience in data engineering, market data infrastructure, or a closely related area.
• Current hands-on production coding experience.
• At least 3 years leading engineers while staying technically involved.
• Strong KDB+/Q experience, including complex Q, tick architecture, query tuning, and production HDB troubleshooting.
• Strong production Python experience, including tested, packaged, maintainable systems-level code.
• Experience building low-latency decoders for real exchange protocols.
• Strong understanding of multicast, packet capture, sequencing, and gap detection.
• Comfortable working in Linux and using tools such as perf, strace, tcpdump, and numactl.
• Able to own production issues directly, not just route them to someone else.

Responsibilities

• Own the market data pipeline from ingestion through normalization and near-real-time delivery. The data has to be correct first, and the system has to recover cleanly when something breaks.
• Responsibilities include:
• - Integrating direct exchange feed capture alongside third-party vendor data
• - Building and improving replay, recovery, and gap-detection capabilities
• - Keeping market data correctly sequenced, validated, and available fast enough for downstream users
• - Understanding when latency matters, when durability matters more, and how to make the right tradeoff
• Design, maintain, and improve the KDB+/Q platforms that hold our real-time and historical market data.
• Responsibilities include:
• - Schema design, partitioning, and query-performance tuning
• - Supporting real-time and historical analytics use cases
• - Managing retention and data lifecycle policies
• - Keeping the platform maintainable as data volumes and usage grow
• - Debugging production HDB and tickerplant issues directly
• Data Distribution &+ Platform Integration
• Deliver data reliably to downstream consumers through streaming, messaging, and platform integrations.
• Responsibilities include:
• - Defining data contracts and schemas that other teams can depend on
• - Supporting replayable and durable data flows where needed
• - Working with downstream teams to understand how they actually consume the data
• - Balancing real-time delivery needs with reliability and operational simplicity
• Tooling, Libraries & Supporting Systems
• Build the internal tooling and shared libraries that make the data platform easier to operate and easier to use.
• Responsibilities include:
• -Building validation, monitoring, replay, and analytics tools
• - Owning supporting systems for reference data, configuration, and metadata
• - Improving developer workflows around market data testing and troubleshooting
• - Reducing repeated manual work through better tools and automation
• Technical Leadership & Production Ownership
• Lead the team by staying close to the work.
• Responsibilities include:
• - Writing production code
• -Reviewing pull requests and technical designs
• -Working directly with trading and research teams to understand their needs
• -Debugging production issues during market hours when needed
• -Setting expectations for quality, reliability, and maintainability
• -Improving monitoring, alerting, and data-quality checks so problems are caught before the desk finds them
• KDB+ / Q; Python; C / C++; Docker; Git / CI-CD; Binary market data protocols; Kernel-bypass / high-performance networking

Skills

KDB+/Q

Python

C/C++

Linux

Production coding

Tools

Docker

Git / CI-CD

Job description

Geneva Trading in Chicago, IL is seeking a Data Engineering Manager to own market data platforms and analytical data systems. You will manage a small team, write production code, review designs, debug systems, and stay close to technical details.

The role emphasizes reliable, scalable data pipelines across multiple venues, supporting trading systems, research, and AI-driven tools. You will design KDB+/Q platforms, data contracts, and ensure data quality, latency vs durability tradeoffs, with