Staff Engineer, Data Platform

DRW; Chicago, New York (IL, NY); On-site; USD 200,000 - 275,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k with match

Disability insurance

Life insurance

HSA

FSA

Job summary

DRW is seeking a Staff Engineer for the Data Platform to scale DRW's data infrastructure and empower traders, researchers, and back-office teams. You will translate data strategy into engineering products and managed services, working across tooling, producers, and consumer teams to align business priorities with technical direction.

You will guide the architecture, drive the data governance strategy, and lead high-impact initiatives spanning multiple teams.

Qualifications

• Extensive experience designing, building, and operating large-scale, data-intensive distributed systems, including leadership across multiple teams.
• Ability to translate data strategy into engineering products and roadmaps.
• Experience delivering managed platform services with provisioning, upgrades, reliability, and support.
• Experience with metadata management, data catalogs, or lineage systems at scale.
• Fluent in Java and/or Python with strong SQL and Linux skills.
• Strong communication skills and ability to influence across a globally distributed org.

Responsibilities

• Define and uphold the data platform vision and architecture at DRW.
• Collaborate with engineering leads, PMs, and stakeholders to translate data strategy into products and roadmaps.
• Design and operate managed platform services for storage, query execution, batch/stream processing, and orchestration.
• Lead cross-team delivery, turn requirements into practical designs with measurable outcomes.
• Drive architecture reviews, document trade-offs, and align patterns with platform goals.
• Oversee data governance strategy, including metadata, lineage, and schema evolution, with security collaboration.
• Troubleshoot distributed systems, contribute to production support, and drive improvements via automation and docs.
• Mentor engineers through reviews and hands-on collaboration.

Skills

Distributed systems

Java

Python

SQL

Linux

Data platform

Mentoring

Communication

Tools

Flink

Spark

ClickHouse

Kubernetes

Iceberg

Delta Lake

Kafka

Parquet

Job description

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.

Our Unified Platform (UP) organization builds and offers managed data services, shared infrastructure, and metadata management systems that underpin our common query layer and power batch and streaming pipelines that power teams across DRW.

As a Staff Engineer focused on the Data Platform, you will bring experience scaling data platforms to shape and uphold DRW’s long-term data platform vision, translating data strategy into engineering products and managed services used by Traders, Quantitative Researchers, and Back-Office personnel. You will work across tooling, producer, and consumer teams to connect business priorities with technical direction and hands-on delivery. This is an individual contributor role combining strategic thinking, architectural leadership, software development, and mentorship, with responsibility for technical initiatives that span teams.

Key Responsibilities

• Contribute to and uphold the overall vision for DRW’s Data Platform, guiding its architecture and evolution to advance the firm’s data strategy.
• Work with engineering leads , product managers , and stakeholders to understand business priorities and translate data strategy into engineering products, platform capabilities, and contribute to the sequenced technical roadmap.
• Design , guide, and build managed platform services for data storage, distributed query execution, batch and streaming processing, and workload orchestration, owning their lifecycle from provisioning and upgrades through production support , refining the managed offers from direct user feedback.
• Lead delivery across team boundaries, turning ambiguous requirements into practical designs and measurable outcomes while balancing immediate business needs with long-term platform goals.
• Drive architecture reviews and technology decisions, documenting trade-offs and building consensus around patterns that uphold the platform vision across the data ecosystem.
• Own the strategy for large-scale data governance and b uild platform capabilities for metadata management, discovery, lineage, schema evolution, and data qua lity. Partner with security and data stakeholders on access controls and usage tra cking.
• Troubleshoot distributed systems, contribute to production support and incident response, and drive lasting improvements through root-cause analysis, automation, and operational documentation.
• Mentor engineers across teams through design reviews, code reviews, and hands‑on collaboration, strengthening engineering practices and helping others take ownership of complex systems.

Required Qualifications

• Extensive experience designing, building, and operating large-scale, data-intensive distributed systems , including technical leadership of initiatives spanning multiple teams.
• Experience coordinating with engineering leadership to accelerate team- and organization-wide delivery within existing processes and practices.
• A track record of translating data or business strategy into engineering products and technical roadmaps, with the judgment to align near-term delivery with a long-term platform vision.
• A track record of building and offering managed platform services to other teams, owning provisioning, upgrades, reliability, and ongoing support throughout the service lifecycle , working directly with users to incorporate their requirements and feedback into product and roadmap decisions.
• Experience scaling metadata management systems, such as data catalogs or lineage tracking systems , that span multiple storage and compute technologies .
• Expertise in Java and/ or Python, with a proven ability to deliver high-quality, maintainable production software, and strong familiarity with SQL and Linux environments.
• Deep understanding of distributed systems trade-offs, including consistency, fault tolerance, concurrency, partitioning, and recovery from partial failures.
• Production e xperience building both batch and stream processing systems at scale , demonstrating practical knowledge of state management, replay, backpressure, and delivery guarantees.
• Experience deploying data processing and query technologies such as Flink, Spark, and ClickHouse , and the ability to guide platform us ers on the performance and operational trade-offs among them.
• Experience with multiple storage technologies, including object storage, relational or NoSQL databases, and event streaming systems such as Kafka . In-depth k nowl ed ge of the internals of open table formats such as Iceberg or Delta Lake.
• Extensive e xperience with data modeling, schema governance and evolution, and formats and serialization systems such as Arrow, Parquet, Protobuf , or Avro.
• Familiarity with building and operating cloud-native data infrastructure, including Kubernetes, workflow orchestration, automated deployment, and production monitoring.
• Excellent written and verbal communication skills, with the ability to communicate a technical vision, explain trade-offs, align stakeholders, and lead through influence across a globally distributed organization.
• Strong technical judgment and problem-solving skills, with the ability to prioritize competing needs, deliver incrementally in a fast-paced trading environment, and develop other engineers.

Desirable Qualifications

• Experience scaling managed data services across teams with different workloads, service expectations, and operational constraints.
• Hands‑on knowledge of data governance in regulated environments.
• Familiarity with financial datasets and the needs of trading, quantitative research, or back-office users.

The annual base salary range for this position is $200,000 to $275,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.

For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice .

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in DRW ’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.