Senior Data Platform Engineer: DataOps & Governance

Drweng; Chicago, New York (IL, NY); On-site; USD 150,000 - 190,000; Full time

Job summary

DRW is hiring a Senior Data Engineer for the Unified Platform organization in Chicago. You will design, build, and operate the data platform and managed services used by Traders, Researchers, and Back-Office staff.

You will own engineering projects, work with platform users to solve technical problems, and contribute to metadata governance and data quality initiatives. You will mentor engineers, lead design reviews, and drive automation, observability, and scalable data processing across batch

Qualifications

• 7+ years of experience with modern data technologies or distributed data systems.
• Strong Java and/or Python production experience, plus SQL, Bash and Linux familiarity.
• Experience building/operating managed data or infrastructure services and production support.
• Ownership of engineering projects from design through deployment and operation.
• Understanding of distributed systems trade-offs like fault tolerance and concurrency.
• Experience with batch/streaming processing: state management, retries, replay, data consistency.
• Experience with data processing/query tech (Flink, Spark, ClickHouse) and various storage systems.

Responsibilities

• Design, build, and operate managed platform services for data storage and processing.
• Own designs and implementations for platform services and lead delivery from requirements to deployment.
• Automate provisioning, configuration, upgrades, and monitoring of managed services.
• Build and integrate metadata management tools, data catalogs, and lineage tracking.
• Implement schema governance, data quality checks, and access controls with security stakeholders.
• Diagnose integration and performance issues with platform users and improve services.
• Improve reliability via observability, capacity management, and testing.
• Participate in production support and incident response for platform services.
• Deliver platform upgrades and data migrations with validation and compatibility checks.
• Lead design and code reviews and mentor junior engineers.

Skills

Java

Python

SQL

Bash

Linux

Data platforms

Ownership

Tools

Flink

Spark

ClickHouse

Iceberg

Delta Lake

Kafka

Parquet

Protobuf

Avro

Job description

DRW is hiring a Senior Data Engineer for the Unified Platform organization in Chicago. You will design, build, and operate the data platform and managed services used by Traders, Researchers, and Back-Office staff.

You will own engineering projects, work with platform users to solve technical problems, and contribute to metadata governance and data quality initiatives. You will mentor engineers, lead design reviews, and drive automation, observability, and scalable data processing across batch