Senior Data Platform Engineer

Linuxconfig; Chicago, New York (IL, NY); In loco; USD 160.000 - 250.000; Tempo pieno

Vantaggi offerti da questo lavoro

Group medical

Dental & Vision insurance

401k (with discretionary employermatch

Disability insurance

Life and AD&D insurance

Health savings accounts

Flexible spending accounts

Descrizione del lavoro

DRW in Chicago is seeking a Senior Data Engineer to design, build, and operate the data platform and managed services used by traders, researchers, and back-office staff. You will own projects, collaborate with platform users, and contribute to metadata management and governance.

You will mentor engineers, drive production excellence, and participate in incident response, upgrades, and migrations, ensuring robust, scalable data infrastructure.

Competenze

• 7+ years of experience with modern data technologies and distributed systems.
• Expertise in Java and/or Python, with production software delivery experience.
• Strong familiarity with SQL, Bash, and Linux environments.
• Experience building and operating managed data or infrastructure services.
• Ownership of engineering projects from design to deployment.
• Understanding of distributed systems trade-offs (fault tolerance, concurrency, partitioning).
• Experience with batch and streaming systems and data freshness controls.
• Experience with data processing/query technologies such as Flink, Spark, or ClickHouse.

Mansioni

• Design, build, and operate data platform services for storage, query, batch/stream processing, and orchestration.
• Own technical designs and lead delivery from requirements to deployment.
• Automate provisioning, upgrades, and monitoring of managed services.
• Build metadata management tools, catalogs, and lineage tracking.
• Implement schema governance, data quality checks, and access controls.
• Collaborate with platform users to diagnose integration and performance issues.
• Improve reliability and performance via observability and testing.
• Lead platform upgrades and data migrations with validation.
• Lead design and code reviews and document trade-offs.
• Mentor engineers to promote maintainable code and testing.

Conoscenze

Java

Python

SQL

Bash

Linux

Distributed systems

Data processing

Strumenti

Flink

Spark

ClickHouse

Kafka

Iceberg/Delta Lake

Descrizione del lavoro

DRW in Chicago is seeking a Senior Data Engineer to design, build, and operate the data platform and managed services used by traders, researchers, and back-office staff. You will own projects, collaborate with platform users, and contribute to metadata management and governance.

You will mentor engineers, drive production excellence, and participate in incident response, upgrades, and migrations, ensuring robust, scalable data infrastructure.