Senior Quantitative Data Engineer — Ultra-Fast Data Platforms

Schonfeld; New York (NY); On-site; USD 200,000 - 220,000; Full time

Benefits offered by this job

Performance bonus

Comprehensive benefits

Job summary

The role requires 7+ years of production data platform experience with Python/SQL, plus deep big‑data, AWS, Terraform, and API design skills. Base pay ranges 200k–220k USD annually with potential bonuses.

Qualifications

• 7+ years building production data platforms with Python and SQL.
• Deep expertise in big-data architecture: partitioning, sharding, columnar formats.
• Hands-on with SingleStore/MemSQL, Spark/Flink/EMR and event buses (Kafka/Kinesis).
• Proven AWS skills plus Terraform / CloudFormation infrastructure-as-code mastery.
• Experience delivering data services for AI/ML workloads and feature pipelines.

Responsibilities

• Architect and operate the platform – 24x7 reliability, IaC-driven deployments, tight cost controls.
• Build and evolve batch and streaming pipelines that ingest billions of market-data events each day.
• Architect high-performance, cost-efficient Lakehouse tables.
• Expose curated datasets via robust APIs consumed by quants and AI agents.
• Optimize workflows to meet aggressive SLAs with observability and data quality checks.
• Champion Infrastructure-as-Code with Git-driven CI/CD for every data asset.
• Mentor junior engineers and enforce best-in-class coding standards.
• Continuously refine processes to keep our data ecosystem resilient and fast.

Skills

Python

SQL

Big-data architecture

SingleStore/MemSQL

Spark/Flink/EMR

Kafka/Kinesis

AWS

Terraform/CloudFormation

API design

Tools

Postgres

SingleStore/MemSQL

Spark

KDB

Job description

The role requires 7+ years of production data platform experience with Python/SQL, plus deep big‑data, AWS, Terraform, and API design skills. Base pay ranges 200k–220k USD annually with potential bonuses.