Data Engineer: Build Lakehouse Pipelines with Databricks

Mondrian Alpha; New York (NY); On-site; USD 110,000 - 165,000; Full time

Job summary

Mondrian Alpha is hiring a data engineer in New York to design, build, and scale data pipelines that feed research and trading. You will work with a modern lakehouse—handling market and alternative data, reference data, and more—ensuring data is timely, accurate, and well-modeled for fast analytics.

You will partner with quant researchers and PMs to deliver trustworthy data, maintain data quality, and optimize for performance and cost in a hands-on, fast-paced environment.

Qualifications

• 3–10 years of experience building production data pipelines.
• Hands-on Databricks and Spark experience is required.
• Solid Python and SQL, with distributed data processing at scale.
• Experience with data modeling and building dependable pipelines.
• Ability to optimize for performance and cost.

Responsibilities

• Design, build, and maintain large-scale data pipelines in Databricks and Spark.
• Ingest and normalize high-volume data from multiple sources.
• Construct the lakehouse layer for research and trading teams to query directly.
• Collaborate with quantitative researchers and PMs to deliver clean, well-modeled data.
• Own data quality, monitoring, and orchestration end to end.

Skills

Databricks

Spark

Python

SQL

Data modeling

Performance optimization

Cost optimization

Data quality monitoring

Airflow

Tools

Delta Lake

Airflow

AWS

Azure

GCP

Job description

Mondrian Alpha is hiring a data engineer in New York to design, build, and scale data pipelines that feed research and trading. You will work with a modern lakehouse—handling market and alternative data, reference data, and more—ensuring data is timely, accurate, and well-modeled for fast analytics.

You will partner with quant researchers and PMs to deliver trustworthy data, maintain data quality, and optimize for performance and cost in a hands-on, fast-paced environment.