Senior Data Platform Engineer & Tech Lead

Castleton Tower Consulting, LLC; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Castleton Tower is seeking a senior, hands-on data engineering lead to build a modern investment data platform for a prominent asset allocator. You will own architecture and end-to-end delivery, mentor a growing team, and partner with investment, operations, and finance stakeholders to Deliver durable data products.

The role emphasizes production-grade Python/SQL/dbt work, CI/CD, and data quality controls with a high standard for engineering discipline.

Qualifications

• 8+ years of hands-on experience in data engineering, analytics engineering, or software engineering focused on data platforms.
• 3+ years leading technical work, as a tech lead, principal or staff engineer, or engineering manager who still builds.
• Expert SQL and Python, and deep data modeling and architecture judgment that goes beyond any single tool.
• Production experience with modern warehouse and lakehouse platforms (Snowflake, Databricks, or similar), dbt, and orchestration tools (Dagster, Airflow, or similar).
• Strong software engineering practice: version control, code review, automated testing, and CI/CD applied to data.
• Track record of shipping and operating systems you built, described in terms of what you delivered.

Responsibilities

• Platform architecture: Design and build the warehouse and lakehouse, data models, orchestration, and semantic layers that the investment organization runs on.
• Hands-on delivery: Build production-grade Python, SQL, dbt, and orchestration work yourself, including batch and near-real-time pipelines.
• Engineering standards: Bring software engineering discipline to data: code review, testing, CI/CD, documentation, observability, and data quality controls.
• Technical leadership: Lead and mentor engineers through design reviews and pairing, set the technical direction for your area, and own outcomes end to end.
• Business partnership: Work with investment, operations, finance, and reporting stakeholders to turn their needs into durable data products.
• AI-enabled engineering: Use tools such as Claude Code, Codex, Cursor, and Copilot to move faster without compromising quality or controls.
• Core responsibilities: Architect and build core investment data domains such as security and entity reference data, positions and transactions, performance, risk, and private-markets fund data.
• Design data models that are correct, reconcilable, and point-in-time aware, with tests and controls that catch problems before users do.
• Own reliability, performance, and cost of the platform, including monitoring, alerting, and incident follow-through.
• Review others' work closely, send it back when it isn't right, and make the next version better.
• Evaluate tooling and vendors across Snowflake, dbt, Dagster/Airflow, and Azure, and make pragmatic build-versus-buy calls.

Skills

Data engineering

Technical leadership

SQL

Python

Data modeling

Architecture

CI/CD

Code review

Automated testing

Shipping systems

Tools

Snowflake

Databricks

dbt

Dagster

Airflow

Azure Data Factory

Power BI

Job description

Castleton Tower is seeking a senior, hands-on data engineering lead to build a modern investment data platform for a prominent asset allocator. You will own architecture and end-to-end delivery, mentor a growing team, and partner with investment, operations, and finance stakeholders to Deliver durable data products.

The role emphasizes production-grade Python/SQL/dbt work, CI/CD, and data quality controls with a high standard for engineering discipline.