Lead Data Engineer

Madison-Davis, LLC

New York (NY)

On-site

USD 150,000 - 190,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Madison-Davis, LLC in New York seeks a hands-on Lead Data Engineer to design and deliver scalable enterprise data solutions as part of a major modernization initiative.

You will work with Snowflake and Databricks, build production data pipelines, implement dimensional models, and help modernize ETL/ELT workloads, blending engineering execution with architectural guidance across teams.

Qualifications

  • 7+ years of relevant data engineering experience.
  • Strong hands-on experience with both Snowflake and Databricks.
  • Advanced Python and SQL skills.
  • Star-schema and dimensional modeling experience.
  • Enterprise ETL/ELT pipeline design and implementation.
  • Airflow or comparable orchestration technologies.
  • Experience with Azure, AWS, or GCP.
  • Production performance optimization and troubleshooting.
  • Architecture and hands-on implementation experience.
  • Strong technical communication and problem-solving abilities.

Responsibilities

  • Build, maintain, and optimize data pipelines using Snowflake, Databricks, Python, and SQL.
  • Support the migration and re-architecture of existing data processing workflows.
  • Design dimensional data models, star schemas, fact tables, and dimension tables.
  • Develop and orchestrate ETL/ELT workflows using Airflow or similar tools.
  • Contribute technical designs, engineering standards, and reusable integration patterns.
  • Troubleshoot production data issues involving performance, reliability, and data quality.
  • Collaborate with architecture, engineering, governance, and business teams.
  • Provide technical guidance and conduct design and code reviews.

Skills

Hands-on data engineering
Python
SQL
Dimensional modeling
ETL/ELT design
Data architecture
Production troubleshooting

Tools

Snowflake
Databricks
Airflow
dbt
Apache Spark
Azure Data Factory
Azure/AWS/GCP

Job description

A global financial institution is seeking a hands-on Lead Data Engineer to design and deliver scalable enterprise data solutions while contributing to a major data platform modernization initiative. The engineer will work with Snowflake and Databricks, build production data pipelines, implement dimensional data models, and help modernize existing ETL/ELT workloads. The role combines hands-on engineering with technical architecture and collaboration across engineering and business teams.

RESPONSIBILITIES
  • Build, maintain, and optimize data pipelines using Snowflake, Databricks, Python, and SQL.Support the migration and re-architecture of existing data processing workflows.
  • Design dimensional data models, star schemas, fact tables, and dimension tables.
  • Develop and orchestrate ETL/ELT workflows using Airflow or similar tools.
  • Contribute technical designs, engineering standards, and reusable integration patterns.
  • Troubleshoot production data issues involving performance, reliability, and data quality.
  • Collaborate with architecture, engineering, governance, and business teams.
  • Provide technical guidance and conduct design and code reviews.
Role Requirements
  • 7+ years of relevant data engineering experience.
  • Strong hands-on experience with both Snowflake and Databricks.
  • Advanced Python and SQL skills.
  • Star-schema and dimensional modeling experience.
  • Enterprise ETL/ELT pipeline design and implementation.
  • Airflow or comparable orchestration technologies.
  • Experience with Azure, AWS, or GCP.
  • Production performance optimization and troubleshooting.
  • Architecture and hands-on implementation experience.
  • Strong technical communication and problem-solving abilities.
PREFERRED EXPERIENCE
  • Experience in financial services or another complex enterprise environment.
  • Apache Spark and Azure Data Factory.
  • Data platform migrations and modernization.
  • dbt or semantic modeling.
  • Medallion architecture, lakehouse patterns, SCD Type 2, or data governance.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Good co India • United States

Remote
USD 120,000 - 180,000
Lead Data Engineer ( Snowflake + ADF + SQL)
Lead Data Engineer ( Snowflake + ADF + SQL)

Shashwath Solution • United States

Remote
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

RBA, Inc. • United States

On-site
USD 120,000 - 190,000
Data Engineer
Data Engineer

firstPRO US • Virginia

On-site
USD 140,000 - 190,000
Data Solutions Lead
Data Solutions Lead

Adactin Software • United States

Remote
USD 140,000 - 210,000
Lead Data Engineer
Lead Data Engineer

Harnham • United States

On-site
USD 150,000 - 210,000
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Lead Data Architect
Lead Data Architect

Motion Recruitment • United States

Hybrid
USD 140,000 - 190,000
Health, Dental, Vision
401K
Hybrid
+1
Sr Data Engineer
Sr Data Engineer

MeridianLink, Inc. • United States

On-site
USD 140,000 - 210,000
Data Engineer
Data Engineer

Compunnel Inc. • Pennsylvania

Hybrid
USD 85,000 - 125,000