A global financial institution is seeking a hands-on Lead Data Engineer to design and deliver scalable enterprise data solutions while contributing to a major data platform modernization initiative. The engineer will work with Snowflake and Databricks, build production data pipelines, implement dimensional data models, and help modernize existing ETL/ELT workloads. The role combines hands-on engineering with technical architecture and collaboration across engineering and business teams.
RESPONSIBILITIES
- Build, maintain, and optimize data pipelines using Snowflake, Databricks, Python, and SQL.Support the migration and re-architecture of existing data processing workflows.
- Design dimensional data models, star schemas, fact tables, and dimension tables.
- Develop and orchestrate ETL/ELT workflows using Airflow or similar tools.
- Contribute technical designs, engineering standards, and reusable integration patterns.
- Troubleshoot production data issues involving performance, reliability, and data quality.
- Collaborate with architecture, engineering, governance, and business teams.
- Provide technical guidance and conduct design and code reviews.
Role Requirements
- 7+ years of relevant data engineering experience.
- Strong hands-on experience with both Snowflake and Databricks.
- Advanced Python and SQL skills.
- Star-schema and dimensional modeling experience.
- Enterprise ETL/ELT pipeline design and implementation.
- Airflow or comparable orchestration technologies.
- Experience with Azure, AWS, or GCP.
- Production performance optimization and troubleshooting.
- Architecture and hands-on implementation experience.
- Strong technical communication and problem-solving abilities.
PREFERRED EXPERIENCE
- Experience in financial services or another complex enterprise environment.
- Apache Spark and Azure Data Factory.
- Data platform migrations and modernization.
- dbt or semantic modeling.
- Medallion architecture, lakehouse patterns, SCD Type 2, or data governance.