We are seeking Data Engineers and Senior Data Engineers to help build a modern, enterprise cloud data and AI platform for a leading financial services organization. This multi-year initiative replaces legacy analytics workflows with governed, reusable data products on Snowflake and dbt, transitioning the business from retrospective reporting to data-driven decisioning.
You will report to the Director of Data Engineering and work in a collaborative, distributed engineering environment. Senior candidates will also drive technical design, mentor team members, and lead complex migration and modeling workstreams.
Key Responsibilities
- Build & Model: Design and deploy robust ELT pipelines using Snowflake and dbt across a governed medallion architecture (bronze/silver/gold, conformed entities, and semantic layers) for BI, API, and ML/AI consumers.
- Modernize & Migrate: Reverse-engineer legacy analytics workflows (e.g., Alteryx, SSIS, stored procedures), re-implement them cleanly in Snowflake/dbt, and establish parity verification.
- Data Quality & Testing: Embed data quality as code (dbt tests, source freshness, reconciliation checks, and observability) directly into development cycles.
- Software Engineering Discipline: Follow Git-based workflows, automated CI/CD, peer code reviews, environment promotion, and detailed documentation.
- Performance & Cost Optimization: Profile query performance, optimize warehouse sizing and clustering, and practice disciplined Snowflake compute management.
- Evidence-Based Delivery: Build against clear design specifications, produce comprehensive developer verification evidence, and collaborate across onshore and offshore partner teams.
Qualifications
- Experience: 5+ years of hands-on data engineering experience building production data pipelines and warehouse models (8+ years with demonstrated technical leadership and mentoring for Senior level).
- Core Stack:
- Snowflake: Deep experience with warehouse and database objects, role-based access, tasks/streams, and performance/cost tuning at scale.
- dbt: Strong production experience structuring layered models, incremental builds, custom macros, schema tests, and CI workflows.
- SQL & Python: Advanced SQL skills (complex transformations, window functions, tuning) combined with solid Python for ingestion utilities, APIs, and automation.
- Architecture: Practical experience building within medallion/layered cloud data architectures, conformed dimensions, and data contracts.
- Engineering Best Practices: Proven track record with Git, automated testing, CI/CD, and robust pipeline observability.
- Communication: Clear written and verbal communication for technical design notes, pull request reviews, and cross-functional coordination.
Preferred Qualifications
- Experience working in financial services, banking, fintech, or other regulated environments handling sensitive data.
- Background in legacy migrations (Alteryx, SSIS, SAS) with rigorous parity testing.
- Experience with orchestration tools (Airflow, Dagster), CDC pipelines, data catalogs, or BI/semantic layers.