Lead Data Engineer - Cloud DW, Snowflake/IDMC (Remote)

IPolarity LLC; Pleasanton (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

IPolarity LLC in Pleasanton, CA is seeking a hands-on Senior/Lead Data Engineer with 8+ years to design, build, and support scalable cloud data solutions for healthcare reporting, analytics, and operational use cases. The role requires strong Snowflake, Informatica IDMC, ETL/ELT, dimensional data warehousing, Python, CI/CD, and AWS or Databricks, with technical ownership expected at the Lead level.

You will design and implement end-to-end data pipelines, build CI/CD for data code, and mentor

Qualifications

• 8+ years in data engineering, ETL development, and enterprise data warehousing.
• Strong Snowflake expertise in SQL, data loading, security, performance tuning, scalability, and cost optimization.
• Proficiency in Python and SQL, plus Git-based CI/CD using Jenkins, Azure DevOps, GitHub Actions, or similar tools.

Responsibilities

• Design, develop, test, deploy, and support scalable batch and near-real-time data pipelines using Snowflake and IDMC.
• Implement ETL/ELT solutions, dimensional models, and SCD Types 1 and 2 for enterprise DW.
• Develop efficient SQL and Python components, reusable frameworks, automation, and validation utilities.
• Build CI/CD pipelines for data code, IDMC assets, Snowflake objects, testing, and environment promotion.
• Optimize Snowflake performance, scalability, reliability, security, and cost; support AWS and/or Databricks workloads.
• Implement data quality, reconciliation, lineage, monitoring, governance, and audit controls.
• Troubleshoot production issues and partner with architecture, QA, DevOps, analytics, and business teams.
• Lead design and code reviews, mentor engineers, and drive engineering standards and solution ownership.

Skills

Snowflake

Informatica IDMC

ETL/ELT

Dimensional data warehousing

Python

CI/CD

AWS

Databricks

SQL

Git-based CI/CD tools

Education

Bachelor's degree in a relevant field

Tools

Snowflake

Informatica IDMC

Databricks

AWS

Git-based CI/CD tools

Job description

IPolarity LLC in Pleasanton, CA is seeking a hands-on Senior/Lead Data Engineer with 8+ years to design, build, and support scalable cloud data solutions for healthcare reporting, analytics, and operational use cases. The role requires strong Snowflake, Informatica IDMC, ETL/ELT, dimensional data warehousing, Python, CI/CD, and AWS or Databricks, with technical ownership expected at the Lead level.

You will design and implement end-to-end data pipelines, build CI/CD for data code, and mentor