Data Engineer - Hybrid Lakehouse on Azure & Data Quality

Trupanion; Seattle (WA); Hybrid; USD 130,000 - 150,000; Full time

Benefits offered by this job

Medical benefits

PTO 4 weeks + 9 holidays

Sabbatical after 5 years

Pet-friendly office

Pet health insurance for your pet

Job summary

Trupanion is hiring a Data Engineer to design, build, and optimize data systems on a Databricks Lakehouse hosted in Azure. You will focus on reliable data ingestion, gold-layer data marts, and data quality governance.

The role emphasizes collaboration with analytics teams and a strong focus on data accuracy and auditable pipelines. The position supports a nationwide search with a preference for Seattle or East Coast time zones and offers a hybrid schedule with in-office presence at least three

Qualifications

• Bachelor’s level degree or higher in Computer Science, Engineering, or equivalent practical experience.
• Minimum 2+ years of experience designing, building, and enhancing high-performance pipelines (ETL/ELT) and building optimized Data Marts across the enterprise.
• Minimum 2+ years of deep technical experience within a Databricks-centric environment leveraging Delta Lake, Spark, Unity Catalog, and Delta Live Tables.
• Proven experience implementing robust data quality, testing, and monitoring frameworks.
• Experience with CI/CD pipelines and source code control.

Responsibilities

• Ingest data and maintain reliable pipelines across batch and real-time streaming, ensuring high availability of feeds.
• Deliver query-ready Gold-layer data marts and dimensional models by partnering with analytics teams.
• Implement automated data validation gates to protect data lake integrity at ingestion.
• Develop automated data quality test suites and monitoring for key transformations.
• Document schemas, metadata tags, and data assets for governance and discoverability.
• Collaborate with downstream teams and resolve data discrepancies to support analysts and data scientists.

Skills

ETL/ELT pipelines

Databricks

Data modeling

Data quality

CI/CD

Observability

Agile

Education

Bachelor's degree in CS or related field

Tools

Delta Lake

Apache Spark

Unity Catalog

Delta Live Tables

Azure DevOps

GitHub Actions

Job description

Trupanion is hiring a Data Engineer to design, build, and optimize data systems on a Databricks Lakehouse hosted in Azure. You will focus on reliable data ingestion, gold-layer data marts, and data quality governance.

The role emphasizes collaboration with analytics teams and a strong focus on data accuracy and auditable pipelines. The position supports a nationwide search with a preference for Seattle or East Coast time zones and offers a hybrid schedule with in-office presence at least three