Senior Manager, Data Engineering

Independence Pet Group; Chicago (IL); On-site; USD 169,000 - 212,000; Full time

Benefits offered by this job

Medical Insurance

Parental Leave

Retirement Savings Plan

Wellness Day off

Employee Training & Development

Job summary

Independence Pet Holdings seeks a senior data engineering leader to architect scalable data ingestion pipelines and MDM strategy across key business domains in a Chicago-area role. You will drive real-time and batch ingestion, define reusable patterns, and ensure trusted data for product, analytics, and operations.

Lead a high-performing data engineering team, promote lakehouse architecture, and enforce governance and DevOps practices as part of a comprehensive rewards package.

Responsibilities

• Own the design and implementation of scalable data ingestion frameworks using Azure Databricks, ADLS Gen2, and Azure-native services.
• Oversee and scale batch and real-time ingestion pipelines (e.g., via Event Hub, Service Bus, Kafka).
• Define and standardize reusable ingestion patterns, frameworks, and orchestration standards.
• Define the roadmap for data ingestion capabilities aligned to product and business priorities.
• Drive performance tuning, cost optimization, and reliability of data pipelines.
• Own the MDM strategy, architecture, and implementation across key business domains.
• Define and manage golden record creation across domains (customer, product, provider, etc.).
• Drive alignment with product, analytics, and business stakeholders to ensure consistent, trusted data across the organization.

Job description

Established in 2021, Independence Pet Holdings is a corporate holding company that manages a diverse and broad portfolio of modern pet health brands and services, including insurance, pet education, lost recovery services, and more throughout North America.

We believe pet insurance is more than a financial product and build solutions to simplify the pet parenting journey and help improve the well‑being of pets. As a leading authority in the pet category, we operate with a full stack of resources, capital, and services to support pet parents. Our multi‑brand and omni‑channel approach include our own insurance carrier, insurance brands and partner brands.

• Own the design and implementation of scalable data ingestion frameworks using Azure Databricks, ADLS Gen2, and Azure-native services.
• Oversee and scale batch and real-time ingestion pipelines (e.g., via Event Hub, Service Bus, Kafka).
• Define and standardize reusable ingestion patterns, frameworks, and orchestration standards.
• Define the roadmap for data ingestion capabilities aligned to product and business priorities.
• Drive performance tuning, cost optimization, and reliability of data pipelines.
• Own the MDM strategy, architecture, and implementation across key business domains.
• Define and manage golden record creation across domains (customer, product, provider, etc.).
• Drive alignment with product, analytics, and business stakeholders to ensure consistent, trusted data across the organization.
• Partner with business and governance teams to align MDM strategy with organizational goals.
• Oversee the development and implementation of probabilistic matching algorithms for entity resolution.
• Lead development of taxonomy-driven data models and hierarchies.
• Promote data lakehouse architecture principles and modular data design.
• Ensure alignment with enterprise data governance and security standards.
• Build and lead a high‑performing team of data engineers, including senior engineers and/or technical leads.
• Define team structure, capacity planning, and hiring strategy to support platform growth.
• Influence overall data architecture, platform standards, and technology decisions.
• Ensure data platforms directly support critical business outcomes, including product capabilities, analytics, and operational workflows.
• Drive agile delivery, sprint planning, and engineering best practices.
• Establish CI/CD pipelines, testing strategies, and DevOps practices.
• Implement robust data quality frameworks, monitoring, and SLAs.
• Ensure compliance with data privacy, security, and regulatory requirements.

Chicago Base pay range: $169,279 – $211,599 per year. This is the range we reasonably expect to pay at hire. Placement within the range depends on job‑related factors such as experience, skills, and certifications. This position is eligible for an annual bonus. Base pay is one part of a total rewards package that includes the benefits listed below.

All of our jobs come with great benefits including healthcare, parental leave and opportunities for career advancements. Some offerings are dependent upon the location of where you work and can include the following:

• Comprehensive full medical, dental and vision Insurance
• Basic Life Insurance at no cost to the employee
• Company paid short‑term and long‑term disability
• 12 weeks of 100% paid Parental Leave
• Health Savings Account (HSA)
• Flexible Spending Accounts (FSA)
• Retirement savings plan
• Personal Paid Time Off
• Paid holidays and company‑wide Wellness Day off
• Paid time off to volunteer at nonprofit organizations
• Pet friendly office environment
• Commuter Benefits
• Group Pet Insurance
• On the job training and skills development
• Employee Assistance Program (EAP)

Interview Technology Notice:

Please note that phone and video interviews or screenings may be recorded and transcribed using interview technology to support our recruitment process.

By continuing with the interview, you consent to this use.

Text Messaging Notice:

If you provide a mobile phone number, you may receive job‑related communications via text message. Message and data rates may apply.

You may opt out of text communications at any time by replying "STOP".