Senior Data Engineer

Independence Pet Group; Chicago (IL); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Comprehensive health insurance

12 weeks paid parental leave

Flexible Spending Accounts (FSA)

Retirement savings plan

Employee Assistance Program (EAP)

Job summary

A leading pet health company is looking for a Senior Data Engineer to design and scale cloud-based data platforms. This role involves collaborating with cross-functional teams to build solutions that enable better decision-making. Ideal candidates should have over 6 years of experience with Python and SQL, as well as familiarity with modern data tools such as AWS, Databricks, and dbt. The position offers a remote or hybrid work option, with a focus on building a strong data ecosystem.

Qualifications

• 6+ years building and scaling cloud-based data platforms and pipelines.
• Strong expertise in Python and SQL.
• Experience with large-scale datasets and event-driven systems.
• Hands-on experience with modern data stack tools (dbt, Airflow, Fivetran, Databricks) and streaming/event-driven systems (Kafka, Kinesis).
• Solid experience with AWS data services and ELT/ETL workflows.
• Proficiency in CI/CD, Git, and infrastructure-as-code.
• Proven ability to lead projects, influence stakeholders, and mentor others.

Responsibilities

• Design, build, and scale cloud-based data platforms and pipelines.
• Own critical data workflows ensuring reliability and quality.
• Collaborate with teams to translate business needs into data solutions.
• Apply best practices in CI/CD, Git, testing, monitoring, and infrastructure-as-code.
• Collaborate effectively with cross-functional teams, translating business needs into scalable data solutions.
• Lead technical initiatives with empathy, mentoring team members and promoting engineering excellence.

Skills

Python

SQL

Cloud-based data platforms

Automation

Data pipeline design

Databricks

Airflow

Tools

AWS

Databricks

dbt

Airflow

Kafka

Job description

. We believe pet insurance is more than a financial product and build solutions to simplify the pet parenting journey and help improve the well-being of pets. As a leading authority in the pet category, we operate with a full stack of resources, capital, and services to support pet parents. Our multi-brand and omni-channel approach include our own insurance carrier, insurance brands and partner brands. **Senior Data Engineer****External name**: Senior Data EngineerEstablished in 2021, Independence Pet Holdings (IPH) is a corporate holding company that manages a diverse and broad portfolio of modern pet health brands and services, including insurance, pet education, lost recovery services, and more throughout North America. We believe pet insurance is more than a financial product and build solutions to simplify the pet parenting journey and help improve the well-being of pets. As a leading authority in the pet category, we operate with a full stack of resources, capital, and services to support pet parents. Our multi-brand and omni-channel approach includes our own insurance carrier, insurance brands and partner brands.**Job Summary:**IDEA (IPH Data & Enterprise Analytics) is IPH’s enterprise data organization responsible for building and operating the data platform, governance framework, and analytics capabilities that power decision-making across all brands. The team brings together experienced data leaders and engineers from across IPH and beyond to create a unified, enterprise-scale data function. Organized around four core pillars—Data Strategy & Planning, Infrastructure & Data Engineering, Enterprise Data Governance, and Analytics & Reporting—IDEA partners with teams across the organization to architect, manage, and activate data & analytics so every IPH team can make faster, smarter, and more informed decisions. As a result, we are looking for a Senior Data Engineer to join the organization. The Senior Data Engineer will play a critical role in shaping IPH’s data ecosystem, building the platforms and pipelines that enable smarter decisions across analytics, product, and operations. This person will bring both technical excellence and a collaborative mindset, designing scalable, high-performance data solutions while ensuring reliability, quality, and accessibility. Ideal candidates have experience in pet insurance or other consumer-facing industries like e-commerce or subscription businesses and are passionate about translating complex business needs into actionable data solutions. Beyond coding and architecture, this role is about fostering strong partnerships across teams, mentoring peers, and championing best practices that make data engineering a force multiplier for the organization.**Job Location:**Remote | Hybrid – United States; Chicago, New York, or Columbus, OH **Main Responsibilities:*** Design, build, and scale cloud-based data platforms and pipelines (batch and streaming) to support analytics, product, and operational use cases.* Own critical data workflows, ensuring reliability, performance, and quality across the data ecosystem.* Implement modern data solutions using tools like dbt, Databricks, ELT frameworks, and other cloud platforms (AWS, Snowflake).* Apply best practices in CI/CD, Git, testing, monitoring, and infrastructure-as-code.* Collaborate effectively with cross-functional teams, balancing technical rigor with strong interpersonal skills to translate business needs into scalable, accessible data solutions.* Lead technical initiatives with empathy and influence, mentoring team members, fostering trust, and promoting shared standards and engineering excellence.**Qualifications:*** 6+ years building and scaling cloud-based data platforms and pipelines.* Strong Python and SQL expertise* Strong SQL and Python skills, with a focus on automation, performance, and reliability.* Experience with large-scale datasets, structured and unstructured* Hands-on experience with modern data stack tools (dbt, Airflow, Fivetran, Databricks) and streaming/event-driven systems (Kafka, Kinesis).* Solid experience with AWS data services and ELT/ETL workflows.* Proficiency in CI/CD, Git, and infrastructure-as-code.* Proven ability to lead projects, influence stakeholders, and mentor others.**Preferred Qualifications:*** Experience designing data platforms at scale in a high-growth or startup environment.* Familiarity with customer-centric tools like Segment, Stripe, Salesforce, or mParticle* Experience supporting analytics, machine learning, or personalization initiatives with robust data foundations.* Knowledge of data privacy and compliance best practices (e.g., GDPR, CCPA).* Prior contributions to open-source projects, internal data tooling, or technical blogs/presentations.All of our jobs come with great benefits including healthcare, parental leave and opportunities for career advancements. Some offerings are dependent upon the location of where you work and can include the following:* Comprehensive full medical, dental and vision Insurance* Basic Life Insurance at no cost to the employee* Company paid short-term and long-term disability* 12 weeks of 100% paid Parental Leave* Health Savings Account (HSA)* Flexible Spending Accounts (FSA)* Retirement savings plan* Personal Paid Time Off* Paid holidays and company-wide Wellness Day off* Paid time off to volunteer at nonprofit organizations* Pet friendly office environment* Commuter Benefits* Group Pet Insurance* On the job training and skills development* Employee Assistance Program (EAP)Established in 2021, **Independence Pet Holdings** is a corporate holding company that manages a diverse and broad portfolio of modern pet health brands and services, including insurance, pet education, lost recovery services, and more throughout North America.**Thanks for visiting our careers page!**ASPCA Pet Health Insurance, Embrace, Felix, Figo, Independence American Insurance Company, Pets Best, Pethealth, PetPartners, PetPlace, and Pumpkin are all operated by **Independence Pet Holdings (IPH)**.At IPH, we welcome and encourage applications from individuals with disabilities. Accommodations are available upon request for candidates participating in all aspects of the selection process.