Lead Data Engineer — GCP & Big Data ETL Lead

American Family Insurance; Englewood (CO); On-site; USD 131,000 - 220,000; Full time

Benefits offered by this job

Relocation support

Medical, dental, vision benefits

401(k) plan

Pension plan

Annual incentive

9 paid holidays

Paid time off 23 days

Job summary

American Family Insurance in Englewood, CO seeks an experienced Data Engineer Lead to design and scale our data platform. You will lead an engineering team, supervise data engineering activities, and ensure data quality across the lifecycle.

You will build ETL pipelines in Python, work with GCP, SQL/NoSQL stores, and open source ML tools, while advocating patterns and collaborating with architecture and business stakeholders.

Qualifications

• Must have GCP experience for this position.
• Extensive Python programming experience with ETL workflows.
• Strong SQL or NoSQL knowledge with multiple data stores.
• Experience with Hadoop or Spark for distributed data processing.
• Knowledge of open-source ML toolkits (e.g., sklearn, SparkML, H2O).
• Data modeling knowledge: dimensional modeling and star schemas.
• Experience with infrastructure-as-code tools (Docker, CloudFormation, Terraform).
• Experience with CI/CD workflows (Jenkins, Git).
• Ability to author robust, reusable code and libraries.

Responsibilities

• Leads an engineering team to meet project deadlines and priorities.
• Supervises data engineering team members and activities.
• Ensures data quality, security, privacy, and integrity across the lifecycle.
• Documents critical workflows and operational support aspects.
• Develops deep understanding of data sources, granularity and limitations.
• Provides analytical oversight to architecture and development teams.
• Creates maintainable, scalable code to load and manipulate data.
• Facilitates communication with project teams and stakeholders.

Skills

GCP

Python

ETL pipelines

SQL/NoSQL

Data modeling

Distributed processing

ML toolkits

Code reuse/patterns

CI/CD

Web services

Tools

Docker

CloudFormation

Terraform

Jenkins

Git

Job description

American Family Insurance in Englewood, CO seeks an experienced Data Engineer Lead to design and scale our data platform. You will lead an engineering team, supervise data engineering activities, and ensure data quality across the lifecycle.

You will build ETL pipelines in Python, work with GCP, SQL/NoSQL stores, and open source ML tools, while advocating patterns and collaborating with architecture and business stakeholders.