Data Engineering Leader: Scalable Pipelines

Allstate Private Limited; Northern (KY); Hybrid; USD 120,000 - 194,000; Full time

Benefits offered by this job

Laptop provided

Home internet reimbursement

Competitive compensation

Job summary

Allstate is seeking two Managing Engineers, Data Engineering to lead the design, development, and delivery of scalable data solutions that support digital products, analytics, and business decision-making.

These roles combine hands-on engineering with technical leadership, team development, and delivery accountability. You will partner with Product Managers, Software Engineers, Data Analysts, Architects, and business stakeholders to deliver reliable, secure data products.

Qualifications

• 5+ years designing and delivering data solutions, pipelines, or enterprise software systems.
• 1+ year of technical leadership, mentorship, or project leadership.
• Strong hands-on experience with Python/Java/Scala.
• Experience with batch and streaming data solutions and data architectures.
• Proficiency in SQL, NoSQL, data modeling, and data storage concepts.
• Experience with Docker and Kubernetes.
• Experience with CI/CD, automated testing, and DevOps practices.

Responsibilities

• Lead design, development, and delivery of scalable data solutions for digital products and analytics.
• Mentor Data Engineers and drive engineering best practices and career development.
• Lead or participate in architecture discussions, code reviews, and incident response.
• Collaborate with Product Managers, Engineers, Analysts, and stakeholders to translate needs into technical roadmaps.
• Ensure data solutions are secure, reliable, scalable, and cost-effective.

Skills

Python

Java

Scala

SQL

NoSQL

Spark

Kafka

Flink

Docker

Kubernetes

CI/CD

Data Pipelines

DevOps

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Azure

dbt

Fabric

GitHub Actions

Job description

Allstate is seeking two Managing Engineers, Data Engineering to lead the design, development, and delivery of scalable data solutions that support digital products, analytics, and business decision-making.

These roles combine hands-on engineering with technical leadership, team development, and delivery accountability. You will partner with Product Managers, Software Engineers, Data Analysts, Architects, and business stakeholders to deliver reliable, secure data products.