Remote Data Engineering Lead

Allstate Northern Ireland Limited; Northern (KY); Hybrid; USD 120,000 - 194,000; Full time

Job summary

Allstate is seeking two Managing Engineers, Data Engineering to lead design, development, and delivery of scalable data solutions that support digital products and analytics. You will mentor data engineers, collaborate with Product Managers, Software Engineers, Data Analysts, and business stakeholders, and drive production-grade data pipelines across batch and streaming workloads.

Required strong hands-on experience with Python/Java/Scala, SQL/NoSQL, Spark, Kafka, and cloud platforms

Qualifications

• 5+ years designing, developing, and supporting data solutions, data pipelines, or enterprise software systems.
• 1+ years of technical leadership, mentorship, or project leadership.

Responsibilities

• Lead the design, development, and delivery of scalable data solutions for digital products and analytics.
• Provide technical leadership, mentorship, and coaching to data engineers.
• Partner with product managers, engineers, analysts, and stakeholders to deliver reliable, secure data products.
• Ensure data pipelines are reliable, secure, scalable, and cost-effective.
• Drive engineering excellence with CI/CD, automated tests, and deployment automation.

Skills

Data engineering

Python

Java

Scala

SQL

NoSQL

Spark

Kafka

Flink

dbt

Docker

Kubernetes

CI/CD

Testing

AWS

Azure

Data governance

Tools

Docker

Kubernetes

Job description

Allstate is seeking two Managing Engineers, Data Engineering to lead design, development, and delivery of scalable data solutions that support digital products and analytics. You will mentor data engineers, collaborate with Product Managers, Software Engineers, Data Analysts, and business stakeholders, and drive production-grade data pipelines across batch and streaming workloads.

Required strong hands-on experience with Python/Java/Scala, SQL/NoSQL, Spark, Kafka, and cloud platforms