Remote Senior Data Engineer: Build Scalable Data Pipelines

Allstate Corporation; Illinois; Remote; USD 80,000 - 137,000; Full time

Job summary

Allstate Corporation seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines and products in a fully remote role covering the USA-IL region. You will partner with product managers, software engineers, and data analysts to deliver trusted data for digital products and analytics, using modern data engineering practices and Fabric Notebooks.

You will own end-to-end data product lifecycles, implement data models, ensure quality and observability, and optimize performance,

Qualifications

• Strong proficiency in developing scalable data pipelines.
• Experience with modern data engineering frameworks and tools.
• Strong SQL, NoSQL, data modeling and architecture knowledge.
• Experience with batch and real-time data processing pipelines.

Responsibilities

• Design, build and own scalable data products and pipelines.
• Collaborate with product managers, engineers and data analysts to power analytics.
• Ensure data quality, governance, and reliability across data flows.
• Document data lineage and support production operations and optimization.

Skills

PySpark

Python

SQL

NoSQL

Apache Spark

Kafka

Flink

dbt

Microsoft Fabric Notebooks

Docker

Kubernetes

Datadog

Azure

AWS

Data Pipelines

Tools

Datadog

Job description

Allstate Corporation seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines and products in a fully remote role covering the USA-IL region. You will partner with product managers, software engineers, and data analysts to deliver trusted data for digital products and analytics, using modern data engineering practices and Fabric Notebooks.

You will own end-to-end data product lifecycles, implement data models, ensure quality and observability, and optimize performance,