Remote Data Engineer: Trusted Risk Data Pipelines

Allstate Foundation; Illinois; Remote; USD 100,000 - 171,000; Full time

Benefits offered by this job

Laptop, monitors, headset provided

Connectivity reimbursement for remote/

Job summary

Allstate's Risk Data Team is seeking a Data Engineer to help build the trusted data foundation that enables faster decisions and risk management. You will transform fragmented risk data into reliable information through scalable data pipelines, governed datasets, and analytics-ready data products.

You will work with analytics engineers, product teams, risk partners, platform teams, and governance stakeholders to integrate data from internal platforms and external sources, enabling dashboards,

Qualifications

• 4+ years of experience as a Data Engineer or similar role.
• Hands-on Apache Spark experience at scale.
• Strong Python and SQL skills.
• Experience building ETL/ELT in cloud-based data lake or lakehouse.
• Experience designing analytical data models for reporting and dashboards.
• Familiarity with data quality, monitoring, lineage, and production support.
• Experience with CI/CD and infrastructure-as-code concepts.

Responsibilities

• Design and maintain trusted risk data products and scalable pipelines.
• Integrate data from risk platforms and external sources into governed datasets.
• Develop and optimize ETL/ELT workflows for ingestion, transformation, validation, and delivery.
• Build data processing workloads in data lake/lakehouse environments like Fabric and OneLake.
• Implement data quality, monitoring, lineage, and reconciliation processes.
• Create curated datasets and outputs for reporting, leadership dashboards, and analysis.
• Optimize data architectures, schemas, and processing for scalability and cost efficiency.
• Develop reusable frameworks, CI/CD pipelines, automated testing, and monitoring.
• Collaborate with analytics, product, risk, governance, security, and compliance stakeholders.
• Participate in Agile delivery activities.

Skills

Apache Spark

Python

SQL

ETL/ELT

CI/CD

Data Modeling

Data Pipelines

Tools

Microsoft Fabric

OneLake

Job description

Allstate's Risk Data Team is seeking a Data Engineer to help build the trusted data foundation that enables faster decisions and risk management. You will transform fragmented risk data into reliable information through scalable data pipelines, governed datasets, and analytics-ready data products.

You will work with analytics engineers, product teams, risk partners, platform teams, and governance stakeholders to integrate data from internal platforms and external sources, enabling dashboards,