Remote Data Architect & Analytics Leader

Allstate; Alton (IL); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Monthly connectivity reimbursement

Work from home policy

Job summary

Allstate is seeking a senior Data Expert to lead architecture and engineering of enterprise data solutions across cloud, lakehouse, and streaming platforms. The role requires deep expertise in data modeling, distributed processing, and modern data tooling.

You will drive standards, governance, and resilience while guiding multi-team initiatives. You will design scalable data architectures, oversee data ingestion, transformation, storage, and consumption, and mentor engineers across the

Qualifications

• Expert-level knowledge of data architecture, data engineering, distributed processing, data integration, and data modeling.
• Advanced proficiency in Python, PySpark, Scala, SQL, or comparable languages used for large-scale data processing.
• Advanced understanding of Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Notebooks, Dataflows Gen2, and Semantic Models.
• Advanced SQL expertise, including query optimization and performance tuning.
• Strong understanding of relational, dimensional, NoSQL, and distributed data modeling techniques.
• Experience designing reusable frameworks and enterprise-scale data processing patterns.
• Strong knowledge of cloud architecture and data services within Microsoft Azure and/or AWS.
• Advanced understanding of engineering practices including Git, CI/CD, automated testing, infrastructure/deployment automation, and release management.
• Experience with observability platforms such as Datadog and designing operational monitoring for enterprise data solutions.
• Strong understanding of data governance, metadata, lineage, data quality, security, privacy, and retention principles.
• Demonstrated ability to troubleshoot complex distributed data and production problems.
• Experience designing large-scale solutions on Microsoft Fabric and Azure.
• Experience modernizing legacy data warehouse, ETL, or enterprise data processing environments into cloud/lakehouse architectures.
• Experience developing metadata-driven data processing and orchestration frameworks.
• Experience with event-driven and real-time data architectures.
• Experience establishing enterprise data engineering standards, reusable frameworks, or reference architectures.
• Experience with data cataloging, lineage, governance, and observability capabilities.
• Experience applying generative AI and agentic AI technologies to data engineering and operational use cases.
• Experience leading architecture reviews, proof-of-concepts, technology evaluations, and complex platform modernization efforts.
• 10 or more years of relevant technology, data engineering, data architecture, or data platform experience (Preferred).
• ~ Significant experience designing and delivering complex, enterprise-scale data solutions.
• ~ Data Analysis, Data Governance, Data Modeling, Data Pipelines, Enterprise Data, Technical Strategy Compensation

Responsibilities

• Lead architecture and design of enterprise-scale data solutions across cloud, lakehouse, warehouse, streaming, and analytical platforms.
• Define scalable patterns for data ingestion, transformation, storage, integration, consumption, and lifecycle management.
• Provide technical direction for initiatives involving multiple applications, domains, platforms, and teams.
• Establish standards for data modeling, interoperability, metadata, lineage, security, performance, and integration.
• Lead technical design reviews and evaluate trade-offs for scalability, reliability, and cost.
• Serve as escalation point for complex data challenges across architecture and production.
• Guide modernization of legacy data platforms using modern cloud and distributed data tech.
• Design scalable processing solutions using Fabric and cloud services.
• Mentor engineers and help develop advanced engineering and architecture capabilities across the organization.
• Create technical documentation, reference architectures, standards, and reusable guidance.

Skills

Data architecture

Data engineering

SQL

Python

PySpark

Scala

Data modeling

Tools

Datadog

Git

CI/CD

Apache Spark

dbt

Job description

Allstate is seeking a senior Data Expert to lead architecture and engineering of enterprise data solutions across cloud, lakehouse, and streaming platforms. The role requires deep expertise in data modeling, distributed processing, and modern data tooling.

You will drive standards, governance, and resilience while guiding multi-team initiatives. You will design scalable data architectures, oversee data ingestion, transformation, storage, and consumption, and mentor engineers across the