Senior AWS Event-Driven Data Engineer

State Farm; Tempe (AZ); Hybrid; USD 81,000 - 142,000; Full time

Benefits offered by this job

Health insurance

Annual raise and bonus

Tuition assistance

Retirement plan

Generous time off

Employee development

Job summary

State Farm is seeking a data engineering professional to join our hybrid team in Tempe, AZ. You will design and implement event-driven data pipelines, build canonical data models, and enable real-time analytics for a large contact-center data ecosystem.

You will contribute to a transition toward a lakehouse architecture with Databricks, Delta Lake, and open-source tooling, while ensuring data governance and scalable data products.

Qualifications

• Experience designing and building event-driven data pipelines (Kafka/Kinesis).
• Ability to design shared canonical data models and durable schemas.
• Experience with change-data-capture from operational stores to event streams.
• Proficiency in data modeling (dimensional models, star/snowflake, dbt).
• Strong PySpark and SQL for large-scale data transformation.
• Familiarity with Databricks Lakehouse Platform and Delta Lake.
• Experience with cloud data warehouses (Redshift, Databricks SQL).

Responsibilities

• Define Canonical Data and Event Schemas to govern domain events.
• Design and deliver event-driven architectures using AWS-native services and evolving to Confluent Kafka.
• Build scalable data pipelines (Kinesis, Kafka, Lambda, Glue, Step Functions).
• Implement CDC pipelines from operational stores into domain events.
• Create materialized read models in DynamoDB/OpenSearch/Aurora for near real-time queries.
• Model enterprise data using dimensional models and dbt-based semantic layers.
• Assist Lakehouse transition toward Databricks/Delta Lake/Iceberg.
• Develop data access APIs exposing governed data to analytics and AI.

Skills

Event-driven pipelines

Canonical data models

CDC patterns

Data modeling

PySpark/SQL

Databricks Lakehouse

Kafka/Kinesis

Delta Lake

Cloud data warehouses

CI/CD tooling

Tools

Databricks Lakehouse Platform

OpenSearch

Redshift

Kinesis

Kafka

Terraform

GitLab

Job description

State Farm is seeking a data engineering professional to join our hybrid team in Tempe, AZ. You will design and implement event-driven data pipelines, build canonical data models, and enable real-time analytics for a large contact-center data ecosystem.

You will contribute to a transition toward a lakehouse architecture with Databricks, Delta Lake, and open-source tooling, while ensuring data governance and scalable data products.