Lead Data Engineer (AWS) - Hybrid Data Platforms

ITSMF; Tempe (AZ); Hybrid; USD 110,000 - 160,000; Full time

Job summary

State Farm’s Innovation Group in Tempe seeks a Data Engineer or Lead Data Engineer to join the SAIL team focused on Agency and Digital. You will design and build the data capabilities that enable experimentation, product development, and emerging technology solutions.

You will collaborate with software engineers, product teams, and business partners to move and transform data, access and analyze data, and maintain production-quality data platforms in a hybrid work environment.

Qualifications

• 3+ years with Python development for ETL/ELT data pipelines.
• Proficiency writing SQL queries and working with relational databases.
• Experience designing, building, and maintaining ETL/ELT pipelines.
• Experience with structured, semi-structured, and unstructured data (CSV, JSON, text).
• Experience with AWS services S3, Glue and Lambda.
• Familiarity with Git and modern version-control practices.
• Familiarity with CI/CD practices and deploying code into production.
• Comfort with Linux and command-line environments.
• Understanding of testing, maintainability, observability, and reusable design.
• Ability to troubleshoot data quality, pipeline, and performance issues.

Responsibilities

• Write code to move and transform data and design robust data platforms.
• Partner with software engineers and product teams to access, analyze, and use data.
• Design and maintain platforms where structured and unstructured data lives.
• Lead data science, ML, and generative AI efforts across the lifecycle.

Skills

Python development

SQL queries

ETL/ELT pipelines

Data formats (CSV/JSON/Text)

AWS

Git

CI/CD

Linux

Software engineering fundamentals

Data quality troubleshooting

Data architectures

ML lifecycle familiarity

LLMs & generative AI concepts

APIs & event-driven architectures

Tools

AWS

S3

Glue

Lambda

Job description

State Farm’s Innovation Group in Tempe seeks a Data Engineer or Lead Data Engineer to join the SAIL team focused on Agency and Digital. You will design and build the data capabilities that enable experimentation, product development, and emerging technology solutions.

You will collaborate with software engineers, product teams, and business partners to move and transform data, access and analyze data, and maintain production-quality data platforms in a hybrid work environment.