Lead Data Engineer, AWS – Hybrid Work Environment

State Farm; Arizona; Hybrid; USD 110,000 - 150,000; Full time

Job summary

State Farm seeks a Data Engineer or Lead Data Engineer to join the SAIL team within the Applied Innovation Lab, focused on Agency and Digital. You will design and build data capabilities to enable experimentation, product development, and emerging technology solutions.

The ideal candidate will have strong data engineering fundamentals, comfort working in ambiguity, and the ability to mentor others while collaborating across technical and business teams.

Qualifications

• 3+ years of Python development for extracting, transforming, processing, and moving data.
• Proficiency writing SQL queries and working with relational databases.
• Experience designing, building, and maintaining ETL/ELT data pipelines.
• Experience with structured, semi-structured, and unstructured data (CSV, JSON, text).
• Experience with AWS services (S3, Glue, Lambda).
• Experience using Git and modern version-control practices.
• Familiarity with CI/CD practices and deploying code into shared or production environments.
• Comfort with Linux and command-line environments.
• Understanding of software engineering principles: testing, maintainability, observability, reusable design.
• Ability to troubleshoot data quality, pipeline, integration, and performance issues.

Responsibilities

• Write code to move and transform data and support data access across teams.
• Collaborate with software engineers and product teams to determine how data can be accessed and analyzed.
• Design and maintain platforms where structured and unstructured data lives.
• Lead data science, machine learning, and generative AI efforts as needed, across the lifecycle from exploration to deployment.
• Provide technical leadership, mentoring, and influence architectural practices within the team.

Skills

Python development

SQL

ETL pipelines

Data formats (CSV/JSON)

AWS

Git

CI/CD

Linux

Testing/Observability

Data quality

Tools

S3

Glue

Lambda

Git

CI/CD tools

Job description

State Farm seeks a Data Engineer or Lead Data Engineer to join the SAIL team within the Applied Innovation Lab, focused on Agency and Digital. You will design and build data capabilities to enable experimentation, product development, and emerging technology solutions.

The ideal candidate will have strong data engineering fundamentals, comfort working in ambiguity, and the ability to mentor others while collaborating across technical and business teams.