Lead Data Engineer - AI-Powered Data Pipelines (Hybrid)

State Farm; Bloomington (IN); Hybrid; USD 90,000 - 150,000; Full time

Benefits offered by this job

Salary range $90k-$150k

Yearly incentive up to 14%

Benefits package

Job summary

State Farm is hiring a Mid-Level/Lead Data Engineer to build scalable data pipelines and governance for AI-powered applications. The role collaborates with Microsoft engineering and product teams to enable Power Platform, AI, and enterprise data solutions across the organization.

The position emphasizes designing secure, scalable data architectures, applying DataOps, and contributing to modern cloud data initiatives within a hybrid work model based near a hub location.

Qualifications

• 3+ years building production data pipelines, integrations, or data solutions.
• 3+ years SQL querying, data transformation, and data modeling.
• 2+ years Python for data engineering, automation, or pipeline development.
• 2+ years cloud data technologies such as Microsoft Fabric, Azure Data Factory, Synapse, Databricks, Snowflake.
• Experience with DataOps practices: version control, automated testing, CI/CD, deployment.
• Experience with structured, semi-structured, and unstructured data.
• Strong analytical and problem-solving skills; good written and verbal communication.

Responsibilities

• Design, build, and maintain scalable data pipelines and data solutions.
• Develop reusable data products for AI, Power Platform, analytics, and enterprise automation.
• Prepare, integrate, and deliver trusted data for intelligent applications and AI use cases.
• Collaborate with software engineers, architects, and business partners to deliver data solutions.
• Transform, cleanse, profile, and validate data from enterprise sources and external data.
• Apply CI/CD, testing, and DataOps practices to data projects.
• Contribute to modern cloud data architecture and evaluate emerging tech.

Skills

Data engineering

SQL

Python

DataOps

Cloud data platforms

Collaboration

Problem solving

Tools

Microsoft Fabric

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Snowflake

Job description

State Farm is hiring a Mid-Level/Lead Data Engineer to build scalable data pipelines and governance for AI-powered applications. The role collaborates with Microsoft engineering and product teams to enable Power Platform, AI, and enterprise data solutions across the organization.

The position emphasizes designing secure, scalable data architectures, applying DataOps, and contributing to modern cloud data initiatives within a hybrid work model based near a hub location.