Mid-Level/Lead Data Engineer-AWS & DB2 (HYBRID)

State Farm; Bloomington, Richardson (IL, TX); Hybrid; USD 86,000 - 124,000; Full time

Benefits offered by this job

Hybrid work model

Competitive benefits

Annual incentive programs

Job summary

State Farm is recruiting a Data Engineer Lead to join the Property & Casualty Data team in Bloomington, IL. The role focuses on building and supporting data pipelines that move data from legacy systems into AWS for analytics and enterprise consumption.

You will work across teams to modernize data capabilities, ensuring data accuracy, security, and reliable operations while leveraging S3, Glue, Athena, and Redshift for scalable cloud solutions.

Qualifications

• Professional Data Engineer experience with data pipelines and analytics.
• Strong programming in Python/Scala/Java and SQL optimization.
• Experience with AWS data services (Glue, EMR, Athena, S3, Redshift).
• Knowledge of ETL processes, data quality, security, and governance.

Responsibilities

• Develop and support data pipelines from legacy systems to AWS.
• Maintain data reliability, security, and performance.
• Collaborate across teams to deliver enterprise data solutions.
• Drive modernization from mainframe to cloud architectures.

Skills

Data engineering

Python/Scala/Java

SQL optimization

AWS (Glue, EMR, S3, Redshift)

ETL pipelines

Problem solving

Communication

CD/CI

Mainframe modernization

Tools

AWS Glue

AWS EMR

Athena

S3

Redshift

Iceberg

Job description

Overview

Being good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. We're moving with urgency to become a Next Gen Good Neighbor, with technology that strengthens human connections and enhances the customer experience. As an employee, you'll spend less time navigating systems and more time applying judgment, empathy, and expertise in the moments that matter most.

Hybrid Work Arrangement: A "Hybrid" position means selected candidates will be assigned to a facility and will spend some time working both in the office and from home. For Enterprise Technology, a hybrid work arrangement will require approximately 40% in‑office time each month, beginning in late 2027. HUB LOCATION: Bloomington, IL, Richardson, TX

SPONSORSHIP: Applicants for this position are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity.

Responsibilities

The Property & Casualty Data team is seeking an experienced Data Engineer/Lead Data Engineer to join us! The Data Engineer will support the Property & Casualty Data tool for z/OS platform and associated data modernization initiatives. This role is responsible for engineering, maintaining, and supporting reliable data pipelines that extract data from legacy systems, make it available through tools, and deliver enterprise data into AWS for analytics and downstream consumption.

This role plays an important part in the continued modernization of Property & Casualty data capabilities, helping transition critical data from legacy platforms to scalable cloud-based solutions while maintaining data accuracy, availability, security, and operational reliability. This position sits within Enterprise Technology and offers the opportunity to work in a highly collaborative environment focused on delivering meaningful business impact. You will partner across teams, solve complex data challenges, and help shape modern data solutions aligned to enterprise goals. It is a strong fit for someone who wants to expand their technical skills, work on high-visibility initiatives, and contribute in a fast-moving, innovative setting.

This is a great opportunity to apply skills in S3, Glue, Athena, and enterprise data lake capabilities to create secure, scalable, and maintainable data solutions to simplify legacy processing, improve performance, automate operational activities, reduce technical debt, and transition appropriate workloads from Mainframe-based solutions to modern cloud architectures.

What's in It for You

• Opportunity to work with innovative technologies across multiple business areas
• Ability to contribute to new concepts and designs
• Being part of a self-empowered team
• Access to customizable skill-level and personal development training
• Opportunity to research and influence the development of new and experimental products
• Influence solution designs with a focus on performance, risk mitigation, and supportability
• Flexible work schedules to support work-life balance

• Potential starting salary range: $85,500 - $124,000
  • Starting salary will be based on skills, background, and experience
  • High end of the range limited to applicants with significant relevant experience
• Potential yearly incentive pay up to 15% of base salary

Qualifications

We Are Seeking Candidates With:

• Utilizes industry-adopted languages and frameworks in coding, testing, security and data engineering practices
• Collects and analyzes information to identify customers’ technical needs, suggest solutions and develop implementation and integration plans (e.g., technical proposals)
• Responsible for the analysis, design, deployment, support, and security of technology to ensure the organization is efficiently managing its technology and data-related assets in accordance with market best-practices and external regulations
• Applies a wide application of complex principles, theories, and concepts in computer science for data engineering solutions
• Ability to learn and adopt new technologies and languages.
• Responsible for the identification, acquisition, cleansing, profiling, and ETL (extracting, transformation, and loading) of data used in analytic discovery and production solution deployment across multiple platforms
• Identify opportunities to simplify legacy processing, improve performance, automate operational activities, reduce technical debt, and transition appropriate workloads from Mainframe-based solutions to modern cloud architectures.
• Ability to identify and apply industry-standard solutions to complex problems
• Monitor daily processing, troubleshoot failures, perform root-cause analysis, implement recovery procedures, and develop long-term solutions that reduce manual intervention and improve operational reliability.
• Develop and support data movement from legacy environments into AWS, including daily delta processing and cloud-based data consolidation.
• Commitment and experience with continuous delivery practices
• Collaborative mindset to engage effectively with team members from diverse technical and business backgrounds
• Agility to quickly adapt to evolving environments
• Excellent verbal and written communication skills with the ability to explain data concepts clearly to technical and non-technical partners.
• Dedication to achieving high-quality results efficiently
• Understanding secure and compliant data handling, including access controls, auditability, retention, and sensitive-data considerations.
• Troubleshooting/problem solving skills
• Demonstrated high levels of ownership, initiative, and collaboration/teamwork to work within a team and across multiple business teams daily on development and production support items.
• Leadership abilities in planning, requirements, development, testing(unit/integration/regression/performance), and service of applications supported Works well in fast-paced, ambiguous, and changing environment
• Curiosity, ownership, and willingness to learn new tools, platforms, and business domains quickly.

Additional Skills

• Professional experience as a Data Engineer.
• Proficiency in programming languages such as Python, Scala, Java, Bash, etc.
• Hands-on experience with AWS services including ETL tools (Glue, EMR Serverless), Lambda, Step Functions, EventBridge, S3, Kinesis Firehose, Redshift, and Iceberg.

• Experience with AWS solutions including Red Hat OpenShift (ROSA), AWS Lambda, Databricks, Python, GO, GraphQL, Glue, Event Bridge, S3, SNS topics, SQS, Iceberg, and Athena
• Strong understanding of mainframe and relational database systems.

• Data access skills using SQL, and Athena.
• Experience in designing, building, and maintaining data pipelines for automated data processing.
• Experience with infrastructure as code tools such as OpenTofu (formerly Terraform) for managing cloud resources and deployments.
• Familiarity with CI/CD pipelines including automated testing, and security scans.
• Knowledge of auditing and monitoring tools: Dynatrace, AWS QuickSight and Cloudwatch.

• Strong data domain knowledge
• Python and/or other data engineering languages, SQL optimization, automation, source control, troubleshooting, monitoring, and production support.

Development Practices

• Continuous Integration/Continuous Deployment (CI/CD)
• Test-Driven Development (TDD)
• Paired Programming

Competencies

• Adaptability
• Work Ethic
• Critical Thinking
• Strategic Business Focus
• Technical/Functional Expertise

Our Benefits

Because work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!

• Potential starting salary range: $85,500 - $124,000
  • Starting salary will be based on skills, background, and experience
  • High end of the range limited to applicants with significant relevant experience
• Potential yearly incentive pay up to 15% of base salary

At State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!

• Get Paid! On top of our competitive pay, you are eligible for an annual raise and bonus.
• Stay Well! Focus on you and your family’s health with our robust health and wellbeing programs. State Farm pays most of your healthcare premium, and we offer multiple healthcare plan options, including a high deductible plan. All medical plans provide 100% coverage for in-network preventative care, AND you and your family have access to vision, dental, telemedicine, 24/7 mental health professionals, and much more!
• Develop and Grow! Take advantage of educational benefits like industry leading training programs, top-notch tuition assistance programs, employee resource groups, and mentoring.
• Plan Ahead! Plan for those big moments in life with benefits like fertility/IVF/adoption assistance, college coaching, national discount programs, interactive monthly financial workshops, free financial coaching, and more. You can also start a savings account or consider financing through our State Farm Federal Credit Union!
• Take a Little "You" Time! You will have access to our generous time off policies designed so you can plan around holidays, family events, volunteering, or just to take a relaxing day off. With the opportunity to initially earn up to 20 days annually plus parental leave, paid holidays, celebration day, life leave (40 hours/year), bereavement leave, and community service/education support days, there will be plenty of time for you!
• Give Back! We offer several ways to give back through our Matching Gift Program, Good Neighbor Grant Program, and the Employee Assistance Fund.
• Finish Strong! Plan for retirement using free financial advisors and a 401(k) plan with company contributions of up to 7% of your salary.

Visit our State Farm Careers page for more information on our benefits, locations, and the hiring process of joining the State Farm team!