Lead Data Engineer – Business & Competitive Intelligence

Allstate Insurance Company; United States; Remote; USD 85,000 - 153,000; Full time

Job summary

A leading company is seeking a Data Engineer to design and manage data infrastructure projects. The role involves working with analytics and Data Science teams to create innovative data solutions. Ideal candidates will have a bachelor's degree and relevant experience in data engineering and analysis. The position offers a flexible environment that values diversity and inclusion.

Qualifications

• 3+ years of relevant experience preferred.
• Equivalent education and experience may be considered.

Responsibilities

• Develop new concepts and prototypes for data solutions.
• Perform data exploration, engineering, testing, and implementation.
• Collaborate closely with Data Science and business partners.

Skills

Data Engineering

Data Analysis

Agile Methodologies

Collaboration

Education

4-year Bachelor’s Degree

Tools

Oracle

MongoDB

SQL

Python

Spark

Kafka

Scala

Hadoop

Job description

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. For more than 90 years, our innovative drive has kept us ahead of our customers’ evolving needs, from advocating for seat belts and air bags to leading in pricing sophistication, telematics, and device and identity protection.

Job Description

This role is responsible for designing, developing, and managing data infrastructure projects and proof of concept business solutions for users in analytics and Data Science. The person in this role works directly with business users, data scientists, and analytic engineers to identify needs and develop tactical solutions. The role involves executing new data engineering initiatives for Data Science and analytics, from inception and prototyping to fully developed solutions and transition to Allstate technology.

Key Responsibilities

1. Partner with teams to develop new concepts, proof of concept designs, and prototypes for data solutions, enabling business users or predictive modelers to understand and explore features before implementation.
2. Perform data exploration, engineering, testing, and implementation.
3. Guide peers and partners on technical solutions, understanding the changing needs of users and Data Scientists, and assisting in goal development and work tracking.
4. Develop enterprise data assets and platforms for data exploration and understanding, supporting data engineering environments, and ensuring data quality through monitoring and validation.
5. Leverage agile data analysis with fluency in technologies such as Oracle, MongoDB, SQL, Python, Spark, Kafka, Scala, and Hadoop to meet dynamic business needs.
6. Rapidly develop new data and analytics work tracks with quick iterations over sprints.
7. Support the development of data infrastructure for predictive modeling and analytics.
8. Create test plans, prepare test data, reconcile data sources, and execute functional tests.
9. Participate in requirements gathering, breaking down business problems, and documenting requirements.
10. Collaborate closely with Data Science and business partners requiring subject matter expertise.
11. Mentor team members and promote an environment of innovation and process improvement.

Education

• 4-year Bachelor’s Degree (preferred)

Experience

• 3+ years of relevant experience (preferred)

Supervisory Responsibilities

• This position does not have supervisory duties.

Additional Information

• Equivalent education and experience may be considered in lieu of formal education requirements.

Compensation for this role ranges from $85,600 to $152,650 annually, based on experience and qualifications. The candidate will be required to undergo a background check.

Joining Allstate is an opportunity to challenge yourself, grow your skills, and make a meaningful impact. We foster a flexible environment that values connection and belonging, supported by multiple diversity and inclusion awards.

Additional Notes

Allstate generally does not sponsor employment-based visas for this position. We are committed to equal employment opportunity and prohibit discrimination based on various protected characteristics. For more information, please review our policies linked within the job posting.