Senior Data Engineer Lead - Big Data Pipelines

Thrivent Financial; Minneapolis (MN); On-site; USD 156,000 - 191,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401k and pension

Paid time off and holidays

Remote/hybrid work option

Job summary

Thrivent Financial is seeking a data engineer to design, develop, and maintain scalable data pipelines using Spark, Hadoop, and Kafka. The role emphasizes data governance, security, and quality, with collaboration across cross-functional teams to transform business capabilities.

You will lead, mentor, and develop engineers while staying current with industry trends. The position is based at Thrivent HQ in Minneapolis and offers a telecommute option from a home office anywhere in the US.

Qualifications

• Minimum of a Bachelor's or foreign equivalent degree in MIS, CS, or related field plus 6 years of progressively responsible post baccalaureate experience as a data engineer.
• At least 6 years of Data Engineering experience with Big Data Technologies: Spark and Hadoop.
• At least 5 years of experience with Python, Java or Scala and architecting big data solutions using Spark and Hadoop.
• At least 4 years of experience building data pipelines, CICD pipelines, and data stores; BI development and data warehousing.
• At least 3 years building data pipelines using Snowflake, Databricks and Kafka.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Hadoop, and Kafka.
• Ensure data governance, security, and quality best practices across pipelines.
• Collaborate with end users and cross-functional teams to improve data availability and accessibility.
• Mentor engineers and contribute to technology strategy and enterprise data architecture.
• Monitor, troubleshoot, and ensure high availability and reliability of data pipelines.

Skills

Spark

Hadoop

Python

Java

Scala

CICD

Education

Bachelor's degree or foreign equivalent in MIS/CS or related field

Tools

Snowflake

Databricks

Kafka

Streamsets

Bamboo

Informatica

IICS

DB2

AWS

Azure

Google Cloud

Docker

Terraform

Job description

Thrivent Financial is seeking a data engineer to design, develop, and maintain scalable data pipelines using Spark, Hadoop, and Kafka. The role emphasizes data governance, security, and quality, with collaboration across cross-functional teams to transform business capabilities.

You will lead, mentor, and develop engineers while staying current with industry trends. The position is based at Thrivent HQ in Minneapolis and offers a telecommute option from a home office anywhere in the US.