Senior Lead Data Engineer: Cloud, ML & Big Data Lead

JobCubby; Chicago, Northern (IL, KY); Hybrid; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking a Senior Lead Data Engineer in Chicago, IL, to guide a team of engineers building cloud-based data platforms. You will work across agile teams to design, implement, and optimize scalable data pipelines using Java, Python, Scala, and modern data technologies.

Expect mentoring, code reviews, and a focus on performance and reliability. The role emphasizes collaboration with product managers to deliver impactful financial experiences for millions of Americans, with strong

Qualifications

• Bachelor’s Degree required.
• At least 6 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Azure, Google).

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support full-stack solutions.
• Lead a team of developers with ML, distributed microservices, and full-stack systems.
• Utilize Java, Scala, Python and RDBMS/NoSQL databases and cloud data warehousing services (Redshift, Snowflake).
• Mentor engineering colleagues and participate in tech communities.
• Deliver cloud-based solutions enabling millions to achieve financial empowerment.
• Perform unit tests and code reviews to ensure robust, well-tuned software.

Skills

Java

Scala

Python

NoSQL

Redshift

Snowflake

AWS

Azure

GCP

Hadoop

Spark

Kafka

UNIX/Linux

Agile

Machine Learning

Data warehousing

Education

Bachelor's Degree

Master's Degree

Tools

MongoDB

Cassandra

Hadoop

Hive

Spark

Kafka

MySQL

Redshift

Snowflake

Job description

Capital One is seeking a Senior Lead Data Engineer in Chicago, IL, to guide a team of engineers building cloud-based data platforms. You will work across agile teams to design, implement, and optimize scalable data pipelines using Java, Python, Scala, and modern data technologies.

Expect mentoring, code reviews, and a focus on performance and reliability. The role emphasizes collaboration with product managers to deliver impactful financial experiences for millions of Americans, with strong