Senior Lead Data Engineer — Cloud, ML & Big Data

capitalone; Chicago (IL); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking a Senior Lead Data Engineer to guide a team in building data-driven solutions at scale. You will work across Agile teams to design, develop, test, and support full-stack, cloud-based data platforms using Java, Scala, Python, and distributed data tools.

You will mentor engineers, stay abreast of technology trends, and collaborate with product managers to deliver robust experiences for millions of users. A strong background in big data and cloud technologies is essential.

Qualifications

• Bachelor’s Degree required.
• 6+ years of application development experience.
• 2+ years of big data technologies experience.
• 1+ year of cloud computing experience (AWS, Azure, Google).
• Master’s Degree preferred.
• 9+ years of application development experience including Python, SQL, Scala, or Java.
• 4+ years of public cloud experience.
• 4+ years of distributed data/computing tools like Hadoop, Spark, Hive, etc.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Lead a team of developers with ML, distributed microservices, and full-stack systems.
• Work with Java, Scala, Python and RDBMS/NoSQL databases; use Redshift or Snowflake for cloud data warehousing.
• Mentor engineers, stay current with tech trends, and participate in technology communities.
• Partner with product managers to deliver cloud-based solutions used by millions of Americans.
• Perform unit tests and code reviews to ensure well-architected, high-performance software.

Skills

Team leadership

Mentoring

Agile practices

Problem solving

Communication

Education

Bachelor's Degree

Master’s Degree

Tools

Redshift

Snowflake

Hadoop

Hive

EMR

Kafka

Spark

MapReduce

MySQL

Mongo

Cassandra

Unix/Linux

Job description

Capital One is seeking a Senior Lead Data Engineer to guide a team in building data-driven solutions at scale. You will work across Agile teams to design, develop, test, and support full-stack, cloud-based data platforms using Java, Scala, Python, and distributed data tools.

You will mentor engineers, stay abreast of technology trends, and collaborate with product managers to deliver robust experiences for millions of users. A strong background in big data and cloud technologies is essential.