Lead Data Engineer: Cloud, Real-Time Analytics & ML

Capital One; Chicago (IL); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to collaborate with Agile teams on end-to-end data solutions. You will work with ML, distributed microservices, and full-stack systems, using Java/Scala/Python and Redshift/Snowflake.

Ideal candidates will have 7+ years in app development, strong cloud and big data experience, and a passion for continuous learning and mentoring within a collaborative engineering culture.

Qualifications

• Bachelor's degree required.
• 4+ years in application development.
• 2+ years in big data technologies.
• 1+ year in cloud computing (AWS, Azure, Google Cloud)
• Experience with Python, SQL, Scala or Java is preferred.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize Java, Scala, Python and RDBMS/NoSQL databases and cloud data warehousing services (Redshift, Snowflake).
• Mentor engineers, stay updated on tech trends, and participate in tech communities.

Skills

Python

SQL

Java/Scala

Big data concepts

Cloud computing

Data modeling

Education

Bachelor's Degree in Computer Science or related field

Tools

AWS

Azure

Google Cloud

Redshift

Snowflake

Hadoop

Hive

EMR

Kafka

Spark

MongoDB

Cassandra

Unix/Linux

MySQL

Job description

Capital One is seeking a Lead Data Engineer to collaborate with Agile teams on end-to-end data solutions. You will work with ML, distributed microservices, and full-stack systems, using Java/Scala/Python and Redshift/Snowflake.

Ideal candidates will have 7+ years in app development, strong cloud and big data experience, and a passion for continuous learning and mentoring within a collaborative engineering culture.