Lead Data Engineer - Cloud, ML & Big Data Innovator

Capital One National Association; Delaware; On-site; USD 179,400 - 225,100; Full time

Benefits offered by this job

Health benefits

Financial benefits

Inclusive benefits

Job summary

Capital One National Association is seeking a Lead Data Engineer to drive data‑engineering initiatives and mentor teams. The role focuses on building scalable data platforms, collaborating across agile teams, and delivering cloud‑based solutions that enable financial empowerment for millions.

You’ll work with Java, Scala, Python, and SQL across big data stacks, with Redshift/Snowflake in a cloud environment, while championing best practices and performance tuning.

Qualifications

• Bachelor’s Degree required.
• At least 4 years of application development experience.
• At least 2 years of big data technologies.
• At least 1 year of cloud computing experience.
• 7+ years of application development including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud (AWS, Azure, Google).
• 4+ years working with distributed data tools (MapReduce, Hadoop, Hive, Kafka, Spark).
• 4+ years of real-time data and streaming applications.
• 4+ years of NoSQL experience (Mongo, Cassandra).
• 4+ years of data warehousing experience (Redshift or Snowflake).
• 4+ years UNIX/Linux including shell scripting.
• 2+ years of Agile engineering practices.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support full‑stack solutions.
• Work with developers experienced in ML, distributed microservices, and full‑stack systems.
• Use Java, Scala, Python and databases; leverage cloud data warehousing services like Redshift and Snowflake.
• Share passion for tech trends, experiment with new tools, and mentor engineering teammates.
• Partner with product managers to deliver cloud‑based solutions that empower users.
• Perform unit tests and code reviews to ensure well‑designed, efficient, and maintainable code.

Skills

Java

Python

Scala

SQL

NoSQL

Spark

Education

Bachelor’s Degree

Tools

Hadoop

Spark

Kafka

Hive

Redshift

Snowflake

EMR

MySQL

Job description

Capital One National Association is seeking a Lead Data Engineer to drive data‑engineering initiatives and mentor teams. The role focuses on building scalable data platforms, collaborating across agile teams, and delivering cloud‑based solutions that enable financial empowerment for millions.

You’ll work with Java, Scala, Python, and SQL across big data stacks, with Redshift/Snowflake in a cloud environment, while championing best practices and performance tuning.