Lead Data Engineer — Cloud, ML & Big Data Innovation

Capital One National Association; Wilmington (DE); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to build and transform data solutions across cloud-based platforms. You will collaborate with Agile teams, work with ML and distributed microservices, and utilize Java, Scala, Python, and SQL/NoSQL databases alongside Redshift and Snowflake for data warehousing.

Ideal candidates have 7+ years in development, strong cloud experience, and a track record with streaming data and real-time processing. Wilmington, DE location.

Qualifications

• Bachelor's degree required.
• At least 4 years in application development.
• At least 2 years in big data technologies.
• At least 1 year of cloud computing experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Work with developers focused on machine learning, distributed microservices, and full stack systems.
• Utilize Java, Scala, Python and RDBMS/NoSQL databases plus cloud data warehousing like Redshift or Snowflake.
• Mentor teammates and share knowledge across the engineering community.
• Deliver cloud-based solutions that empower users and drive performance.

Skills

Java

Scala

Python

Cloud computing

Big data

Streaming data

NoSQL

SQL

Machine learning

Unix/Linux

Agile

Distributed systems

Education

Bachelor’s Degree

Tools

Hadoop

Kafka

Spark

EMR

Redshift

Snowflake

MongoDB

Cassandra

MySQL

Job description

Capital One is seeking a Lead Data Engineer to build and transform data solutions across cloud-based platforms. You will collaborate with Agile teams, work with ML and distributed microservices, and utilize Java, Scala, Python, and SQL/NoSQL databases alongside Redshift and Snowflake for data warehousing.

Ideal candidates have 7+ years in development, strong cloud experience, and a track record with streaming data and real-time processing. Wilmington, DE location.