Senior Data Engineer — Cloud & ML Innovator

JobCubby; Wilmington, Northern (DE, KY); Hybrid; USD 179,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to drive data-centric engineering initiatives across Agile teams. You will design, develop, test, and support full-stack data solutions using Java, Python, Scala, and both SQL and NoSQL databases in cloud environments.

You will work with teams skilled in machine learning, distributed computing, and cloud data warehousing, contributing to scalable, secure data platforms used nationwide.

Qualifications

• Bachelor’s Degree in a related field.
• At least 4 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
• Experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark).

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in machine learning, distributed microservices, and full stack systems.
• Utilize Java, Scala, Python and NoSQL/SQL databases and cloud data warehousing like Redshift or Snowflake.
• Mentor other members of the engineering community and stay current with tech trends.
• Deliver cloud-based solutions that drive experiences and empower users.

Skills

Java

Python

Scala

SQL

NoSQL

Cloud computing

Big data technologies

Education

Bachelor’s Degree

Tools

Redshift

Snowflake

Hadoop

Kafka

Spark

EMR

MySQL

Mongo

Cassandra

Job description

Capital One is seeking a Lead Data Engineer to drive data-centric engineering initiatives across Agile teams. You will design, develop, test, and support full-stack data solutions using Java, Python, Scala, and both SQL and NoSQL databases in cloud environments.

You will work with teams skilled in machine learning, distributed computing, and cloud data warehousing, contributing to scalable, secure data platforms used nationwide.