Lead Data Engineer - Cloud & ML Innovator

Capital One National Association; New York (NY); On-site; USD 215,000 - 246,000; Full time

Benefits offered by this job

Performance-based incentives

Comprehensive benefits

Job summary

Capital One is seeking Lead Data Engineers to drive transformation in data engineering across enterprise platforms. You will collaborate with agile teams to design, develop, test, and support data solutions using Java, Scala, Python, SQL, and modern data stores in the cloud.

You will work with ML and distributed microservices, build cloud-based data warehousing with Redshift/Snowflake, and mentor peers while delivering scalable experiences for millions of Americans.

Qualifications

• Bachelor’s degree required.
• At least 4 years of application development experience.
• At least 2 years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Azure, Google Cloud).
• Preferred: 7+ years in application development (Python, SQL, Scala or Java).
• Preferred: 4+ years of public cloud experience (AWS, Azure or Google Cloud).
• Preferred: 4+ years with distributed data tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL).
• Preferred: 4+ years real-time data/streaming apps.
• Preferred: 4+ years NoSQL (Mongo, Cassandra).
• Preferred: 4+ years Redshift or Snowflake data warehousing.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Work with engineers experienced in ML, distributed microservices, and full-stack systems.
• Utilize languages like Java, Scala, Python and SQL; work with RDBMS and NoSQL databases; leverage cloud data warehousing (Redshift, Snowflake).
• Mentor other engineers and stay current with technology trends.
• Deliver cloud-based solutions that empower customers at scale.
• Perform unit tests and code reviews for performance and quality.

Skills

Big data technologies

Python

Java

Scala

SQL

Cloud computing

Education

Bachelor’s Degree

Tools

MapReduce

Hadoop

Hive

EMR

Kafka

Spark

Gurobi

MySQL

Redshift

Snowflake

Job description

Capital One is seeking Lead Data Engineers to drive transformation in data engineering across enterprise platforms. You will collaborate with agile teams to design, develop, test, and support data solutions using Java, Scala, Python, SQL, and modern data stores in the cloud.

You will work with ML and distributed microservices, build cloud-based data warehousing with Redshift/Snowflake, and mentor peers while delivering scalable experiences for millions of Americans.