Lead Data Engineer - Real-Time Intelligent Foundations

Capital One; Virginia (MN); On-site; USD 197,300 - 225,100; Full time

Job summary

Capital One is seeking a Lead Data Engineer to join the Intelligent Foundations and Experiences (IFX) group. You will design, develop, test and support end-to-end data and ML-powered solutions across cloud-based platforms, collaborating with agile teams in a fast-paced environment.

You will code in Java, Scala and Python, work with Redshift/Snowflake, and help build scalable data pipelines and streaming applications for millions of customers.

Qualifications

• Bachelor's degree required.
• 4+ years in application development.
• 2+ years with big data technologies.
• 1+ year cloud computing experience (AWS/Azure/Google Cloud).

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement and support data solutions.
• Work with engineers experienced in ML, distributed microservices, and full-stack systems.
• Deliver robust cloud-based data solutions for real-time experiences.

Skills

Python

SQL

Java

Scala

Hadoop

Spark

Kafka

NoSQL

UNIX/Linux

Agile

AWS

Snowflake

Education

Bachelor's Degree

Tools

Redshift

Snowflake

EMR

Hive

MySQL

Job description

Capital One is seeking a Lead Data Engineer to join the Intelligent Foundations and Experiences (IFX) group. You will design, develop, test and support end-to-end data and ML-powered solutions across cloud-based platforms, collaborating with agile teams in a fast-paced environment.

You will code in Java, Scala and Python, work with Redshift/Snowflake, and help build scalable data pipelines and streaming applications for millions of customers.