Lead Data Engineer: Real-Time Data & ML Solutions

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer in New York, NY to drive data-centric solutions across Agile teams. You’ll design, develop, test, and support full-stack data platforms, focusing on large-scale data pipelines with Java/Scala/Python and Cloud data warehousing (Redshift/Snowflake).

You will collaborate with ML experts and distributed microservices teams, mentor peers, and ensure robust, well-tested code with performance tuning in a fast-paced, inclusive environment.

Qualifications

• Bachelor’s Degree required.
• 4+ years in application development.
• 2+ years in big data technologies.
• 1+ year cloud computing with AWS/Azure/Google Cloud.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support solutions.
• Work with developers experienced in ML, distributed microservices, and full stack systems.
• Use Java, Scala, Python and RDBMS/NoSQL with Redshift/Snowflake.
• Mentor engineers and participate in knowledge sharing.
• Collaborate with product managers to deliver cloud-based solutions for financial empowerment.
• Perform unit tests and code reviews for performance and quality.

Skills

Data engineering

Big data

Cloud computing

Java

Scala

Python

NoSQL

Redshift

Snowflake

Unix/Linux

AWS

Azure

Google Cloud

MySQL

Spark

MapReduce

Hadoop

Hive

EMR

Kafka

Education

Bachelor’s Degree

Tools

Spark

MapReduce

Hadoop

Hive

EMR

Kafka

MySQL

Job description

Capital One is seeking a Lead Data Engineer in New York, NY to drive data-centric solutions across Agile teams. You’ll design, develop, test, and support full-stack data platforms, focusing on large-scale data pipelines with Java/Scala/Python and Cloud data warehousing (Redshift/Snowflake).

You will collaborate with ML experts and distributed microservices teams, mentor peers, and ensure robust, well-tested code with performance tuning in a fast-paced, inclusive environment.