Lead Data Engineer — Cloud, ML & Big Data Innovator

Socket.dev; New York, Virginia (NY, MN); On-site; USD 215,000 - 246,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One in New York, NY seeks a Lead Data Engineer to design and implement scalable data platforms. You will work across Agile teams to build end-to-end data solutions leveraging Java, Python, SQL and modern data stores.

The role emphasizes collaboration with ML and distributed systems teams, optimizing data pipelines, and mentoring engineers in a fast-paced, inclusive environment. Strong cloud and big data experience are required.

Qualifications

• Bachelor’s degree in a related field.
• 4+ years of experience in application development.
• 2+ years of experience in big data technologies.
• 1+ year experience with cloud computing (AWS, Azure, Google Cloud)

Responsibilities

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
• Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.

Skills

Python

SQL

Scala

Java

Big data

Cloud computing

UNIX/Linux

Agile

NoSQL

Data warehousing

Education

Bachelor's degree

Tools

Redshift

Snowflake

Hadoop

Spark

Kafka

EMR

MySQL

Hive

MapReduce

Job description

Capital One in New York, NY seeks a Lead Data Engineer to design and implement scalable data platforms. You will work across Agile teams to build end-to-end data solutions leveraging Java, Python, SQL and modern data stores.

The role emphasizes collaboration with ML and distributed systems teams, optimizing data pipelines, and mentoring engineers in a fast-paced, inclusive environment. Strong cloud and big data experience are required.