Senior Data Engineer: Cloud-First Lakehouse Architect

Capital One

New York (NY)

On-site

USD 251,000 - 286,000

Full time

2 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Capital One is seeking a Data Engineer in New York to help lead a major data transformation in a cloud-first environment. You will design, build, and optimize data pipelines using Python, Spark, and modern data platforms while collaborating with product managers, software engineers, data scientists and analysts.

The role requires strong SQL, distributed data experience, and hands-on skills with Databricks and Snowflake.

Qualifications

  • Bachelor's degree or higher in CS or related quantitative field.
  • 6+ years of application development experience (Internship experience does not apply).
  • 4+ years of distributed data experience.
  • 4+ years of SQL experience.
  • 4+ years of programming with Python, Java, or Scala.
  • 4+ years of designing and developing data pipelines.
  • 2+ years of data modeling with relational and non-relational databases.

Responsibilities

  • Collaborate with Agile teams to design, develop, test, implement, and support data solutions.
  • Mentor team members and influence developers, data analysts and data scientists.
  • Build cloud-first data solutions and scalable pipelines.
  • Evaluate platform choices like Snowflake vs Databricks for requirements.
  • Communicate data outcomes clearly to stakeholders to drive alignment.
  • Lead end-to-end data initiatives with minimal supervision.

Skills

SQL
Python
Spark
Data pipelines
Cloud platforms

Education

Bachelor's Degree in CS or related field
Master’s Degree (preferred)

Tools

Databricks
Snowflake
EMR

Job description

Capital One is seeking a Data Engineer in New York to help lead a major data transformation in a cloud-first environment. You will design, build, and optimize data pipelines using Python, Spark, and modern data platforms while collaborating with product managers, software engineers, data scientists and analysts.

The role requires strong SQL, distributed data experience, and hands-on skills with Databricks and Snowflake.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: ML, Lakehouse & Cloud Pipelines
Senior Data Engineer: ML, Lakehouse & Cloud Pipelines

Capital One Group • McLean (VA)

Hybrid
USD 179,000 - 225,000
Senior Data Engineer - Cloud-First Pipelines & Lakehouse
Senior Data Engineer - Cloud-First Pipelines & Lakehouse

Capital One • Chicago (IL)

On-site
USD 179,000 - 205,000
Lead Data Engineer, Cloud Data & Real-Time Pipelines
Lead Data Engineer, Cloud Data & Real-Time Pipelines

Capital One National Association • New York (NY)

On-site
USD 215,200 - 245,600
Senior Data Engineer & Technical Lead (IC)
Senior Data Engineer & Technical Lead (IC)

ITSMF • New York (NY)

On-site
USD 215,000 - 246,000
Senior Data Engineer - Python, AWS & Cloud Data
Senior Data Engineer - Python, AWS & Cloud Data

Capital One • Richmond (VA)

On-site
USD 179,000 - 205,000
Senior Data Engineer: Cloud Data Pipelines & ML
Senior Data Engineer: Cloud Data Pipelines & ML

Capital One National Association • Plano (TX)

On-site
USD 179,000 - 205,000
Senior Data Engineer: Cloud-First ML Pipelines
Senior Data Engineer: Cloud-First ML Pipelines

Capital One National Association • McLean (VA)

On-site
USD 197,000 - 225,000
Senior Data Engineer: Cloud Data Pipelines
Senior Data Engineer: Cloud Data Pipelines

Capital One • McLean (VA)

On-site
USD 197,000 - 225,000
Senior Data Engineer — Cloud Data Pipelines
Senior Data Engineer — Cloud Data Pipelines

Capital One • New York (NY)

On-site
USD 215,000 - 246,000
Senior Data Engineer - Cloud Data Pipelines & ML
Senior Data Engineer - Cloud Data Pipelines & ML

Capital One National Association • Virginia (MN), Northern (KY)

Hybrid
USD 179,000 - 225,000