Senior Data Engineer, Cloud Platforms & Pipelines

Capital One National Association; New York (NY); On-site; USD 251,000 - 286,000; Full time

Benefits offered by this job

Sponsorship for employment

Job summary

Capital One is seeking a Data Engineer 5 to join Enterprise Platforms Technology. The role focuses on building cloud-first data solutions, leading data pipelines, and guiding cross-functional teams across ML and distributed systems.

You will work with Python, Spark, Databricks, and Snowflake to transform data into impactful insights. The position requires strong SQL, coding in Python/Java/Scala, and experience designing end-to-end data solutions.

Qualifications

• Bachelor's degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 6 years of experience in application development
• At least 4 years of experience in distributed data
• At least 4 years of experience with SQL
• At least 4 years of experience programming with Python, Java, or Scala
• At least 4 years of experience designing and developing data pipelines
• At least 2 years of experience in data modeling and end-to-end data solutions using relational and non-relational databases
• Preferred: Master’s degree; 8+ years of data engineering; 4+ years data modeling; 9+ years in application development; 5+ years cloud data workloads; 5+ years data workloads with Spark/Databricks; 5+ years real-time/streaming data; 3+ years data observability or orchestration tools; 5+ years NoSQL data; 5+ years data warehousing; 3+ years Agile; 3+ years data products

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
• Influence a team of developers, data analysts and data scientists with experience in machine learning and distributed systems
• Use Python and Spark with cloud-based data warehousing platforms like Databricks and Snowflake
• Mentor other data community members and stay current with data trends
• Collaborate with product managers and software engineers to deliver cloud-first data solutions for millions of Americans
• Design, build, and deliver cloud data solutions with minimal supervision
• Architect and enforce common data engineering patterns for quality and reusability
• Communicate technical concepts and data outcomes to stakeholders
• Design and build scalable, resilient data pipelines and platforms
• Balance hands-on contribution with mentoring to elevate peers
• Lead large-scale data initiatives end-to-end and evaluate platform choices like Snowflake vs Databricks

Skills

Python

SQL

Java

Scala

Machine learning

Education

Bachelor's degree in Computer Science or related quantitative field

Master’s degree in Computer Science or related field (preferred)

Tools

Databricks

Snowflake

Spark

Job description

Capital One is seeking a Data Engineer 5 to join Enterprise Platforms Technology. The role focuses on building cloud-first data solutions, leading data pipelines, and guiding cross-functional teams across ML and distributed systems.

You will work with Python, Spark, Databricks, and Snowflake to transform data into impactful insights. The position requires strong SQL, coding in Python/Java/Scala, and experience designing end-to-end data solutions.