Senior Data Engineer - Cloud & Data Platforms

Capital One Group; New York, McLean, Cambridge (NY, VA, MA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is hiring a Data Engineer 5 to join a fast-paced, data-driven transformation across our Enterprise Data Tech group. You will craft cloud-first data solutions, design scalable pipelines, and mentor teammates while collaborating with product managers and engineers to deliver impactful, ML-enabled data experiences for customers.

The role spans New York, Cambridge, and McLean locations, emphasizing a strong data engineering foundation, distributed systems, and modern tools like

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field.
• At least 6 years of application development experience.
• At least 4 years on distributed data systems.
• At least 4 years of SQL experience.
• At least 4 years programming in Python, Java, or Scala.
• At least 4 years designing and developing data pipelines.
• At least 2 years data modeling and end-to-end data solutions with relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Influence a team of developers, data analysts and data scientists with ML and lakehouse knowledge.
• Use Python, Spark and cloud data warehousing (Databricks, Snowflake) skills.
• Mentor peers and stay current with data trends and technologies.
• Work with product managers to deliver cloud-first data solutions.
• Design and deliver cloud data solutions with minimal supervision.
• Enforce common data engineering design patterns for quality and reuse.
• Communicate data outcomes clearly to stakeholders.
• Architect scalable, resilient data pipelines with performance in mind.
• Lead large-scale data initiatives end-to-end and evaluate platform choices like Snowflake vs Databricks.

Skills

SQL

Python

Java

Scala

Spark

Data pipelines

Data modeling

Education

Bachelor's Degree or higher in Computer Science or related field

Tools

Snowflake

Databricks

EMR / Spark

SQL databases

Job description

Capital One is hiring a Data Engineer 5 to join a fast-paced, data-driven transformation across our Enterprise Data Tech group. You will craft cloud-first data solutions, design scalable pipelines, and mentor teammates while collaborating with product managers and engineers to deliver impactful, ML-enabled data experiences for customers.

The role spans New York, Cambridge, and McLean locations, emphasizing a strong data engineering foundation, distributed systems, and modern tools like