Senior Data Engineer - Cloud Data & Lakehouse Architect

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 for Nexus Products in New York, NY. You will design and deliver cloud-first data solutions, collaborating with agile teams to turn business problems into scalable data platforms.

You’ll work with Python, Spark, and a mix of relational and NoSQL databases, deploying on Databricks and Snowflake, while mentoring peers and advancing data practices across the organization. This role offers growth in a dynamic, inclusive tech environment.

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field.
• At least 4 years of experience in application development.
• At least 2 years of experience in distributed data.
• At least 2 years of experience with SQL.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support full-stack data solutions.
• Influence multidisciplinary teams with ML, distributed microservices, lakehouse architecture, and full-stack systems.
• Use Python, Spark, SQL/NoSQL databases, and cloud data warehousing (Databricks, Snowflake).
• Stay current with data trends, explore new technologies, and mentor data team members.
• Collaborate with product managers and engineers to deliver cloud-first data solutions that empower users.
• Independently design and deliver cloud data solutions with minimal supervision.
• Architect and enforce data engineering design patterns for quality and reusability.
• Communicate data outcomes clearly to stakeholders to drive alignment.
• Design and build scalable, resilient data pipelines and platforms.
• Implement data security standards with encryption and access control.

Skills

Python

SQL

Java

Scala

Data pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

EMR

Spark

Databricks

Snowflake

Redshift

Airflow

Dagster

MongoDB

Cassandra

DynamoDB

Job description

Capital One is seeking a Data Engineer 4 for Nexus Products in New York, NY. You will design and deliver cloud-first data solutions, collaborating with agile teams to turn business problems into scalable data platforms.

You’ll work with Python, Spark, and a mix of relational and NoSQL databases, deploying on Databricks and Snowflake, while mentoring peers and advancing data practices across the organization. This role offers growth in a dynamic, inclusive tech environment.