Cloud Data Engineer, Resilience & Pipelines Lead

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 to drive cloud-first data solutions in New York, collaborating with agile teams across data, analytics, and software engineering. You will design pipelines, use Python and Spark, and work with Databricks and Snowflake to enable scalable data platforms for business insights.

The role emphasizes leadership in data engineering practices, security compliance, and delivering robust data capabilities to empower financial services at scale.

Qualifications

• Bachelor's degree in a CS or related quantitative field is required.
• At least 4 years of application development experience.
• At least 2 years of SQL experience across data platforms.
• At least 2 years of experience in data pipeline design and development.
• At least 2 years of experience in one programming language (Python, Java, or Scala).
• At least 1 year of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Influence teams with ML, microservices, lakehouse architecture and full‑stack systems.
• Design and build cloud-first data pipelines and platforms for scalability and resilience.
• Implement data security standards and access controls.
• Communicate data outcomes to stakeholders and mentor teammates.

Skills

Distributed data

Data pipelines

Data modeling

Cloud computing

Python/Java/Scala

SQL proficiency

Education

Bachelor's Degree in Computer Science or related quantitative field

Tools

Databricks

Snowflake

SQL

Python

Spark

EMR

NoSQL databases (MongoDB, Cassandra, DynamoDB)

Job description

Capital One is seeking a Data Engineer 4 to drive cloud-first data solutions in New York, collaborating with agile teams across data, analytics, and software engineering. You will design pipelines, use Python and Spark, and work with Databricks and Snowflake to enable scalable data platforms for business insights.

The role emphasizes leadership in data engineering practices, security compliance, and delivering robust data capabilities to empower financial services at scale.