Data Engineer, Cloud Resilience & Platform Innovation

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 (Cloud Operations Resilience Engineering) in New York, NY. You will collaborate with Agile teams to design, develop, and deploy scalable cloud data solutions using Python, Spark, Databricks, and Snowflake.

The role requires extensive experience in distributed data, data pipelines, and data modeling across relational and NoSQL systems, with a focus on resilience and operational efficiency.

Qualifications

• Bachelor's Degree or higher in CS or related quantitative field.
• 6+ years in application development.
• 4+ years distributed data experience.
• 4+ years SQL experience.
• 4+ years programming in Python/Java/Scala.
• 4+ years designing and developing data pipelines.
• 2+ years data modeling end-to-end with relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support full-stack data solutions.
• Influence a team of developers, data analysts, and data scientists.
• Utilize Python, Spark, SQL with Databricks/Snowflake for cloud data warehousing.
• Mentor data community members and share new data technologies.
• Deliver robust cloud-first data solutions that empower users.
• Design, build, and deliver cloud data applications with minimal supervision.
• Architect common data engineering design patterns for maintainability.
• Communicate technical concepts and data outcomes to stakeholders.
• Design data pipelines with focus on scalability, resilience, and efficiency.
• Balance hands-on work with mentoring peers.
• Lead large-scale data initiatives and evaluate platform choices (Snowflake vs Databricks).

Skills

Python

SQL

Spark

Java

Data pipelines

Cloud computing

Education

Bachelor's Degree in Computer Science or related field

Master's Degree in Computer Science or related field

Tools

Databricks

Snowflake

EMR

Airflow

Dagster

Job description

Capital One is seeking a Data Engineer 5 (Cloud Operations Resilience Engineering) in New York, NY. You will collaborate with Agile teams to design, develop, and deploy scalable cloud data solutions using Python, Spark, Databricks, and Snowflake.

The role requires extensive experience in distributed data, data pipelines, and data modeling across relational and NoSQL systems, with a focus on resilience and operational efficiency.