Cloud Data Engineer – Resilience & Operations

Capital One; Riverwoods (IL); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking an experienced Data Engineer 5 (Cloud Operations Resilience Engineering) to drive end-to-end cloud data solutions. You will collaborate with cross-functional teams and mentor peers while shaping scalable data pipelines and platform decisions across the data ecosystem.

You will work with Python, Spark, SQL and cloud data warehousing on Databricks and Snowflake, contributing to a major technology transformation at Capital One in Riverwoods, IL.

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field.
• At least 6 years of experience in application development.
• At least 4 years of experience in distributed data.
• At least 4 years of experience with SQL.
• At least 4 years of experience programming with Python, Java, or Scala.
• At least 4 years of experience designing and developing data pipelines.
• At least 2 years of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support data solutions.
• Influence a team of developers, data analysts, and data scientists on architecture and platforms.
• Build data pipelines and platforms focusing on scalability, resilience, and efficiency.
• Architect and enforce common data engineering design patterns across pipelines and platforms.
• Communicate data outcomes clearly to stakeholders to drive alignment.

Skills

Python

SQL

Distributed data

Data pipelines

Data modeling

Cloud

Education

Bachelor's Degree or higher in CS or related field

Master's Degree in CS or related field

Tools

Databricks

Snowflake

Spark

EMR

Airflow

Glue

Job description

Capital One is seeking an experienced Data Engineer 5 (Cloud Operations Resilience Engineering) to drive end-to-end cloud data solutions. You will collaborate with cross-functional teams and mentor peers while shaping scalable data pipelines and platform decisions across the data ecosystem.

You will work with Python, Spark, SQL and cloud data warehousing on Databricks and Snowflake, contributing to a major technology transformation at Capital One in Riverwoods, IL.