Senior Data Engineer - Cloud Data Pipelines & ML

Capital One National Association; Virginia, Northern (MN, KY); Hybrid; USD 179,000 - 225,000; Full time

Job summary

Capital One National Association is seeking Data Engineers to drive a major transformation, delivering cloud-first data solutions and architectures across teams. You will work with Python and Spark, leveraging Databricks and Snowflake to enable scalable data platforms that empower millions of Americans.

You will mentor teammates, design robust pipelines, enforce data security standards, and collaborate with product managers to deliver end-to-end data products in an agile environment.

Qualifications

• Bachelor's Degree in Computer Science or related quantitative field.
• At least 4 years of application development experience.
• At least 2 years of distributed data experience.
• At least 2 years of SQL experience.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of data pipeline design and development.
• At least 1 year of data modeling with relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support data solutions.
• Influence a team of developers, data analysts, and data scientists in ML and lakehouse architectures.
• Utilize Python, Spark, and cloud data warehousing platforms like Databricks and Snowflake.
• Mentor other data team members and engage with internal tech communities.
• Design and deliver cloud-first data solutions driving customer financial empowerment.

Skills

Python

SQL

Java/Scala

Education

Bachelor's Degree in Computer Science or related quantitative field

Tools

Databricks

Snowflake

EMR

Spark

Airflow

Job description

Capital One National Association is seeking Data Engineers to drive a major transformation, delivering cloud-first data solutions and architectures across teams. You will work with Python and Spark, leveraging Databricks and Snowflake to enable scalable data platforms that empower millions of Americans.

You will mentor teammates, design robust pipelines, enforce data security standards, and collaborate with product managers to deliver end-to-end data products in an agile environment.