Senior Data Engineer - Enterprise Platforms & Cloud

Capital One; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 for Enterprise Platforms Technology to drive large-scale cloud data solutions. You will design, build, and support end-to-end data pipelines using Python, Spark, and modern data warehouses like Snowflake and Databricks.

You will work with cross-functional teams, mentor junior engineers, and influence architectural decisions such as choosing between Snowflake and Databricks, aiming for scalable, robust data platforms that empower millions of customers

Qualifications

• Bachelor's degree in CS or related quantitative field.
• At least 6 years of experience in application development.
• At least 4 years of experience in distributed data and SQL.
• At least 4 years of experience designing and developing data pipelines.
• At least 2 years of experience in data modeling with relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design and implement data solutions.
• Lead data pipelines and platforms for scalable cloud data.
• Mentor data engineers and collaborate with data scientists.
• Evaluate platform choices like Snowflake vs Databricks.
• Communicate data outcomes to stakeholders.

Skills

Python

SQL

Spark

Java

Scala

Distributed systems

Data pipelines

Mentoring

Cloud computing

Data modeling

Education

Bachelor's Degree in CS or related field

Master's Degree in CS

Tools

Databricks

Snowflake

EMR

Glue

Dagster

Airflow

MongoDB

Cassandra

DynamoDB

Job description

Capital One is seeking a Data Engineer 5 for Enterprise Platforms Technology to drive large-scale cloud data solutions. You will design, build, and support end-to-end data pipelines using Python, Spark, and modern data warehouses like Snowflake and Databricks.

You will work with cross-functional teams, mentor junior engineers, and influence architectural decisions such as choosing between Snowflake and Databricks, aiming for scalable, robust data platforms that empower millions of customers