Senior Data Engineer – Cloud Data Pipelines

Capital One; Deerfield (IL); On-site; USD 179,000 - 246,000; Full time

Job summary

Capital One in the United States is seeking a Data Engineer to join a fast-paced, inclusive delivery environment and drive a major transformation in data platforms. You will collaborate with agile teams to design, implement, and support cloud-first data solutions, leveraging Python, Spark, and SQL across lakehouse architectures.

You'll mentor others, enforce data engineering patterns, and communicate complex data concepts to stakeholders. This role is based in multiple U.S.

Qualifications

• Bachelor's degree in CS or quantitative field.
• 4+ years in application development.
• 2+ years in distributed data and with SQL.
• 2+ years with Python/Java/Scala.
• 2+ years in data pipeline design and development.
• 1+ year in data modeling for relational and non-relational DBs.

Responsibilities

• Collaborate with Agile teams to design, develop and support data solutions.
• Influence teams with ML, microservices, lakehouse architectures.
• Use Python, Spark and SQL across cloud data warehousing platforms.
• Mentor data community members and share technology trends.
• Deliver cloud-first data solutions enabling scalable experiences.
• Design and deliver data pipelines with focus on scalability and security.
• Enforce data engineering design patterns for quality and reuse.
• Communicate technical concepts clearly to stakeholders.

Skills

Python

SQL

Java

Scala

Data pipelines

Education

Bachelor's Degree in Computer Science or related field

Tools

EMR

Spark

Databricks

Snowflake

Redshift

Glue

Airflow

Dagster

MongoDB

Cassandra

DynamoDB

Job description

Capital One in the United States is seeking a Data Engineer to join a fast-paced, inclusive delivery environment and drive a major transformation in data platforms. You will collaborate with agile teams to design, implement, and support cloud-first data solutions, leveraging Python, Spark, and SQL across lakehouse architectures.

You'll mentor others, enforce data engineering patterns, and communicate complex data concepts to stakeholders. This role is based in multiple U.S.