Senior Data Engineer: End-to-End Cloud Data & ML Pipelines

Capital One; Richmond (TX); Hybride; USD 209 000 - 286 000; Plein temps

Résumé du poste

Capital One is seeking a Data Engineer 5 to design and deliver cloud-first data solutions. You will work across Agile teams with data scientists, engineers and product managers to build scalable data pipelines using Python, Spark, and modern cloud data warehousing platforms like Databricks and Snowflake.

You will lead end-to-end data initiatives, mentor peers, and help evolve the data landscape in a fast-paced, collaborative environment.

Qualifications

• Bachelor's degree or higher in a quantitative field such as CS, analytics, or engineering.
• 6+ years in application development with 4+ years in distributed data.
• 4+ years SQL experience.
• 4+ years programming in Python, Java, or Scala.
• 4+ years designing and developing data pipelines.
• 2+ years data modeling with relational and non-relational databases.

Responsabilités

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Influence teams with ML, microservices, lakehouse architectures, and full-stack systems.
• Build data pipelines and cloud-based data platforms for scalable solutions.
• Deliver cloud-first data solutions and empower customer experiences at scale.
• Lead end-to-end data initiatives and evaluate platform choices (Snowflake vs Databricks).

Connaissances

Python

SQL

Spark

Databricks

Snowflake

Cloud computing

Data pipelines

Distributed systems

Formation

Bachelor's degree in Computer Science or related field

Outils

Airflow

Dagster

EMR

Spark

Description du poste

Capital One is seeking a Data Engineer 5 to design and deliver cloud-first data solutions. You will work across Agile teams with data scientists, engineers and product managers to build scalable data pipelines using Python, Spark, and modern cloud data warehousing platforms like Databricks and Snowflake.

You will lead end-to-end data initiatives, mentor peers, and help evolve the data landscape in a fast-paced, collaborative environment.