Senior Data Engineer Leader (IC) — Cloud Data Platforms

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 (Senior Manager, IC) to lead end-to-end data platform initiatives in a fast-paced, collaborative environment. The role focuses on building scalable cloud data pipelines, guiding cross-functional teams, and architecting lakehouse solutions using Snowflake and Databricks.

The ideal candidate has extensive distributed data experience, strong SQL and programming skills in Python/Java/Scala, and a proven ability to deliver enterprise data platforms that

Qualifications

• Bachelor's degree or higher in a quantitative field; 6+ years in application development
• 4+ years in distributed data and in SQL
• 4+ years programming in Python, Java, or Scala
• 4+ years designing and developing data pipelines
• 2+ years data modeling end-to-end solutions using relational and NoSQL databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement and support data solutions
• Influence teams with ML, microservices, lakehouse architecture, and full-stack systems
• Use Python and Spark with relational and NoSQL databases and cloud warehousing platforms like Snowflake and Databricks
• Mentor data community members and keep up with data trends and new tech
• Deliver cloud-first data solutions that empower users and drive business outcomes
• Independently design and deliver data pipelines and ensure quality and reusability
• Architect data engineering patterns to ensure maintainability across platforms
• Communicate technical concepts clearly to stakeholders to drive alignment
• Balance hands-on work with mentoring and lifting team capabilities
• Lead large-scale data initiatives and evaluate platform choices like Snowflake vs Databricks

Skills

SQL

Python

Java

Scala

Distributed data

Data modeling

Data pipelines

Cloud platforms

Spark

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

EMR

Spark

Glue

Databricks

Snowflake

Job description

Capital One is seeking a Data Engineer 5 (Senior Manager, IC) to lead end-to-end data platform initiatives in a fast-paced, collaborative environment. The role focuses on building scalable cloud data pipelines, guiding cross-functional teams, and architecting lakehouse solutions using Snowflake and Databricks.

The ideal candidate has extensive distributed data experience, strong SQL and programming skills in Python/Java/Scala, and a proven ability to deliver enterprise data platforms that