Senior Data Engineering Lead - AI, Cloud & Scale

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking Data Engineers to drive a major transformation in Risk Tech, building data-driven tools and AI-powered solutions to manage risk and empower customers.

You will work across agile teams to design, develop, test, and deploy cloud-first data solutions, mentor peers, and lead end-to-end data initiatives using Snowflake, Databricks, Spark, and other modern data technologies.

Qualifications

• Bachelor's degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 6 years of experience in application development (Internship experience does not apply)
• At least 4 years of experience in distributed data
• At least 4 years of experience with SQL
• At least 4 years of experience programming with Python, Java, or Scala
• At least 4 years of experience designing and developing data pipelines
• At least 2 years of experience in data modeling and designing end-to-end data solutions using relational and non-relational databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
• Influence a team of developers, data analysts and data scientists with ML, microservices, lakehouse architecture, and full-stack systems
• Utilize Python, Spark, and databases; leverage cloud-based data warehousing platforms like Databricks and Snowflake
• Mentor other data community members and stay current with data trends and tools
• Collaborate with product managers and software engineers to deliver cloud-first data solutions for millions of Americans
• Independently design and deliver cloud data solutions with minimal supervision
• Architect and enforce data engineering design patterns for quality and reusability
• Communicate data concepts and outcomes to internal and external stakeholders
• Design and build scalable, resilient data pipelines and platforms
• Balance deep technical work with mentoring and elevating peers
• Lead large-scale data initiatives end-to-end, evaluating platform choices like Snowflake vs Databricks

Skills

Python

Spark

SQL

Java

Scala

NoSQL

Databricks

Snowflake

EMR

Airflow

Dagster

Data modeling

Data pipelines

Education

Bachelor's degree in CS or related

Master's degree (preferred)

Tools

Databricks

Snowflake

EMR

Glue

Spark

Airflow

Dagster

Job description

Capital One is seeking Data Engineers to drive a major transformation in Risk Tech, building data-driven tools and AI-powered solutions to manage risk and empower customers.

You will work across agile teams to design, develop, test, and deploy cloud-first data solutions, mentor peers, and lead end-to-end data initiatives using Snowflake, Databricks, Spark, and other modern data technologies.