Data Engineering Leader - Cloud-First, Scalable Pipelines

Capital One; Richmond (VA); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking data engineers to lead cloud-first data solutions, collaborating with agile teams to architect end-to-end data pipelines using Python, Spark, SQL, Databricks and Snowflake. You’ll mentor others and drive scalable, secure data platforms across multiple teams in a fast-paced environment.

The role emphasizes hands-on delivery, architecture guidance, and communication with stakeholders to ensure impactful data outcomes for millions of Americans.

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field
• At least 4 years of experience in application development
• At least 2 years of experience in distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language (Python, Java, or Scala)
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and end-to-end data solutions

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support solutions
• Influence a team of developers, data analysts and data scientists
• Utilize Python, Spark, and SQL with Databricks and Snowflake
• Mentor other data community members and stay current with data trends
• Deliver cloud-first data solutions that empower users and drive business impact
• Design and deliver data pipelines and platforms with scalability and reliability
• Enforce data engineering design patterns for maintainability
• Communicate technical concepts to stakeholders to drive alignment
• Support secure data solutions with encryption and access controls

Skills

Python

SQL

Spark

Cloud platforms (AWS/Azure/GCP)

Education

Bachelor's degree in Computer Science or related quantitative field

Tools

Databricks

Snowflake

NoSQL databases

Job description

Capital One is seeking data engineers to lead cloud-first data solutions, collaborating with agile teams to architect end-to-end data pipelines using Python, Spark, SQL, Databricks and Snowflake. You’ll mentor others and drive scalable, secure data platforms across multiple teams in a fast-paced environment.

The role emphasizes hands-on delivery, architecture guidance, and communication with stakeholders to ensure impactful data outcomes for millions of Americans.