Lead Data Engineer, IC – Cloud Data Platforms

Capital One Group; Richmond (VA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health benefits

Financial benefits

Job summary

Capital One Group seeks Data Engineers to drive a major transformation, delivering cloud-first data solutions and pipelines. You will work with developers, data analysts, and data scientists in an Agile environment to design, test, and deploy scalable systems.

Responsibilities include building robust data platforms, ensuring security and performance, and mentoring peers while communicating complex data concepts to stakeholders.

Qualifications

• Bachelor's degree or higher in Computer Science or a related quantitative field.
• At least 4 years of experience in application development (Internship experience does not apply).
• At least 2 years of experience in distributed data.
• At least 2 years of experience with SQL.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and end-to-end data solutions using relational and non-relational databases.
• 7+ years of experience in application development with proficiency in Python, SQL, Scala, or Java.
• 4+ years of hands-on experience designing and operating data workloads in at least one public cloud (AWS/Azure/GCP).
• 4+ years of experience building/distributing data or compute workloads with EMR, Spark, Glue, or Databricks.
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines.
• 2+ years of experience with data observability or data orchestration tools (Airflow, Dagster).
• 4+ years of experience with unstructured or semi-structured data using NoSQL databases (MongoDB, Cassandra, DynamoDB).
• 4+ years of experience designing and supporting data warehousing solutions (Snowflake, Redshift).
• 2+ years of experience working in an Agile development environment.
• 2+ years of experience developing user-centric reusable data products.

Responsibilities

• Design, build, test, implement, and support full-stack data solutions in cloud-first environments.
• Collaborate with Agile teams to deliver robust data solutions for millions of users.
• Architect and enforce reusable data engineering patterns for quality and maintainability.
• Build scalable data pipelines and platforms with a focus on performance and security.
• Mentor team members and communicate data outcomes clearly to stakeholders.

Skills

Python

SQL

Distributed data

Data modeling

Cloud

API design

Education

Bachelor's degree in Computer Science

Quantitative field knowledge

Tools

Spark

Databricks

Snowflake

AWS

EMR

Airflow

Dagster

MongoDB

Cassandra

DynamoDB

Job description

Capital One Group seeks Data Engineers to drive a major transformation, delivering cloud-first data solutions and pipelines. You will work with developers, data analysts, and data scientists in an Agile environment to design, test, and deploy scalable systems.

Responsibilities include building robust data platforms, ensuring security and performance, and mentoring peers while communicating complex data concepts to stakeholders.