Data Engineer 4: Cloud Data Pipelines & GenAI

Capital One; Richmond (VA); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking a Data Engineer to design, build, and deploy cloud-first data solutions and scalable pipelines in a fast-paced, collaborative setting.

You will lead cross-functional teams, implement data governance and security, and partner with product managers to deliver high-impact data products across marketing platforms. Strong cloud and streaming experience are essential.

Qualifications

• Bachelor's degree in CS or related field.
• 4+ years in application development (internships not counted).
• 2+ years in distributed data.
• 2+ years of SQL experience.
• 2+ years in one language (Python/Java/Scala).
• 2+ years in data pipeline design and development.
• 1+ year in data modeling with relational and non-relational DBs.
• 4+ years cloud data workloads (AWS/Azure/GCP).
• 4+ years NoSQL (MongoDB/Cassandra/DynamoDB).
• 4+ years streaming data apps (Kafka).

Responsibilities

• Architect and build scalable, cloud-first data solutions and real-time pipelines.
• Lead cross-functional Agile teams and enforce data engineering patterns.
• Utilize Python, SQL, Scala, Spark with Databricks and Snowflake.
• Implement data security and governance standards for quality.
• Partner with product managers and software engineers to deliver solutions.
• Communicate data concepts to both technical and non-technical stakeholders.

Skills

Distributed data

SQL

Python/Java/Scala

Data pipeline design

Data modeling

Cloud data platforms

Cross-functional leadership

Agile engineering

Data governance

Real-time streaming

Education

Bachelor's degree in CS or related

Master’s degree (preferred)

Tools

Databricks

Snowflake

EMR/Spark

Kafka

Airflow

NoSQL databases

Relational DBs

Job description

Capital One is seeking a Data Engineer to design, build, and deploy cloud-first data solutions and scalable pipelines in a fast-paced, collaborative setting.

You will lead cross-functional teams, implement data governance and security, and partner with product managers to deliver high-impact data products across marketing platforms. Strong cloud and streaming experience are essential.