Senior Data Engineer - Python, AWS & Cloud Data

Capital One; Richmond (VA); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 to help drive a major transformation by building cloud-first data solutions. You will collaborate across Agile teams, work with data scientists, and design scalable pipelines using Python, Spark, and cloud data warehousing platforms like Databricks and Snowflake.

You’ll influence peers, mentor others, and ensure robust data architectures and security. A strong background in SQL and data modeling is required, with 4+ years in data engineering or related

Qualifications

• Bachelor's Degree or higher in Computer Science or related quantitative field
• 4+ years of experience in application development
• 2+ years of experience in SQL
• 2+ years of experience in one programming language (Python, Java, or Scala)
• 2+ years of experience in data pipeline design and development
• 1+ year of experience in data modeling and end-to-end data solutions using relational and non-relational databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
• Influence a team of developers, data analysts and data scientists
• Utilize Python and Spark with SQL and NoSQL databases and cloud data warehousing platforms
• Share knowledge and mentor teammates in data technologies and trends
• Deliver cloud-first data solutions that support financial empowerment for millions
• Independently design, build, and deliver data solutions with minimal supervision
• Architect and enforce data engineering design patterns for maintainability
• Communicate technical concepts and data outcomes to stakeholders
• Design and build scalable, resilient data pipelines
• Implement data security standards and ensure compliance

Skills

Python

SQL

Data modeling

Education

Bachelor's degree or higher in Computer Science or related quantitative field

Tools

Databricks

Snowflake

EMR

Spark

Glue

Airflow

Dagster

MongoDB

Cassandra

DynamoDB

Redshift

Job description

Capital One is seeking a Data Engineer 4 to help drive a major transformation by building cloud-first data solutions. You will collaborate across Agile teams, work with data scientists, and design scalable pipelines using Python, Spark, and cloud data warehousing platforms like Databricks and Snowflake.

You’ll influence peers, mentor others, and ensure robust data architectures and security. A strong background in SQL and data modeling is required, with 4+ years in data engineering or related