Senior Data Engineer (Python & AWS) — Real-Time Data Solutions

Capital One National Association; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One National Association is seeking a Data Engineer 4 to drive data solutions in a cloud-first environment. You'll collaborate with Agile teams, mentor peers, and deliver scalable data pipelines using Python, Spark, and SQL across Databricks and Snowflake.

The role emphasizes data security, architecture, and ensuring robust performance as data volume grows, enabling real-time insights for financial empowerment.

Qualifications

• Bachelor's degree or higher in Computer Science or related quantitative field.
• At least 4 years of application development experience.
• At least 2 years of distributed data experience.
• At least 2 years of SQL experience.
• At least 2 years with Python, Java, or Scala.
• At least 2 years designing and developing data pipelines.
• At least 1 year experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Influence a team of developers, data analysts and data scientists.
• Utilize Python, Spark, SQL, and cloud data warehousing platforms like Databricks/Snowflake.
• Design and deliver cloud-first data platforms with scalable pipelines.
• Ensure data security standards and governance across pipelines.

Skills

Python

SQL

Spark

Cloud

Data pipelines

NoSQL

ETL

Data modeling

Education

Bachelor's degree or higher in CS or related quantitative field

Quantitative field knowledge

Tools

AWS

Databricks

Snowflake

EMR

Glue

Job description

Capital One National Association is seeking a Data Engineer 4 to drive data solutions in a cloud-first environment. You'll collaborate with Agile teams, mentor peers, and deliver scalable data pipelines using Python, Spark, and SQL across Databricks and Snowflake.

The role emphasizes data security, architecture, and ensuring robust performance as data volume grows, enabling real-time insights for financial empowerment.