Senior Cloud-First Data Engineer – Scalable ML Pipelines

Capital One National Association; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One in McLean, Virginia is seeking a Data Engineer 4 to design, build, and scale cloud-first data solutions. You will collaborate with agile teams and mentors, applying Python, Spark, and SQL across data platforms.

This role emphasizes data security, scalable pipelines, and modern lakehouse architectures using Databricks and Snowflake, with opportunities to influence a wide range of data products for millions of customers.

Qualifications

• Bachelor's degree or higher in Computer Science or related quantitative field.
• At least 4 years of experience in application development.
• At least 2 years of experience in distributed data.
• At least 2 years of experience with SQL.
• At least 2 years of experience in one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling using relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement and support solutions.
• Influence teams with ML, distributed microservices and lakehouse architectures.
• Utilize Python and Spark with SQL and NoSQL databases and cloud data warehousing (Databricks, Snowflake).
• Mentor data community members and stay current with data trends.
• Collaborate with product managers and software engineers to deliver cloud-first data solutions.
• Design and deliver scalable cloud data pipelines and platforms.
• Architect data engineering patterns for quality and reusability.
• Communicate technical concepts and data outcomes to stakeholders.
• Aim for scalable, reliable data systems under growing data demands.
• Ensure data security standards and access controls.

Skills

Python

Spark

SQL

NoSQL

Databricks

Snowflake

Mentoring

Education

Bachelor's degree in CS or related field

Tools

Databricks

Snowflake

EMR

Glue

Job description

Capital One in McLean, Virginia is seeking a Data Engineer 4 to design, build, and scale cloud-first data solutions. You will collaborate with agile teams and mentors, applying Python, Spark, and SQL across data platforms.

This role emphasizes data security, scalable pipelines, and modern lakehouse architectures using Databricks and Snowflake, with opportunities to influence a wide range of data products for millions of customers.