Senior Cloud Data Engineer — Pipelines, ML & Scale

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One seeks Data Engineers to drive transformation in cloud-based data solutions. You will design, build, and operate scalable data pipelines using Python, SQL, Spark, and Databricks in a fast-paced environment.

You’ll collaborate with product managers, software engineers and data scientists to deliver robust data platforms that empower millions of Americans. The role emphasizes innovation, performance, and data security in a cloud-first context.

Qualifications

• Bachelor’s degree or higher in Computer Science or a related quantitative field.
• At least 4 years of experience in application development.
• At least 2 years of experience in distributed data and SQL.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and end-to-end data solutions using relational and non-relational databases.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical data solutions.
• Influence a team of developers, data analysts, and data scientists in ML, microservices, and lakehouse architectures.
• Utilize Python and Spark with relational and NoSQL databases and cloud data warehousing (Databricks, Snowflake).
• Mentor other members of the data community and stay current with data trends.
• Collaborate with product managers and engineers to deliver cloud-first data solutions that empower millions.
• Independently design, build and deliver data solutions with minimal supervision.
• Architect and enforce data engineering design patterns for quality and reusability.
• Communicate data outcomes clearly to stakeholders to drive alignment.
• Design scalable and resilient data pipelines with focus on performance.
• Implement data security standards and access controls compliant with regulations.

Education

Bachelor’s degree in Computer Science or related quantitative field

Tools

Python

SQL

Spark

Databricks

Snowflake

Job description

Capital One seeks Data Engineers to drive transformation in cloud-based data solutions. You will design, build, and operate scalable data pipelines using Python, SQL, Spark, and Databricks in a fast-paced environment.

You’ll collaborate with product managers, software engineers and data scientists to deliver robust data platforms that empower millions of Americans. The role emphasizes innovation, performance, and data security in a cloud-first context.