Senior Data Engineer Lead - AI-Driven Data Platforms

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 (Senior Manager, IC) to lead the design, development, and deployment of cloud-based data solutions. You will collaborate with Agile teams, mentor engineers, and drive end-to-end data initiatives across platforms such as Snowflake and Databricks.

The role emphasizes architectural decision-making, scalability, and partnership with product teams to empower millions of Americans with data-driven experiences.

Qualifications

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 6 years of experience in application development
• At least 4 years of experience in distributed data
• At least 4 years of experience with SQL
• At least 4 years of experience programming with Python, Java, or Scala
• At least 4 years of experience designing and developing data pipelines
• At least 2 years of experience in data modeling and designing end-to-end data solutions using relational and NoSQL databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support data solutions
• Influence a team of developers, data analysts and data scientists with ML, microservices, lakehouse architecture
• Utilize Python and Spark and cloud data warehousing like Databricks and Snowflake
• Mentor other data team members and stay current with data trends
• Partner with product managers to deliver cloud-first data solutions
• Design and deliver scalable cloud data platforms with high reliability
• Architect common data engineering patterns for maintainability and reuse
• Communicate data outcomes clearly to stakeholders
• Lead large-scale data initiatives end-to-end and evaluate platform choices

Skills

Python

Spark

SQL

Data pipelines

NoSQL

Education

Bachelor's in Computer Science or related field

Tools

Databricks

Snowflake

AWS

EMR

Job description

Capital One is seeking a Data Engineer 5 (Senior Manager, IC) to lead the design, development, and deployment of cloud-based data solutions. You will collaborate with Agile teams, mentor engineers, and drive end-to-end data initiatives across platforms such as Snowflake and Databricks.

The role emphasizes architectural decision-making, scalability, and partnership with product teams to empower millions of Americans with data-driven experiences.