Senior Lead Data Engineer, Enterprise Platforms

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Sr. Lead Data Engineer to drive enterprise platforms technology and transform data systems across the organization. You will lead development efforts, mentor engineers, and collaborate with product teams to deliver scalable data solutions in a cloud environment.

The role emphasizes Python/SQL, distributed computing, and real-time data workloads, with opportunities to shape architecture and contribute to strategic initiatives across multiple lines of business.

Qualifications

• Bachelor’s Degree required.
• At least 6 years of application development experience.
• At least 2 years of big data technologies.
• At least 1 year cloud experience (AWS, Azure, or Google Cloud).

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies.
• Lead a team of developers with deep experience in data movement, distributed computing, and full stack systems.
• Utilize Python, SQL and Open Source RDBMS and NoSQL databases and Cloud data warehousing services like Snowflake and Databricks.
• Optimize information systems for end users and downstream consumers with sound data design.
• Mentor other engineers, stay current with tech trends, and participate in tech communities.
• Collaborate with digital product managers to deliver cloud-based solutions for millions of Americans.
• Perform unit tests and code reviews to ensure well-designed, efficient, and robust code.

Skills

Python

SQL

Scala

Java

Agile engineering

Education

Bachelor’s Degree

Master’s Degree

Tools

Snowflake

Databricks

MapReduce

Hadoop

Kafka

Spark

MySQL

NoSQL databases

UNIX/Linux shell

Job description

Capital One is seeking a Sr. Lead Data Engineer to drive enterprise platforms technology and transform data systems across the organization. You will lead development efforts, mentor engineers, and collaborate with product teams to deliver scalable data solutions in a cloud environment.

The role emphasizes Python/SQL, distributed computing, and real-time data workloads, with opportunities to shape architecture and contribute to strategic initiatives across multiple lines of business.