Lead Data Engineer: Real-Time Data and AI-Driven Insights

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer in the United States, focusing on enterprise platforms and data-driven insights. You will work across Agile teams to design, develop, and test full-stack data solutions, leveraging Java, Scala, Python, and cloud data services.

Expect mentorship, code reviews, and performance tuning while delivering scalable, personalized customer experiences. The role emphasizes collaboration with ML-enabled teams and distributed data systems, with opportunities to

Qualifications

• Bachelor’s Degree required; Master’s preferred.
• 4+ years in application development with 2+ years in big data.
• 1+ year cloud experience (AWS, Azure, GCP).
• Experience with ML-assisted coding tools is a plus.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support full-stack solutions.
• Work with teams experienced in ML, distributed microservices, and cloud data platforms.
• Use Java, Scala, Python and SQL/NoSQL with Redshift or Snowflake for data warehousing.
• Mentor peers, review code, and ensure performance tuning.
• Deliver cloud-based solutions that enable scalable customer experiences.

Skills

Big data technologies

Cloud computing

Python

Java

Scala

SQL

NoSQL

Data warehousing

Unix/Linux

Agile

Education

Bachelor's degree

Master's degree

Tools

Redshift

Snowflake

Hadoop

Kafka

Spark

MySQL

Job description

Capital One is seeking a Lead Data Engineer in the United States, focusing on enterprise platforms and data-driven insights. You will work across Agile teams to design, develop, and test full-stack data solutions, leveraging Java, Scala, Python, and cloud data services.

Expect mentorship, code reviews, and performance tuning while delivering scalable, personalized customer experiences. The role emphasizes collaboration with ML-enabled teams and distributed data systems, with opportunities to