Lead Data Engineer - AI & Real-Time DataOps

Capital One National Association; New York (NY); On-site; USD 215,200 - 245,600; Full time

Job summary

Capital One in New York, NY is hiring a Lead Data Engineer to join Risk Tech. You’ll design and deploy data-driven, AI-enhanced risk solutions, collaborating with agile teams across the tech stack and product groups.

You’ll work with Java, Scala, Python, and modern data stores in cloud environments, building scalable, real-time data pipelines and ML-enabled tools to empower financial decisions at scale.

Qualifications

• Bachelor’s degree required.
• 4+ years in application development.
• 2+ years in big data technologies.
• 1+ year cloud experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support solutions.
• Work with ML, distributed microservices, and full-stack systems.
• Use Java/Scala/Python; work with RDBMS and NoSQL; cloud data warehousing.
• Share knowledge, mentor teammates, and stay current with tech trends.
• Partner with product managers to deliver cloud-based experiences for users.
• Perform unit tests and code reviews for robust, performant solutions.

Skills

Python

SQL

Scala

Java

Machine learning

Big data

Education

Bachelor’s Degree

Tools

AWS

Azure

Google Cloud

Redshift

Snowflake

Hadoop

Kafka

Spark

MongoDB

Cassandra

Job description

Capital One in New York, NY is hiring a Lead Data Engineer to join Risk Tech. You’ll design and deploy data-driven, AI-enhanced risk solutions, collaborating with agile teams across the tech stack and product groups.

You’ll work with Java, Scala, Python, and modern data stores in cloud environments, building scalable, real-time data pipelines and ML-enabled tools to empower financial decisions at scale.