Senior Data Engineer — Cloud & Real-Time Analytics Leader

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One in New York, NY is seeking a Lead Data Engineer to join a fast-paced, collaborative tech team focused on solving complex business problems. You will contribute to full-stack development, work with ML and distributed microservices, and leverage Java, Python, Scala, SQL, and NoSQL with Redshift/Snowflake for cloud-based data warehousing.

You will mentor engineers, participate in code reviews, and help deliver scalable data solutions that empower millions of Americans.

Qualifications

• Bachelor’s degree in a related field.
• 4+ years in application development and 2+ years in big data technologies.
• Experience with cloud platforms (AWS, Azure, GCP).
• Experience with distributed data and streaming technologies.
• Experience with Agile engineering practices.

Responsibilities

• Design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
• Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.
• Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake.
• Share your passion for staying on top of tech trends, mentoring other members of the engineering community.
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans.
• Perform unit tests and conduct reviews with other team members to ensure code is rigorously designed and tuned for performance.

Skills

Java

Python

Scala

SQL

Big data

Education

Bachelor's Degree

Tools

Hadoop

Spark

Kafka

Redshift

Snowflake

Hive

EMR

MySQL

Job description

Capital One in New York, NY is seeking a Lead Data Engineer to join a fast-paced, collaborative tech team focused on solving complex business problems. You will contribute to full-stack development, work with ML and distributed microservices, and leverage Java, Python, Scala, SQL, and NoSQL with Redshift/Snowflake for cloud-based data warehousing.

You will mentor engineers, participate in code reviews, and help deliver scalable data solutions that empower millions of Americans.