Lead Data Engineer - Cloud & ML Expert

Socket.dev; Virginia, New York (MN, NY); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking Lead Data Engineers who will join Enterprise Platforms Technology to drive data-driven transformation across the company. You will design, build, test, and support scalable data solutions using Python, Java, Scala, and SQL, with deep exposure to Redshift, Snowflake, Hadoop, and Spark.

You will mentor teammates, collaborate with agile teams, and help deliver cloud-based data experiences to millions of users while ensuring performance and reliability of critical systems.

Qualifications

• Bachelor’s Degree required.
• At least 4 years of application development experience.
• At least 2 years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Azure, Google Cloud).

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support full-stack solutions.
• Work with developers experienced in ML, distributed microservices, and full-stack systems.
• Utilize languages like Java, Scala, Python and RDBMS/NoSQL databases; leverage cloud data warehousing services like Redshift and Snowflake.
• Share passion for new technologies and mentor engineers.
• Collaborate with product managers to deliver cloud-based experiences for users.
• Perform unit tests and reviews to ensure robust, efficient code.

Skills

Python

SQL

Scala

Java

Big data

Cloud computing

Distributed systems

NoSQL

Data warehousing

UNIX/Linux

Education

Bachelor’s Degree

Tools

Redshift

Snowflake

Hadoop

Kafka

Spark

MySQL

Job description

Capital One is seeking Lead Data Engineers who will join Enterprise Platforms Technology to drive data-driven transformation across the company. You will design, build, test, and support scalable data solutions using Python, Java, Scala, and SQL, with deep exposure to Redshift, Snowflake, Hadoop, and Spark.

You will mentor teammates, collaborate with agile teams, and help deliver cloud-based data experiences to millions of users while ensuring performance and reliability of critical systems.