Lead Data Engineer: Cloud, Big Data & ML

Capital One; San Francisco (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to join our growing data engineering team in San Francisco, focusing on building and scaling data platforms. This role collaborates with Agile teams to design, develop, test, and deploy robust data solutions and distributed systems across the stack.

The candidate will work with Java, Scala, Python, and NoSQL/SQL databases, leveraging cloud data warehousing services like Redshift and Snowflake, while mentoring peers and contributing to advancing Capital

Qualifications

• Bachelor's degree required.
• At least 4 years of application development experience.
• At least 2 years of big data experience and 1 year cloud experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in ML, distributed microservices, and full-stack systems.
• Utilize Java, Scala, Python and RDBMS/NoSQL databases; use cloud data warehousing (Redshift/Snowflake).
• Mentor team members and stay current with tech trends; participate in communities.

Skills

Java

Python

SQL

Scala

Unix/Linux

Cloud computing

Hadoop

Spark

Kafka

NoSQL

Education

Bachelor's Degree

Tools

Redshift

Snowflake

MongoDB

Cassandra

Hive

EMR

MapReduce

MySQL

Job description

Capital One is seeking a Lead Data Engineer to join our growing data engineering team in San Francisco, focusing on building and scaling data platforms. This role collaborates with Agile teams to design, develop, test, and deploy robust data solutions and distributed systems across the stack.

The candidate will work with Java, Scala, Python, and NoSQL/SQL databases, leveraging cloud data warehousing services like Redshift and Snowflake, while mentoring peers and contributing to advancing Capital