Lead Data Engineer: Cloud, ML & Real-Time Data

COMFORT SYSTEMS; San Francisco (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer in San Francisco to design and implement scalable data platforms and cloud-based analytics. The role involves collaborating with agile teams, utilizing Java, Python, SQL, Scala, and modern data stores to deliver robust solutions.

You will mentor engineers, embrace new technologies and contribute to the company's mission of financial empowerment for customers and communities.

Qualifications

• Bachelor’s Degree in a related field.
• Minimum 4 years of experience in data engineering/big data development.
• Minimum 1 year of experience with cloud computing (AWS, Azure, Google Cloud).

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Work with teams pursuing ML, distributed microservices, and full-stack systems.
• Utilize Java, Python, SQL, Scala with RDBMS and NoSQL databases and cloud data warehousing services.
• Mentor engineers and contribute to best practices across the engineering community.
• Deliver cloud-based data solutions that enable scalable analytics for millions of users.
• Perform unit tests and code reviews to ensure performance and quality.

Skills

Java

Python

SQL

Scala

NoSQL

AWS

Spark

Hadoop

Kafka

Cloud

Education

Bachelor’s Degree

Tools

Redshift

Snowflake

Hadoop

Kafka

Spark

MySQL

MongoDB

Cassandra

Job description

Capital One is seeking a Lead Data Engineer in San Francisco to design and implement scalable data platforms and cloud-based analytics. The role involves collaborating with agile teams, utilizing Java, Python, SQL, Scala, and modern data stores to deliver robust solutions.

You will mentor engineers, embrace new technologies and contribute to the company's mission of financial empowerment for customers and communities.