Lead Data Engineer: Cloud, Big Data & ML

Relha LLC; McLean, Northern (VA, KY); Hybrid; USD 197,000 - 225,000; Full time

Job summary

Capital One in McLean, VA is seeking a Lead Data Engineer to design, develop, and support data solutions in big data environments. You will collaborate with Agile teams, work with ML-focused engineers, and leverage Java, Scala, Python, and SQL across cloud data warehouses like Redshift and Snowflake.

The role requires strong experience in distributed data systems, NoSQL, and UNIX/Linux, with a path toward mentoring and technical leadership within an inclusive, fast-paced setting.

Qualifications

• Bachelor's degree required.
• Minimum 4 years of application development experience.
• At least 2 years of experience with big data technologies.
• At least 1 year of cloud computing experience (AWS, Azure, Google Cloud).
• Preferred: 7+ years in application development (Python/SQL/Scala/Java).
• Preferred: 4+ years of public cloud experience.
• Preferred: 4+ years of distributed data/compute tools.
• Preferred: 4+ years of NoSQL and data warehousing experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support data solutions in big data environments.
• Work with engineers experienced in machine learning, distributed microservices, and ETL systems.
• Utilize Java, Scala, Python and SQL with Redshift/Snowflake for data warehousing.
• Mentor engineers, share technology trends, and contribute to internal/external communities.
• Deliver cloud-based data solutions that empower users and drive business outcomes.
• Perform unit tests and code reviews to ensure performance and quality.

Skills

Java

Scala

Python

Big data technologies

Agile engineering practices

Education

Bachelor's Degree

Tools

Hadoop

Hive

Spark

Kafka

EMR

MapReduce

MySQL

MongoDB

Cassandra

Redshift

Snowflake

Unix/Linux

Job description

Capital One in McLean, VA is seeking a Lead Data Engineer to design, develop, and support data solutions in big data environments. You will collaborate with Agile teams, work with ML-focused engineers, and leverage Java, Scala, Python, and SQL across cloud data warehouses like Redshift and Snowflake.

The role requires strong experience in distributed data systems, NoSQL, and UNIX/Linux, with a path toward mentoring and technical leadership within an inclusive, fast-paced setting.