Lead Data Engineer - Nexus Data Products

Capital One; McLean (VA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Comprehensive health benefits

Financial well-being support

Inclusive environment

Job summary

Capital One is seeking a Lead Data Engineer to create innovative data solutions that integrate with advanced technologies. This role emphasizes collaboration within Agile teams and requires strong expertise in cloud computing and big data technologies.

The ideal candidate will have significant experience in application development and be proficient in programming languages such as Java, Scala, and Python. The position is based in McLean, Virginia, and offers a comprehensive benefits package to support overall well-being.

Qualifications

• At least 4 years of experience in application development.
• At least 2 years of experience with big data technologies.
• At least 1 year of experience with cloud computing.

Responsibilities

• Collaborate with Agile teams to design and develop technical solutions.
• Utilize programming languages and manage databases for data solutions.
• Mentor engineering members and experiment with new technologies.

Skills

Java

Scala

Python

Machine Learning

Cloud Computing

Agile Engineering Practices

Education

Bachelor’s Degree

Tools

AWS

Azure

Google Cloud

Redshift

Snowflake

Hadoop

Spark

Job description

Lead Data Engineer - Nexus Data Products

Lead Data Engineer at Capital One will craft and pioneer data solutions in a fast-paced, collaborative environment. The role focuses on marrying data with emerging technologies to drive powerful cloud-based experiences that help millions of Americans achieve financial empowerment.

What You’ll Do

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies.
• Work with developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize programming languages such as Java, Scala, and Python, and work with Open Source RDBMS, NoSQL databases, and cloud-based data warehousing services like Redshift and Snowflake.
• Participate in internal and external technology communities, stay on top of tech trends, experiment with new technologies, and mentor other engineering members.
• Collaborate with digital product managers to deliver robust cloud-based solutions.
• Perform unit tests and conduct code reviews to ensure rigorous design, elegant coding, and performance tuning.

Basic Qualifications

• Bachelor’s Degree.
• At least 4 years of experience in application development (internship experience does not apply).
• At least 2 years of experience with big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development, including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud).
• 4+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
• 4+ years experience working on real-time data and streaming applications.4+ years experience with NoSQL implementation (Mongo, Cassandra).
• 4+ years of data warehousing experience (Redshift or Snowflake).
• 4+ years of experience with UNIX/Linux, including basic commands and shell scripting.
• 2+ years of experience with Agile engineering practices.
• Experience leveraging interactive AI tooling to accelerate productivity.

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.

Equal Opportunity Employer

Capital One is an equal opportunity employer (EOE, including disability/veteran) committed to non-discrimination in compliance with applicable federal, state, and local laws.