Senior Data Engineer - Real-Time, Cloud & ML Focus

Capital One; North Dakota; On-site; USD 179,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to drive development across Big Data, ML and ETL initiatives. You will collaborate with Agile teams and engineers to deliver robust cloud-based data solutions, applying Java, Python, Scala and SQL across Redshift/Snowflake environments.

The role emphasizes mentoring, technology exploration, and performance tuning, with opportunities to influence enterprise data programs and empower millions of customers.

Qualifications

• Bachelor's Degree required.
• 4+ years in application development.
• 2+ years in big data technologies.
• 1+ year in cloud computing (AWS/Azure/Google).
• Experience with distributed data/tools preferred.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions.
• Work with engineers skilled in ML, distributed microservices, and ETL systems.
• Use Java, Scala, Python and SQL/NoSQL databases and cloud data warehousing (Redshift, Snowflake).
• Mentor engineers and contribute to tech communities.
• Deliver cloud-based solutions for scalable customer experiences.
• Perform unit tests and code reviews for performance and maintainability.

Skills

Java

Python

Scala

Big data

Cloud computing

AWS

Azure

GCP

Redshift

Snowflake

Hadoop

MapReduce

Kafka

Spark

SQL

NoSQL

UNIX/Linux

Shell scripting

Agile

AI tooling

Education

Bachelor's Degree

Tools

EMR

Hive

MySQL

MongoDB

Cassandra

Kubernetes

Job description

Capital One is seeking a Lead Data Engineer to drive development across Big Data, ML and ETL initiatives. You will collaborate with Agile teams and engineers to deliver robust cloud-based data solutions, applying Java, Python, Scala and SQL across Redshift/Snowflake environments.

The role emphasizes mentoring, technology exploration, and performance tuning, with opportunities to influence enterprise data programs and empower millions of customers.