Senior Data Engineer Manager (Databricks, Spark, Snowflake)

Capital One National Association; Chicago (IL); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking a Senior Manager Data Engineer to lead a high-performing team building cloud-based data solutions using Databricks, PySpark, and Snowflake. You will collaborate with agile teams to design, develop, and deploy scalable data pipelines for real-time analytics.

The role requires strong leadership, 6+ years of software and data experience, and hands-on expertise with AWS or other cloud platforms, distributed systems, and data warehousing.

Qualifications

• Bachelor's or higher in computer science, engineering, or a related field.
• 6+ years of application development experience.
• 2+ years with big data technologies.
• 1+ year of cloud experience.
• 4+ years of people management experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support full-stack data solutions.
• Lead a team of developers with expertise in ML, distributed microservices, and data systems.
• Use Java, Scala, Python, and cloud data warehousing services like Redshift and Snowflake.

Skills

Databricks

PySpark

Cloud adoption

Big data

Distributed systems

Mentoring

Agile

Education

Bachelor's Degree

Master's Degree

Tools

Python

Java

Scala

SQL

Redshift

Snowflake

Unix/Linux

Job description

Capital One is seeking a Senior Manager Data Engineer to lead a high-performing team building cloud-based data solutions using Databricks, PySpark, and Snowflake. You will collaborate with agile teams to design, develop, and deploy scalable data pipelines for real-time analytics.

The role requires strong leadership, 6+ years of software and data experience, and hands-on expertise with AWS or other cloud platforms, distributed systems, and data warehousing.