Senior Data Engineer - Cloud-First ML Pipelines

ITSMF; Chicago (IL); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking Data Engineer 4 (Manager, IC) to lead data initiatives in a cloud-first environment. You will collaborate with agile teams to design and implement scalable data solutions using Python, Spark, and modern data platforms like Databricks and Snowflake.

You will mentor teams, drive architecture decisions, and ensure secure, efficient data pipelines across multiple domains, enabling data-driven experiences for customers.

Qualifications

• Bachelor's Degree or higher in Computer Science or related quantitative field.
• At least 4 years of experience in application development.
• At least 2 years of experience in distributed data.
• At least 2 years of experience with SQL.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Influence a team of developers, data analysts and data scientists on data platforms.
• Utilize Python, Spark, and cloud-based data warehousing platforms like Databricks and Snowflake.
• Mentor other members of the data community and stay updated on data trends.
• Deliver cloud-first data solutions for scalable, secure data pipelines.

Skills

Python

SQL

Java

Scala

Data pipelines

Cloud computing

Education

Bachelor's degree or higher in CS or related field

Tools

Databricks

Snowflake

EMR

Spark

Airflow

Job description

Capital One is seeking Data Engineer 4 (Manager, IC) to lead data initiatives in a cloud-first environment. You will collaborate with agile teams to design and implement scalable data solutions using Python, Spark, and modern data platforms like Databricks and Snowflake.

You will mentor teams, drive architecture decisions, and ensure secure, efficient data pipelines across multiple domains, enabling data-driven experiences for customers.