Senior Data Engineer, Cloud Data Platforms & Pipelines

Capital One; Chicago (IL); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 to join Marketing and Messaging (Enterprise Platform Technology) in Chicago. You will collaborate across Agile teams to design and deliver cloud-first data solutions, leveraging Python, Spark, and SQL with Snowflake and Databricks.

You’ll lead end-to-end data initiatives, mentor peers, and drive scalable data platforms for enhanced customer experiences. The role emphasizes architecture decisions, data modeling, and collaboration with product managers and

Qualifications

• Bachelor's Degree or higher in Computer Science or related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 6 years of experience in application development
• At least 4 years of experience in distributed data
• At least 4 years of experience with SQL
• At least 4 years programming in Python, Java, or Scala
• At least 4 years of experience designing and developing data pipelines
• At least 2 years in data modeling and end-to-end data solutions using relational and NoSQL databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions
• Influence a team of developers, data analysts and data scientists
• Utilize Python and Spark with relational and NoSQL databases
• Mentor data community members and share knowledge
• Deliver cloud-first data solutions to drive customer experiences
• Independently design and deliver data solutions with minimal supervision
• Architect common data engineering patterns for code quality and reuse
• Communicate technical concepts and data outcomes to stakeholders
• Design scalable data pipelines with resilience and efficiency
• Lead large-scale data initiatives from end-to-end

Skills

Python

SQL

Spark

NoSQL databases

Databricks

Snowflake

Data pipelines

Data modeling

Cloud platforms

Machine learning concepts

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Snowflake

Cloud platforms (AWS/Azure/GCP)

Job description

Capital One is seeking a Data Engineer 5 to join Marketing and Messaging (Enterprise Platform Technology) in Chicago. You will collaborate across Agile teams to design and deliver cloud-first data solutions, leveraging Python, Spark, and SQL with Snowflake and Databricks.

You’ll lead end-to-end data initiatives, mentor peers, and drive scalable data platforms for enhanced customer experiences. The role emphasizes architecture decisions, data modeling, and collaboration with product managers and