Senior Data Engineer - Cloud, Lakehouse & Spark

African American Talent; Chicago (IL); In loco; USD 209.000 - 239.000; Tempo pieno

Descrizione del lavoro

Capital One is seeking a Data Engineer 5 to join a bold engineering team focused on cloud-first data solutions. You will design and deliver scalable data pipelines, mentor peers, and influence architecture across platforms like Snowflake, Databricks, and Spark.

You’ll work with product managers and engineers to drive data-driven experiences for millions. The role emphasizes collaboration, hands-on coding, and independent decision making in a fast-paced environment.

Competenze

• Bachelor's degree in Computer Science or related quantitative field
• At least 6 years of application development experience
• At least 4 years of distributed data experience
• At least 4 years of SQL
• At least 4 years of Python/Java/Scala
• At least 4 years of data pipeline development
• At least 2 years for data modeling with relational and non-relational databases

Mansioni

• Collaborate with Agile teams to design, develop, test, and support solutions
• Influence teams with data engineering and ML concepts
• Use Python, Spark, Databricks, Snowflake for cloud data solutions
• Mentor data community and share knowledge
• Deliver cloud-first data solutions for major financial services use cases
• Architect data platform patterns for quality and reusability
• Communicate technical outcomes to stakeholders
• Build scalable data pipelines with resilience and performance
• Lead large‑scale data initiatives end-to-end

Conoscenze

Python

SQL

Spark

Machine learning awareness

Formazione

Bachelor's degree in CS or related

Master’s degree in CS or related

Strumenti

Databricks

Snowflake

Spark

Python

SQL

Airflow

Dagster

EMR

NoSQL databases

Descrizione del lavoro

Capital One is seeking a Data Engineer 5 to join a bold engineering team focused on cloud-first data solutions. You will design and deliver scalable data pipelines, mentor peers, and influence architecture across platforms like Snowflake, Databricks, and Spark.

You’ll work with product managers and engineers to drive data-driven experiences for millions. The role emphasizes collaboration, hands-on coding, and independent decision making in a fast-paced environment.