Senior Data Engineer (Hybrid) — Cloud Data Pipelines

Capital One Group; Plano (TX); Hybrid; USD 179,000 - 205,000; Full time

Job summary

Capital One seeks a Data Engineer 4 to drive data platform transformation in a hybrid Plano, TX setting. You will design and scale cloud data solutions using Python, Spark, Databricks and Snowflake, partnering with product managers, engineers and data scientists to deliver impactful financial services experiences.

You will mentor peers, enforce data engineering standards, and build end-to-end pipelines with governance and security.

Qualifications

• Bachelor’s degree or higher in CS or quantitative field
• At least 4 years of application development experience
• At least 2 years distributed data experience
• At least 2 years SQL experience
• At least 2 years experience in one programming language (Python, Java, or Scala)
• At least 2 years data pipeline design and development
• At least 1 year data modeling with relational and non-relational systems

Responsibilities

• Collaborate with agile teams to design, develop, test, and support technical solutions
• Influence a team of developers, analysts and data scientists
• Use Python and Spark with Databricks and Snowflake for data warehousing
• Mentor data community members and stay current with data trends
• Deliver cloud-first data solutions that empower millions of users

Skills

Python

Spark

SQL

Data pipelines

Distributed data

NoSQL databases

Education

Bachelor’s Degree or higher in Computer Science or related field

Tools

Databricks

Snowflake

EMR

Glue

Spark

Job description

Capital One seeks a Data Engineer 4 to drive data platform transformation in a hybrid Plano, TX setting. You will design and scale cloud data solutions using Python, Spark, Databricks and Snowflake, partnering with product managers, engineers and data scientists to deliver impactful financial services experiences.

You will mentor peers, enforce data engineering standards, and build end-to-end pipelines with governance and security.