Cloud Data Engineer: Resilient Pipelines & Lakehouse

Capital One; Plano (TX); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 to help drive a major transformation in cloud-first data platforms. You will work across Agile teams, shaping data pipelines and platforms with focus on scalability, security, and performance.

You’ll leverage Python, Spark, and SQL with Databricks, Snowflake and NoSQL databases while mentoring others and staying ahead of technology trends. Plano, TX location emphasizes a strong data-driven culture.

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field.
• At least 4 years of experience in application development.
• At least 2 years of experience in distributed data.
• At least 2 years of experience with SQL.
• At least 2 years of experience with one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Influence a team of developers, data analysts and data scientists with ML, microservices, lakehouse architecture, and full-stack systems.
• Utilize Python and Spark with relational and NoSQL databases and cloud data warehousing (Databricks, Snowflake).
• Mentor data community members and stay current with data trends and technologies.
• Collaborate with product managers and engineers to deliver cloud-first data solutions for millions of customers.

Skills

Python

SQL

Spark

Data pipelines

Data modeling

Education

Bachelor's degree in Computer Science or related quantitative field

Tools

Databricks

Snowflake

EMR

Airflow

Dagster

Job description

Capital One is seeking a Data Engineer 4 to help drive a major transformation in cloud-first data platforms. You will work across Agile teams, shaping data pipelines and platforms with focus on scalability, security, and performance.

You’ll leverage Python, Spark, and SQL with Databricks, Snowflake and NoSQL databases while mentoring others and staying ahead of technology trends. Plano, TX location emphasizes a strong data-driven culture.