Senior Data Engineer: Python, SQL, AWS & GenAI

Capital One; Deerfield (IL); On-site; USD 179,000 - 205,000; Full time

Job summary

Capital One is seeking Data Engineers to join the Marketing and Messaging team, delivering cloud-first data solutions. You’ll collaborate with Agile teams and mentor peers while building scalable pipelines using Python, Spark, Databricks and Snowflake.

You’ll work with product managers and software engineers to empower millions of Americans with secure, robust data experiences in a fast-paced environment.

Qualifications

• Bachelor's degree or higher in Computer Science or a related quantitative field.
• At least 4 years of application development experience.
• At least 2 years of distributed data experience.
• At least 2 years of SQL experience.
• At least 2 years of programming experience (Python, Java, or Scala).
• At least 2 years of data pipeline design and development.
• At least 1 year of data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Influence a team of developers, data analysts and data scientists with ML and microservices.
• Utilize Python and Spark with Databricks and Snowflake for cloud data work.
• Mentor and share knowledge across the data community and internal teams.
• Partner with product managers and engineers to deliver cloud-first data solutions.
• Independently design, build and deliver data solutions with minimal supervision.
• Enforce consistent data engineering design patterns for quality and reuse.
• Communicate data outcomes clearly to stakeholders to drive alignment.
• Design scalable, resilient data pipelines with strong security and performance.
• Implement encryption, access control, and privacy compliance.

Skills

Python

Spark

SQL

Data pipelines

Education

Bachelor's Degree or higher in Computer Science or related field

Tools

Databricks

Snowflake

EMR

Airflow

Job description

Capital One is seeking Data Engineers to join the Marketing and Messaging team, delivering cloud-first data solutions. You’ll collaborate with Agile teams and mentor peers while building scalable pipelines using Python, Spark, Databricks and Snowflake.

You’ll work with product managers and software engineers to empower millions of Americans with secure, robust data experiences in a fast-paced environment.