Lead Data Engineer: Python, AWS, GenAI, Snowflake

Capital One; Chicago (IL); On-site; USD 179,000 - 205,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One is seeking a Lead Data Engineer to drive data engineering efforts across the Enterprise Platforms Technology organization. You will lead a team of developers, collaborate with Agile teams, and build scalable data pipelines using Python, SQL, and cloud data warehousing services.

The role emphasizes data modeling, governance, and using emerging technologies like GenAI. You will mentor engineers, contribute to platform improvements, and deliver robust cloud-based solutions for millions

Qualifications

• Bachelor's Degree required.
• At least 4 years of application development experience.
• At least 2 years of big data technologies experience.
• At least 1 year of cloud computing experience (AWS, Azure, GCP).
• Experience with Python, SQL, Spark, ETL tools, and cloud data warehousing.

Responsibilities

• Collaborate with Agile teams to design and deliver technical data solutions.
• Lead a team of developers in data movement, distributed computing, and full-stack systems.
• Utilize Python, SQL, Snowflake/Databricks for data warehousing and analytics.
• Optimize data design for end-user and downstream consumers.
• Mentor engineers and share knowledge of new technologies.

Skills

Python

SQL

Spark

ETL tools

AWS Glue

Big data

Cloud computing

NoSQL

Education

Bachelor's Degree

Tools

Snowflake

Databricks

Hadoop

Redshift

Kafka

MongoDB

MySQL

Job description

Capital One is seeking a Lead Data Engineer to drive data engineering efforts across the Enterprise Platforms Technology organization. You will lead a team of developers, collaborate with Agile teams, and build scalable data pipelines using Python, SQL, and cloud data warehousing services.

The role emphasizes data modeling, governance, and using emerging technologies like GenAI. You will mentor engineers, contribute to platform improvements, and deliver robust cloud-based solutions for millions