Senior Cloud Data Engineer | ML-Driven Data Pipelines

Capital One National Association; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 in New York, NY to design, build, and support cloud-first data solutions in collaboration with Agile teams. You will work with developers, data scientists and product managers to deliver scalable data platforms using Python, Spark, and modern data warehouses like Databricks and Snowflake.

Minimum qualifications include a CS degree and 4+ years in application development, with 2+ years in distributed data, SQL, and one programming language

Qualifications

• Bachelor's degree or higher in Computer Science or related field.
• 4+ years in application development; 2+ years in distributed data.
• 2+ years with SQL and one programming language (Python/Java/Scala).
• 2+ years in data pipeline design and development.

Responsibilities

• Collaborate across Agile teams to design, develop, test, implement, and support full-stack data solutions.
• Influence a team of developers, data analysts and data scientists with ML, distributed microservices and lakehouse architectures.
• Utilize Python, Spark and cloud data warehousing (Databricks, Snowflake) tools.
• Mentor data community members and share trends, tooling, and best practices.
• Partner with product managers and engineers to deliver cloud-first data solutions.
• Design, build, and deliver scalable data platforms with strong security and access controls.
• Communicate technical concepts clearly to stakeholders and drive alignment.

Skills

Full-stack development

Python

SQL

Spark

Data pipelines

Cloud platforms

Team leadership

Education

Bachelor's degree in CS or related field

Job description

Capital One is seeking a Data Engineer 4 in New York, NY to design, build, and support cloud-first data solutions in collaboration with Agile teams. You will work with developers, data scientists and product managers to deliver scalable data platforms using Python, Spark, and modern data warehouses like Databricks and Snowflake.

Minimum qualifications include a CS degree and 4+ years in application development, with 2+ years in distributed data, SQL, and one programming language