Senior Real-Time Streaming Data Platform Engineer

Capital One; Plano (TX); Vor Ort; USD 179.000 - 205.000; Vollzeit

Zusammenfassung

Capital One is seeking a Data Engineer 4 to design and build a real-time data platform. You will lead scalable, low-latency streaming pipelines, work with Spark, Flink, Kafka, Snowflake, Redshift, and AWS services, and collaborate across agile teams to deliver impactful data solutions.

You will mentor engineers, promote best practices in data architecture, and contribute to CI/CD, resiliency, and security initiatives while solving complex business problems for millions of customers.

Qualifikationen

• .Bachelor's degree in Computer Science or related quantitative field.
• 2+ years in distributed data development.
• 2+ years SQL.
• 2+ years in one programming language (Python/Java/Scala).
• 2+ years data pipeline design and development.
• 1 year data modeling with relational/non-relational systems.

Aufgaben

• Lead design and build enterprise-scale streaming data platform.
• Build pipelines with Flink/Spark, and data stores.
• Lead engineers on data pipelines using Spark, Flink, Kafka, Snowflake, AWS services.
• Influence data pipeline design and data architecture approaches.
• Collaborate with Agile teams and ensure CI/CD and security alignment.
• Mentor engineers and share new tech trends.

Kenntnisse

Python

Java

Scala

SQL

Spark

Flink

Kafka

Snowflake

Redshift

AWS

CI/CD

Agile

Ausbildung

Bachelor's degree in Computer Science or related quantitative field

Jobbeschreibung

Capital One is seeking a Data Engineer 4 to design and build a real-time data platform. You will lead scalable, low-latency streaming pipelines, work with Spark, Flink, Kafka, Snowflake, Redshift, and AWS services, and collaborate across agile teams to deliver impactful data solutions.

You will mentor engineers, promote best practices in data architecture, and contribute to CI/CD, resiliency, and security initiatives while solving complex business problems for millions of customers.