Real-Time Data Platform Lead Engineer

Capital One Group

Plano, Northern (TX, KY)

Hybrid

USD 179,000 - 205,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Capital One is seeking a Lead Data Engineer to drive a scalable, real-time data platform and analytics capabilities across the enterprise. You will lead a team of engineers, design streaming pipelines, and collaborate with product and security teams to deliver resilient cloud-based solutions that empower millions of Americans.

You’ll mentor peers, stay current on technology trends, and contribute to agile delivery, CI/CD, and data governance within a fast-paced environment.

Qualifications

Bachelor’s degree in a relevant field.
At least 4 years of experience in application development (internship experience does not apply).
At least 2 years of experience with big data technologies.
At least 1 year of cloud computing experience (AWS, Azure, Google Cloud).

Responsibilities

Lead design and build enterprise-scale streaming data platform with low latency and fault tolerance.
Develop distributed streaming pipelines and analytics data stores using Flink, Spark Streaming with Java, Python or Scala.
Lead engineers building data pipelines using Spark, Flink, Kafka, Snowflake, AWS Redshift on large datasets.
Influence data pipeline design, data architecture and processing of structured and unstructured data.
Collaborate with agile teams to design, develop, test, implement, and support technical solutions in full-stack data environments.
Mentor engineers and share best practices, stay current with tech trends, and participate in internal/external communities.