Principal Data Processing Engineer — Execution Engine Lead

DataPelago, Inc.; Mountain View, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Stock options

Benefits package

Leadership development opportunities

Job summary

DataPelago, Inc. in Mountain View is seeking a Principal Data Processing Engineer to lead the core execution components of our high-performance data engine.

You will guide architecture, design, and implementation to improve speed, scale, and reliability for enterprise-grade analytics on large datasets. You will mentor a team of engineers, collaborate with product and customer teams, and push forward innovations that leverage accelerated computing, parallel processing, and open-source platforms

Qualifications

• 10+ years of experience in enterprise-grade database or analytics execution engines.
• Proven leadership of teams of 10+ engineers in design, development, and releases.
• Experience with Spark, Flink, Doris, Gluten, Velox, DataFusion/Comet or similar.

Responsibilities

• Drive evolution of the execution engine architecture with accelerated computing.
• Lead end-to-end lifecycle from design to rollout of enterprise-grade product.
• Design, implement, test, and maintain core components of the engine.
• Mentor engineers and promote best practices in design, testing, and CI/CD.
• Collaborate with product, engineering, and customer success teams.

Skills

C

C++

Rust

Linux

High-performance

Parallel processing

Education

BS in Computer Science

MS in Computer Science

Tools

Linux

GCC/LLVM

Git

CI/CD

Job description

DataPelago, Inc. in Mountain View is seeking a Principal Data Processing Engineer to lead the core execution components of our high-performance data engine.

You will guide architecture, design, and implementation to improve speed, scale, and reliability for enterprise-grade analytics on large datasets. You will mentor a team of engineers, collaborate with product and customer teams, and push forward innovations that leverage accelerated computing, parallel processing, and open-source platforms