Spark Runtime Engineering Lead

Snowflake Inc.

Menlo Park (CA)

On-site

USD 210,000 - 320,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Snowflake seeks an Engineering Manager for Spark Runtime Engineering in the US, leading a small team of engineers focused on production compiler and runtime capabilities for Spark workloads on Snowflake. You will guide architectural decisions, review critical designs, and ensure reliable, cost-efficient data processing at scale.

You will collaborate with compiler, query engine, and product teams to translate customer needs into a focused roadmap, mentor engineers, and drive performance

Qualifications

  • 2+ years of direct engineering management experience.
  • 5+ years of hands-on software engineering experience, including work on compilers, query-processing systems, or runtime infrastructure.
  • Deep expertise in compiler architecture, IR transformations, relational query processing, or runtime integration.
  • Proficiency in Scala, Java, or C++, with ability to review production code and guide decisions.
  • Strong systems fundamentals (concurrency, memory behavior, performance) and experience debugging complex production issues.
  • Ability to translate technical/customer requirements into engineering priorities and collaborate across teams.

Responsibilities

  • Set technical direction for Spark query compilation and runtime integration, including IRs and semantic compatibility.
  • Improve end-to-end workload performance and cost-efficiency through profiling and optimizations.
  • Establish strong correctness and compatibility practices, including differential testing against Apache Spark.
  • Own production quality of the team’s components, including observability, incident response, and safe rollout practices.
  • Hire, coach, and develop engineers; provide actionable feedback and support career growth.
  • Partner with senior technical leaders and Product Management to prioritize investments and deliver a realistic roadmap.
  • Validate changes against customer workloads and track improvements in compatibility and latency.

Skills

Engineering management
Software engineering
Compiler architecture
IR transformations
Relational query processing
Concurrency
Scala/JVM languages
Code review

Education

CS degree or equivalent

Tools

Scala
Java
C++

Job description

Snowflake seeks an Engineering Manager for Spark Runtime Engineering in the US, leading a small team of engineers focused on production compiler and runtime capabilities for Spark workloads on Snowflake. You will guide architectural decisions, review critical designs, and ensure reliable, cost-efficient data processing at scale.

You will collaborate with compiler, query engine, and product teams to translate customer needs into a focused roadmap, mentor engineers, and drive performance

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager — Spark Runtime & Compiler Lead
Engineering Manager — Spark Runtime & Compiler Lead

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
Medical, dental, vision, life, andDis+
401(k) retirement plan
Flexible spending & health savings
+5
Engineering Manager - Spark Runtime & Compiler
Engineering Manager - Spark Runtime & Compiler

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical, dental, vision
401(k) retirement plan
Flexible spending & health savings
+4
Staff Spark Compiler & Runtime Engineer
Staff Spark Compiler & Runtime Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical insurance
Dental insurance
Vision insurance
+8
Staff Software Engineer - Spark Runtime & Compiler Architect
Staff Software Engineer - Spark Runtime & Compiler Architect

Snowflake • Bellevue (WA)

On-site
USD 240,000 - 360,000
Medical Insurance
Dental Insurance
Vision Insurance
+11
Staff Spark Compiler & Runtime Engineer - High-Impact Data
Staff Spark Compiler & Runtime Engineer - High-Impact Data

Snowflake • Menlo Park (CA)

On-site
USD 220,000 - 300,000
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake Inc. • Menlo Park (CA)

On-site
USD 210,000 - 320,000
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
Medical, dental, vision, life, andDis+
401(k) retirement plan
Flexible spending & health savings
+5
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Menlo Park (CA)

On-site
USD 220,000 - 300,000
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical, dental, vision
401(k) retirement plan
Flexible spending & health savings
+4
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Bellevue (WA)

On-site
USD 240,000 - 360,000
Medical Insurance
Dental Insurance
Vision Insurance
+11