Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake Inc.

Menlo Park (CA)

On-site

USD 210,000 - 320,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Snowflake seeks an Engineering Manager for Spark Runtime Engineering in the US, leading a small team of engineers focused on production compiler and runtime capabilities for Spark workloads on Snowflake. You will guide architectural decisions, review critical designs, and ensure reliable, cost-efficient data processing at scale.

You will collaborate with compiler, query engine, and product teams to translate customer needs into a focused roadmap, mentor engineers, and drive performance

Qualifications

  • 2+ years of direct engineering management experience.
  • 5+ years of hands-on software engineering experience, including work on compilers, query-processing systems, or runtime infrastructure.
  • Deep expertise in compiler architecture, IR transformations, relational query processing, or runtime integration.
  • Proficiency in Scala, Java, or C++, with ability to review production code and guide decisions.
  • Strong systems fundamentals (concurrency, memory behavior, performance) and experience debugging complex production issues.
  • Ability to translate technical/customer requirements into engineering priorities and collaborate across teams.

Responsibilities

  • Set technical direction for Spark query compilation and runtime integration, including IRs and semantic compatibility.
  • Improve end-to-end workload performance and cost-efficiency through profiling and optimizations.
  • Establish strong correctness and compatibility practices, including differential testing against Apache Spark.
  • Own production quality of the team’s components, including observability, incident response, and safe rollout practices.
  • Hire, coach, and develop engineers; provide actionable feedback and support career growth.
  • Partner with senior technical leaders and Product Management to prioritize investments and deliver a realistic roadmap.
  • Validate changes against customer workloads and track improvements in compatibility and latency.

Skills

Engineering management
Software engineering
Compiler architecture
IR transformations
Relational query processing
Concurrency
Scala/JVM languages
Code review

Education

CS degree or equivalent

Tools

Scala
Java
C++

Job description

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.

Engineering Manager – Spark Runtime Engineering

Location: Bellevue, WA or Menlo Park, CA

About the Team

The Spark Runtime Engineering Team brings Snowflake’s performance, efficiency, and reliability to Spark workloads. Our mission is to help customers scale data processing while preserving the familiar Spark APIs and semantics they rely on. We build the compiler and runtime integration that translate Spark workloads into efficient execution on Snowflake’s cloud-native query engine. This includes tackling complex challenges in compiler infrastructure, query-plan lowering, Spark compatibility, execution integration, and end-to-end observability to deliver faster, more cost-efficient data processing at scale.

We are seeking a hands‑on Engineering Manager who combines deep technical expertise with strong people leadership. You will shape the team’s technical direction, stay actively engaged in architecture and critical engineering decisions, and hire, mentor, and grow a high‑performing engineering team to advance the future of Spark on Snowflake.

Role Overview

You will lead a team of approximately 5–8 engineers building production compiler and runtime capabilities for Spark workloads on Snowflake. You will guide architectural decisions, review critical designs and code, and help investigate complex correctness, performance, and reliability issues. In partnership with compiler, query engine, runtime, and product teams, you will turn customer needs into a focused roadmap and measurable engineering outcomes.

Responsibilities
  • Set technical direction for Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and efficient SQL generation.

  • Improve end-to-end workload performance and cost-efficiency through profiling, compilation‑latency reduction, metadata‑access improvements, and collaboration with query‑engine teams.

  • Establish strong correctness and compatibility practices, including differential testing against Apache Spark, regression coverage, and clear handling of unsupported behavior.

  • Own the production quality of the team’s components, including observability, incident response, fault recovery, and safe rollout practices.

  • Hire, coach, and develop engineers; provide actionable feedback, manage performance, and support career growth across experience levels.

  • Partner with senior technical leaders and Product Management to prioritize investments, manage dependencies, and deliver a realistic roadmap.

  • Validate changes against representative customer workloads and track measurable improvements in compatibility, latency, reliability, and cost‑efficiency.

Minimum Qualifications
  • 2+ years of direct engineering management experience, with demonstrated success developing engineers and delivering production systems.

  • 5+ years of hands‑on software engineering experience, including substantial work on compilers, query-processing systems, or runtime infrastructure.

  • Deep expertise in at least one relevant area, such as compiler architecture and IR transformations, relational query processing, language semantics and type systems, or runtime integration.

  • Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to review production code and guide technical decisions.

  • Strong systems fundamentals, including concurrency, memory behavior, and performance analysis, together with experience debugging complex production issues.

  • Ability to translate technical and customer requirements into engineering priorities and collaborate effectively across teams and locations.

Preferred Qualifications
  • Experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.

  • Experience with relational algebra, SQL generation, query optimization, or database execution systems.

  • Experience with Scala/JVM performance, native runtime functions, metadata caching, or compilation-performance optimization.

  • Experience building compatibility-test frameworks, differential testing, performance benchmarks, or production observability for data systems.

  • Experience leading systems through customer adoption, production hardening, and staged releases.

  • A degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

Why Join Us?

Help shape how Spark workloads run on Snowflake. You will work on technically challenging compiler and runtime problems, grow a strong engineering team, and make a measurable difference to the correctness, reliability, and cost‑efficiency of customers’ data processing.

Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical, dental, vision
401(k) retirement plan
Flexible spending & health savings
+4
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
Medical, dental, vision, life, andDis+
401(k) retirement plan
Flexible spending & health savings
+5
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Menlo Park (CA)

On-site
USD 220,000 - 300,000
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical insurance
Dental insurance
Vision insurance
+8
Spark Runtime Engineering Lead
Spark Runtime Engineering Lead

Snowflake Inc. • Menlo Park (CA)

On-site
USD 210,000 - 320,000
Engineering Manager — Spark Runtime & Compiler Lead
Engineering Manager — Spark Runtime & Compiler Lead

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
Medical, dental, vision, life, andDis+
401(k) retirement plan
Flexible spending & health savings
+5
Engineering Manager - Spark Runtime & Compiler
Engineering Manager - Spark Runtime & Compiler

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical, dental, vision
401(k) retirement plan
Flexible spending & health savings
+4
Staff Spark Compiler & Runtime Engineer
Staff Spark Compiler & Runtime Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical insurance
Dental insurance
Vision insurance
+8
Staff Spark Compiler & Runtime Engineer - High-Impact Data
Staff Spark Compiler & Runtime Engineer - High-Impact Data

Snowflake • Menlo Park (CA)

On-site
USD 220,000 - 300,000
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Bellevue (WA)

On-site
USD 240,000 - 360,000
Medical Insurance
Dental Insurance
Vision Insurance
+11