Staff Software Engineer - Compiler & Spark Runtime

Snowflake

Menlo Park (CA)

On-site

USD 236,000 - 339,000

Full time

40 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Vision insurance
Life insurance
Disability insurance
401(k)
FSA/HSA
Paid holidays
Paid time off
Parental leave
Employee assistance program

Job summary

Snowflake is seeking a Staff Software Engineer for the Spark Runtime team. You will own complex compiler and runtime integration projects for Spark workloads on Snowflake’s cloud-native engine, translating customer needs into prioritized technical outcomes.

You will mentor engineers, review designs, and drive end-to-end production rollout, with a focus on performance, reliability, and cost-efficiency. This role requires deep expertise in compilers and runtime systems.

Qualifications

  • 10+ years of hands-on software engineering in compilers, query-processing systems, or runtime infrastructure.
  • Technical lead experience without formal management authority.
  • Experience delivering production systems with architectural ownership.
  • Deep expertise in compiler architecture, IR transformations, or runtime integration.

Responsibilities

  • Lead design and implementation of Spark query compilation and runtime integration.
  • Own complex engineering initiatives from problem definition to production rollout.
  • Provide technical leadership and resolve blockers across teams.
  • Improve workload performance and cost-efficiency through profiling and optimizations.
  • Drive production quality with observability and safe rollout practices.
  • Mentor engineers and align stakeholders on architectural decisions.

Skills

Compiler architecture
IR transformations
Relational query processing
Language semantics
Scala/Java/C++
Concurrency
Production code reviews

Education

BS in Computer Science or related field

Job description

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.

Staff Software Engineer – Compiler & Spark Runtime

Location: Bellevue, WA or Menlo Park, CA

About The Team

The Spark Runtime Engineering Team brings Snowflake’s performance, efficiency, and reliability to Spark workloads. Our mission is to help customers scale data processing while preserving the familiar Spark APIs and semantics they rely on. We build the compiler and runtime integration that translate Spark workloads into efficient execution on Snowflake’s cloud-native query engine. This includes tackling complex challenges in compiler infrastructure, query-plan lowering, Spark compatibility, execution integration, and end-to-end observability to deliver faster, more cost-efficient data processing at scale.

Role Overview

You will own complex projects from design through implementation and production rollout, contribute directly to the codebase, review critical designs and code, and investigate challenging correctness, performance, and reliability issues. You will provide technical leadership for engineers building production compiler and runtime capabilities for Spark workloads on Snowflake.

In partnership with compiler, query engine, runtime, and product teams, you will translate customer needs into focused technical priorities and measurable engineering outcomes. You will lead through technical judgment, hands‑on execution, mentorship, and influence—not through formal reporting relationships.

Responsibilities
  • Lead the technical design and implementation of Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and efficient SQL generation.
  • Own complex engineering initiatives from problem definition and architecture through implementation, validation, and production rollout.
  • Provide technical leadership to project teams by clarifying engineering trade‑offs, aligning contributors, reviewing designs and code, and resolving technical blockers.
  • Improve end‑to‑end workload performance and cost‑efficiency through profiling, compilation‑latency reduction, metadata‑access improvements, and collaboration with query‑engine teams.
  • Establish strong correctness and compatibility practices, including differential testing against Apache Spark, regression coverage, and clear handling of unsupported behavior.
  • Drive production quality for owned components, including observability, incident investigation, fault recovery, and safe rollout practices.
  • Mentor engineers through design discussions, code reviews, debugging, and knowledge sharing, strengthening the team’s technical capabilities.
  • Partner with senior technical leaders and Product Management to prioritize investments, identify dependencies, and scope deliverable engineering milestones.
  • Validate changes against representative customer workloads and track measurable improvements in compatibility, latency, reliability, and cost‑efficiency.
Minimum Qualifications
  • 10+ years of hands‑on software engineering experience, including substantial work on compilers, query‑processing systems, or runtime infrastructure.
  • Demonstrated experience serving as a technical lead for complex engineering initiatives, guiding engineers and coordinating delivery without requiring formal management authority.
  • A track record of designing, implementing, and delivering production systems, with ownership of significant architectural and implementation decisions.
  • Deep expertise in at least one relevant area, such as compiler architecture and IR transformations, relational query processing, language semantics and type systems, or runtime integration.
  • Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to write and review production code.
  • Strong systems fundamentals, including concurrency, memory behavior, and performance analysis, together with experience debugging complex production issues.
  • Ability to translate technical and customer requirements into practical engineering priorities and collaborate effectively across teams and locations.
  • Strong technical communication and mentorship skills, including the ability to build alignment around architectural decisions and explain complex trade‑offs.
Preferred Qualifications
  • Experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.
  • Experience with relational algebra, SQL generation, query optimization, or database execution systems.
  • Experience with Scala/JVM performance, native runtime functions, metadata caching, or compilation‑performance optimization.
  • Experience building compatibility‑test frameworks, differential testing, performance benchmarks, or production observability for data systems.
  • Experience technically leading systems through customer adoption, production hardening, and staged releases.
  • A degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com

The following represents the expected range of compensation for this role:

  • The estimated base salary range for this role is $236,000 - $339,200.
  • Additionally, this role is eligible to participate in Snowflake’s bonus and equity plan.

The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location. This role is also eligible for a competitive benefits package that includes: medical, dental, vision, life, and disability insurance; 401(k) retirement plan; flexible spending & health savings account; at least 12 paid holidays; paid time off; parental leave; employee assistance program; and other company benefits.

To comply with pay transparency requirements and other statutes, you can notify us if you believe that a job posting is not compliant by completing this form.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Medical, dental, vision
401(k) retirement plan
Flexible spending & health savings
+4
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
Medical, dental, vision, life, andDis+
401(k) retirement plan
Flexible spending & health savings
+5
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Menlo Park (CA)

On-site
USD 220,000 - 300,000
Engineering Manager/Tech Lead Manager - Runtime Engineering
Engineering Manager/Tech Lead Manager - Runtime Engineering

Snowflake Inc. • Menlo Park (CA)

On-site
USD 210,000 - 320,000
Staff Software Engineer - Compiler & Spark Runtime
Staff Software Engineer - Compiler & Spark Runtime

Snowflake • Bellevue (WA)

On-site
USD 240,000 - 360,000
Medical Insurance
Dental Insurance
Vision Insurance
+11
Staff Software Engineer - Snowhouse
Staff Software Engineer - Snowhouse

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Bonus and equity plan
Staff Software Engineer - Database Engineering
Staff Software Engineer - Database Engineering

Snowflake • Bellevue (WA)

On-site
USD 200,000 - 288,000
Medical Insurance
Dental Insurance
Vision Insurance
+8
Staff Software Engineer - AI Native Authoring
Staff Software Engineer - AI Native Authoring

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 339,000
401(k)
Paid time off
Paid holidays
+2
Staff Software Engineer - Query Processing (Snowtrail)
Staff Software Engineer - Query Processing (Snowtrail)

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 339,000
Health insurance
Dental insurance
Vision insurance
+8
Senior Software Engineer
Senior Software Engineer

Snowflake • Menlo Park (CA)

On-site
USD 200,000 - 288,000