Engineering Manager - Streaming

Menlo Ventures; Bellevue (WA); On-site; USD 181,000 - 241,000; Full time

Job summary

A leading technology firm in Bellevue is seeking a seasoned professional to lead engineering efforts focused on Stream Processing within the Databricks Intelligence Platform. The role involves overseeing a talented team, managing technical architecture, and ensuring high-quality product delivery. Ideal candidates will have significant experience in Apache Spark and distributed systems, and a passion for coaching and growing engineering talent. This position offers a competitive salary range of $181,000 to $241,000 USD, along with a commitment to diversity and inclusion.

Qualifications

• 5+ years experience in a related system, including big-data ecosystem.
• Experience in ensuring high-quality infrastructure services.
• Ability to attract, hire, and coach engineers.

Responsibilities

• Leading an engineering team in developing Stream Processing capabilities.
• Overseeing recruitment and upskilling of team members.
• Implementing processes to execute product vision.

Skills

Apache Spark

Distributed systems

Database internals

Performance optimization

Job description

Overview

At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems. We are the Apache “Spark™ Structured Streaming” team responsible for building Stream Processing capabilities into Apache Spark™ and the Databricks Intelligence Platform. Stream processing is in its infancy and we are here to build not just state‑of‑the‑art Stream Processing technology but a best‑in‑class managed offering for customers to run their Stream Processing workloads.

Key Responsibilities

• Leading a talented engineering team in the Apache Spark Structured Streaming team developing and promoting the engine in OSS and the Databricks data intelligence platform.
• Overseeing sustained recruitment of top‑tier talent and upskilling talent on the team.
• Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities.
• Building software that is not just high quality but easy to operate.
• Making company‑wide impact by driving Stream Processing adoption across the Databricks product portfolio.
• Managing technical debt, including long‑term technical architecture decisions and balancing product roadmap.

Desired Qualifications

• 5+ years experience working in a related system, including big‑data ecosystem, Apache Spark or database internals.
• A passion for database systems, storage systems, distributed systems, language design, or performance optimization.
• Ability to ensure the team builds high‑quality and reliable infrastructure services. Experience responsible for testing, quality, and SLAs of a product. Previous experience building and leading teams in a complex technical domain, such as distributed data systems or database internals.
• Ability to attract, hire, and coach engineers who meet Databricks hiring standards. Can up‑level existing team via hiring top‑notch senior talent, growing leaders and helping struggling members. Can gain trust of the team and guide their careers. Experience managing distributed teams preferred.
• Comfortable working cross‑functionally with product management and directly with customers; ability to deeply understand product and customer personas.

Pay Range

Local Pay Range: $181,000 – $241,000 USD.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio‑economic status, veteran status, and other protected characteristics.