Senior Staff Engineer, Big Data Infrastructure

Stripe, Inc.

New York (NY)

On-site

USD 271,000 - 407,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
401(k) plan
Medical benefits (health, dental, vis)

Job summary

Stripe, Inc. is seeking a Technical Leader for the Big Data Infrastructure team to guide a 40+ engineer group in scaling data systems, partnering with Data Foundations, Payins Engineering, and AI/ML Foundations to modernize the stack and enable AI agents to operate data pipelines end-to-end.

You will drive modernization bets, migrate from YARN to Kubernetes, advance native vectorization (Gluten/Velox), and implement multi-region, multi-cloud data strategies for high availability and compliance.

Qualifications

  • BS or MS in Computer Science or a related field.
  • Senior Staff level with 12+ years of professional software development experience.
  • Strong background in distributed infrastructure and/or platform services (storage, databases, compute).
  • Experience leading cross-team and company-wide projects with minimal downtime.
  • Experience building reliable, scalable distributed systems with focus on reliability and security.
  • Experience driving a culture of operational excellence with metrics, alerts, and dashboards.

Responsibilities

  • Serve as the technical leader for the Big Data Infrastructure organization.
  • Oversee distributed systems that manage substantial AWS spend.
  • Drive modernization bets (YARN to Kubernetes, native vectorization, Airflow modernization).
  • Lead multi-region and multi-cloud data strategy for high availability and compliance.
  • Mentor engineers and foster a culture of excellence.

Skills

Distributed systems
Technical leadership
Engineering leadership
Operational excellence
Cross-team collaboration

Education

BS/MS in Computer Science or related field

Tools

Spark
Iceberg
S3
Airflow
YARN
Celeborn
Kubernetes
Gluten/Velox

Job description

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.


About the team

In this role, you’d be joining the Big Data Infrastructure team. Our team builds and maintains the platforms that power data work across Stripe, managing three core layers:



  • Data Orchestration (Airflow)

  • Batch Compute (Spark, Celeborn)

  • Data Lake (Iceberg, Hive, S3, Azure Blob Storage)


We support over 2,000 engineers and 600+ internal teams, processing workloads that organically grow more than 30% year over year. Our infrastructure handles massive scale, managing over 800 PB of data, running 325,000 applications a day, and accounting for hundreds of millions of dollars in annual spend, directly powering critical pipelines like inbound payments, network reconciliation, and capital underwriting.


What you’ll do

As the technical leader for the Big Data Infrastructure organization, you will guide a 40+ person engineering team to scale our foundational data systems. You will partner closely with major internal customers like Data Foundations, Payins Engineering, and AI/ML Foundations to modernize our tech stack and execute Stripe's transition to the "Agentic Era" - building "invisible infrastructure" where AI agents operate data pipelines end-to-end.


Responsibilities


  • Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe's total AWS spend

  • Execute Stripe's transition to the "Agentic Era" by building invisible infrastructure that empowers AI agents to author, validate, ship, and operate data pipelines

  • Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization

  • Lead the implementation of a multi-region and multi-cloud data strategy for high availability, disaster recovery, and Azure Blob Storage compliance

  • Reduce operational burden and maintenance overhead (KTLO) from over 40% to under 10% by shifting fixes into the platform instead of relying on runbooks

  • Foster a culture of operational excellence and mentor engineers at various stages in their careers, up to Staff+


Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.


Minimum requirements


  • BS or MS in Computer Science or a related field

  • This is a Senior Staff role, so ideally 12+ years of professional experience in a software development role

  • A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute

  • Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime

  • Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security

  • Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards


Preferred qualifications


  • Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems

  • Experience in a development team at AWS, Azure, OCI, or Google

  • Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn

  • Experience with database internals and/or with Kubernetes


In-office expectations

Office-assigned Stripes in most of our locations are currently expected to spend at least 50% of the time in a given month in their local office or with users. This expectation may vary depending on role, team and location. For example, Stripes in Stripe Delivery Center roles in Mexico City, Mexico, Bengaluru, India, and Dublin, Ireland work 100% from the office. Also, some teams have greater in-office attendance requirements, to appropriately support our users and workflows, which the hiring manager will discuss. This approach helps strike a balance between bringing people together for in-person collaboration and learning from each other, while supporting flexibility when possible.


Pay and benefits

The annual US base salary range for this role is $271,200 - $406,800. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role. This salary range may be inclusive of several career levels at Stripe and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location. Applicants interested in this role and who are not located in the US may request the annual salary range for their location during the interview process.


Additional benefits for this role may include: equity, company bonus or sales commissions/bonuses; 401(k) plan; medical, dental, and vision benefits; and wellness stipends.


We look forward to hearing from you.

At Stripe, we're looking for people with passion, grit, and integrity. You're encouraged to apply even if your experience doesn't precisely match the job description. Your skills and passion will stand out—and set you apart—especially if your career has taken some extraordinary twists and turns. At Stripe, we welcome diverse perspectives and people who think rigorously and aren't afraid to challenge assumptions. Join us.


Please find our California applicant personal information notice here.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Engineer, Big Data Infrastructure
Senior Staff Engineer, Big Data Infrastructure

Stripe, Inc. • Seattle (WA)

On-site
USD 271,000 - 407,000
Equity
401(k)
Medical, dental, vision benefits
+1
Staff Software Engineer, Risk Data Engineering
Staff Software Engineer, Risk Data Engineering

Stripe, Inc. • Seattle (WA)

Hybrid
USD 224,000 - 336,000
Equity
Company bonus or sales commissions/bon
401(k) plan
+2
Data Analyst, NYC
Data Analyst, NYC

Stripe, Inc. • New York (NY)

On-site
USD 162,000 - 242,000
Equity
Company Bonus/Commissions
401(k) plan
+2
Strategy & Operations, Infrastructure
Strategy & Operations, Infrastructure

Stripe, Inc. • San Francisco (CA)

On-site
USD 192,000 - 287,000
Equity
401(k) plan
Medical, dental, and vision
+1
Strategy & Operations, Infrastructure
Strategy & Operations, Infrastructure

Stripe, Inc. • Seattle (WA)

On-site
USD 192,000 - 287,000
Equity
401(k) plan
Medical, dental, and vision benefits
+1
Software Engineer, Early Career — Immediate Start
Software Engineer, Early Career — Immediate Start

Stripe, Inc. • San Francisco (CA)

On-site
USD 122,000 - 134,000
Equity
Company bonus
401(k) plan
+2
Staff Software Engineer, IAM Control Plane
Staff Software Engineer, IAM Control Plane

Stripe, Inc. • San Francisco (CA)

On-site
USD 224,000 - 336,000
Equity
401(k) plan
Medical, dental and vision benefits
+1
Integration Engineer, Professional Services
Integration Engineer, Professional Services

Stripe, Inc. • Chicago (IL)

Hybrid
USD 204,000 - 306,000
Equity
401(k) plan
Medical, dental, and vision benefits
+1
Strategy & Operations, Infrastructure
Strategy & Operations, Infrastructure

Stripe, Inc. • United States

Hybrid
USD 192,000 - 287,000
Equity
401(k)
Medical benefits
+1
AI Engineer
AI Engineer

Stripe, Inc. • New York (NY)

On-site
USD 157,000 - 235,000
Equity
401(k) plan
Medical, dental, and vision benefits
+1