Principal ML Inference Engineer: Scale, Strategy & Impact

Snap

New York (NY)

On-site

USD 276,000 - 414,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity in RSUs

Job summary

Snap Inc. is seeking a Principal Software Engineer for the ML Inference team in NYC. This role leads technical strategy, architects high‑scale inference services, and drives scalable deployments across product lines.

You will collaborate with multiple teams to translate complex requirements into robust systems, promote reliability and cost efficiency, and mentor engineers while shaping the company’s ML platform direction.

Qualifications

  • Bachelor's degree or higher in a technical field with substantial software development experience.
  • 10+ years in software development; leadership or domain expert experience is required.
  • Experience architecting large scale distributed systems and RPC services.

Responsibilities

  • Oversee technical strategy and architecture in ML Inference Platform services.
  • Design, implement, and scale core components for ML inference and deployment.
  • Collaborate across teams to translate requirements into scalable solutions.
  • Advise on availability, scalability, and cost management.
  • Provide technical direction influencing the company.

Skills

Software design
Debugging
Performance analysis
High availability
Mentorship
Collaboration

Education

Bachelor's in CS
Master's/PhD (optional)

Tools

TensorFlow
PyTorch
Kubernetes
GPU
LLM inference

Job description

Snap Inc. is seeking a Principal Software Engineer for the ML Inference team in NYC. This role leads technical strategy, architects high‑scale inference services, and drives scalable deployments across product lines.

You will collaborate with multiple teams to translate complex requirements into robust systems, promote reliability and cost efficiency, and mentor engineers while shaping the company’s ML platform direction.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior ML Engineer: End-to-End ML Lifecycle & Scale
Senior ML Engineer: End-to-End ML Lifecycle & Scale

Snap • New York (NY)

On-site
USD 173,000 - 259,000
Paid parental leave
Comprehensive medical coverage
Emotional and mental health support programs
ML Infrastructure Engineer — Scale Fast AI Platforms
ML Infrastructure Engineer — Scale Fast AI Platforms

Snap Inc. • Palo Alto (CA)

On-site
USD 133,000 - 235,000
Paid parental leave
Comprehensive medical coverage
Mental health support programs
+1
ML Platform Infra Engineer for Scalable AI Serving
ML Platform Infra Engineer for Scalable AI Serving

Snap Inc. • Los Angeles (CA)

On-site
USD 157,000 - 235,000
Paid parental leave
Comprehensive medical coverage
Mental health support programs
+1
ML Infrastructure Engineer, Content Retrieval Platform
ML Infrastructure Engineer, Content Retrieval Platform

Socket.dev • Palo Alto (CA)

On-site
USD 133,000 - 235,000
Paid parental leave
Comprehensive medical coverage
Mental health support
Senior ML Engineer — Scalable ML in Production
Senior ML Engineer — Scalable ML in Production

Snap Inc. • New York (NY)

On-site
USD 173,000 - 259,000
Equity (RSUs)
Comprehensive medical coverage
Paid parental leave
Senior ML Engineer Level 4 - Equity RSUs
Senior ML Engineer Level 4 - Equity RSUs

Snap Inc. • Palo Alto (CA)

On-site
USD 173,000 - 259,000
Paid parental leave
Comprehensive medical coverage
Emotional and mental health support
+1
ML Infra Engineer – Content Retrieval at Scale
ML Infra Engineer – Content Retrieval at Scale

Relha LLC • Palo Alto (CA), Northern (KY)

Hybrid
USD 157,000 - 235,000
Paid parental leave
Comprehensive medical coverage
Emotional and mental health support
+1
Senior Data Scientist - ML & Product Insights
Senior Data Scientist - ML & Product Insights

Relha LLC • Los Angeles (CA), Northern (KY)

Hybrid
USD 190,000 - 284,000
RSU equity
Equal Opportunity Employer
Lead ML Platform Engineer: Training & Inference at Scale
Lead ML Platform Engineer: Training & Inference at Scale

Paramount • Burbank (CA)

On-site
USD 157,000 - 235,000
Benefits package
On-site & virtual events
Generous PTO
Senior ML Engineer: Scale Real-Time ML Infra & Data
Senior ML Engineer: Scale Real-Time ML Infra & Data

Ultra • New York (NY)

Hybrid
USD 180,000 - 240,000