Senior Staff Software Engineer, Serving

United States Digital Space LLC

United States

Remote

USD 219,000 - 266,000

Full time

4 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

United States Digital Space LLC is seeking a senior software engineer to join the Accelerate Serving team. You will design, build, and operate high-throughput, low-latency services that handle real-time ad bids and respond to exchanges.

You will optimize GPU-powered inference, profile pipelines, and own changes end-to-end from design to deployment, collaborating with ML engineers to productionize models. This is a remote-friendly role requiring 10+ years in industry and an MS in CS (Go a plus).

Qualifications

  • Strong core Computer Science fundamentals (data structures, algorithms, system architecture).
  • 10+ years of industry experience.
  • MS or higher in Computer Science (or equivalent work experience).
  • Experience with Go is a plus.

Responsibilities

  • Design, build, and operate the high-throughput, low-latency services that receive bid requests, execute bidding logic, and respond to ad exchanges in real time.
  • Improve the performance, scalability, and reliability of systems processing millions of requests per second under strict latency constraints.
  • Develop and optimize GPU-powered inference services that execute neural network models using TensorRT.
  • Profile end-to-end inference pipelines to identify bottlenecks in GPU utilization, memory access, and networking.
  • Partner with ML engineers to productionize new model architectures and features.
  • Design and operate large feature stores for real-time and precomputed features.
  • Develop benchmarking and performance-analysis tools to compare models and detect regressions.
  • Improve experimentation tooling for offline training runs and model leaderboards.
  • Own changes through full lifecycle—from design to testing, deployment, observability, and optimization.

Skills

Go programming
Computer Science fundamentals

Education

MS in Computer Science or equivalent

Job description

the company is a leading AI-powered performance marketing platform for the mobile app economy. Our end-to-end technology stack helps app marketers acquire and retain high-value users, while enabling publishers to maximize revenue across programmatic and direct demand.

the company’s solutions, including Accelerate, Direct, Monetize, Intelligence, and Vungle Exchange, support over 6,600 mobile businesses across 74 countries in sectors such as gaming, social, finance, ecommerce, and entertainment. Founded in 2012 and headquartered in Redwood City, CA, the company has a diverse, global presence.

At the company, we’re solving one of the core problems faced by every mobile app: growth. To do so, we build Machine Learning and Big Data-driven technology that can accurately predict which apps a user will like, and connect them in a compelling way. Our systems operate at a scale unseen outside of the largest Internet companies -- processing over 12 million requests per second and interacting with over 5 billion unique users each day.

The Serving team builds and maintains the mission-critical infrastructure responsible for serving ads across the company’s product line.

As an engineer on the company’s Accelerate Serving team, you will:

  • Design, build, and operate the high-throughput, low-latency services that receive bid requests, execute the company’s bidding logic, and respond to ad exchanges in real time.
  • Improve the performance, scalability, and reliability of systems that process millions of requests per second under strict latency constraints.
  • Develop and optimize GPU-powered inference services that execute neural network models using TensorRT.
  • Profile end-to-end inference pipelines to identify and eliminate bottlenecks in GPU utilization, batching, memory access, serialization, networking, and request handling.
  • Partner with machine learning engineers to productionize new model architectures and features, translating modeling requirements into efficient and reliable serving implementations.
  • Design and operate large feature store fleets that provide low-latency access to real-time and precomputed features.
  • Develop benchmarking and performance-analysis tools that help engineers compare models, understand latency and throughput trade-offs, and identify regressions before deployment.
  • Improve experimentation tooling that allows machine learning teams to orchestrate offline training runs, evaluate candidate models, and maintain model leaderboards.
  • Own changes through their full lifecycle—from system design and implementation to testing, deployment, observability, capacity planning, incident response, and continued optimization.
Requirements
  • Strong core Computer Science fundamentals (data structures, algorithms, system architecture)
  • 10+ years of industry experience
  • M.S.. or higher in Computer Science (or equivalent work experience)
  • Experience with Go is a plus
Location

This role is eligible for full-time remote work in one of our entities: CA, CO, ID, IL, FL, GA, MA, MI, MN, MO, NJ, NV, NY, OR, PA, TX, UT, and WA

We are a remote-first company with US hubs in Redwood City, Los Angeles, and New York City.

Travel Expectations:We offer several opportunities for in-person team gatherings, including but not limited to project meetings, regional meetups, and company-wide events. We expect our employees to attend these gatherings at least once per quarter. These gatherings provide essential opportunities for collaboration, communication, and team building.

Compensation:the company offers all employees a full compensation package that includes equity and health/vision/dental benefits associated with your country of residence. Base compensation will vary based on the candidate's location and experience.

The following are our base salary ranges for this role:

  • SF Bay Area, NYC, Los Angeles/Orange County: $255,000 - $310,000
  • Seattle/Olympia, Austin, San Diego, Santa Barbara, Boston: $234,000 - $285,000
  • All other cities and towns in our approved states: $219,000 - $266,000

the company offers a fast-paced, collaborative, and innovative work environment where employees are empowered to grow and make an impact. We’re shaping the future of the mobile app ecosystem—join us and help accelerate what’s next.

the company’s compensation strategy includes competitive salaries, equity, and benefits designed to support employee well-being and performance. We benchmark compensation based on role, level, and location to ensure fairness and market alignment. Benefits may include medical coverage, wellness stipends, and additional perks based on your country of residence.

the company is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and applicants regardless of race, ethnicity, national origin, age, marital status, disability, sexual orientation, gender identity, religion, veteran status, or any other characteristic protected by applicable law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Partner Engineering
Software Engineer, Partner Engineering

United States Digital Space LLC • United States

Remote
USD 140,000 - 200,000
Senior Staff Software Engineer, Serving
Senior Staff Software Engineer, Serving

Bazeta • Northern (KY)

Hybrid
USD 219,000 - 266,000
Senior Staff Product Manager, eCommerce
Senior Staff Product Manager, eCommerce

United States Digital Space LLC • United States

Remote
USD 198,000 - 280,000
Equity compensation
Health/vision/dental benefits
Remote-friendly
Staff / Principal Machine Learning Engineer, Serving - USA
Staff / Principal Machine Learning Engineer, Serving - USA

Inworld • Mountain View (CA)

On-site
USD 270,000 - 500,000
Relocation assistance
Equity options
Comprehensive benefits
Growth Platform, Marketing Engineer
Growth Platform, Marketing Engineer

United States Digital Space LLC • Carlsbad (CA)

On-site
USD 176,000 - 242,000
Equity
Benefits
Staff / Principal Machine Learning Engineer, Serving
Staff / Principal Machine Learning Engineer, Serving

Inworld AI • Mountain View (CA)

On-site
USD 270,000 - 500,000
Relocation assistance
Equity options
Comprehensive benefits package
Sr Software Development Engineer, Ads Nova
Sr Software Development Engineer, Ads Nova

Amazon • New York (NY)

On-site
USD 185,000 - 250,000
Health insurance
401(k) matching
Paid time off
+1
Solutions Engineer, Ads Solutions - San Francisco
Solutions Engineer, Ads Solutions - San Francisco

OpenAI • San Francisco (CA)

On-site
USD 234,000 - 260,000
Medical, dental, vision insurance
401(k) with match
Paid parental leave
+4
Director - Product Management
Director - Product Management

InMobi • San Mateo (CA)

On-site
USD 218,365 - 311,950
High-quality medical, dental, and vision insurance
401(k) company match
Generous vacation and leave policies
+2
Sr Software Development Engineer, Ads Nova
Sr Software Development Engineer, Ads Nova

Amazon • Seattle (WA)

On-site
USD 168,000 - 262,000
Health insurance
401(k) matching
Paid time off
+2