Senior Staff Performance Engineer

samsungsemiconductor

San Jose (CA)

On-site

USD 190,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Samsung Semiconductor seeks a senior performance engineer to build and operate AI environments reflecting production workloads, including MoE deployments and disaggregated inference. You will collect traces, telemetry, and performance data across the software stack to identify bottlenecks and optimize system performance.

You will interpret workload characteristics, collaborate with hardware and software teams, and define benchmarking standards to guide workload characterization and performance

Qualifications

  • 10+ years in performance engineering, AI systems, distributed systems, or HPC.
  • Strong ability to interpret workload traces and telemetry to identify bottlenecks.
  • Knowledge of LLM software stack, including serving, scheduling, KV-cache, kernels, and interconnect.

Responsibilities

  • Build and operate AI environments reflecting production workloads (agentic workflows, distributed inference, MoE deployments).
  • Collect workload traces, runtime telemetry, and performance data across stack.
  • Characterize bottlenecks across environments and platforms (compute, memory, interconnect).
  • Communicate findings to hardware architects, systems engineers, and researchers via reports and reviews.
  • Define performance evaluation methodologies and benchmarking standards for adoption.

Skills

Performance engineering
AI systems
Distributed systems
High-performance computing
Benchmarking
Workload analysis

Education

BS/MS/PhD in CS/CE/EE or related field

Tools

LLM software stack

Job description

Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.

Advancing the World's Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you'll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what's possible and powering the future.

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We're dedicated to empowering people to be their true selves. Together, we're building a better tomorrow for our employees, customers, partners, and communities.

Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.

Advancing the World's Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you'll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what's possible and powering the future.

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We're dedicated to empowering people to be their true selves. Together, we're building a better tomorrow for our employees, customers, partners, and communities.

The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique challenges posed by AI/ML workloads and to explore new computing abstractions that can provide a better balance between the hardware and software components of our systems. Additionally, we continuously conduct research and development in emerging technologies and trends across memory, computing, interconnect, and AI/ML, ensuring that our platforms are always equipped to handle the most demanding workloads of the future. By working together as a dedicated and passionate team, we aim to revolutionize the way AI/ML applications are deployed and executed, ultimately contributing to the advancement of AGI in an affordable and sustainable manner. Join us in our passion to shape the future of computing!

Location: Daily onsite presence at our San Jose, CA office / U.S. headquarters in alignment with our Flexible Work policy.

What You'll Do
  • Build and operate AI environments that reflect production workloads, including agentic workflows, distributed inference, disaggregated serving architectures, and MoE deployments.
  • Collect workload traces, runtime telemetry, and performance data across the software stack from AI applications.
  • Characterize and compare workloads across environments and platforms, identifying compute, memory, communication, and scheduling bottlenecks from applications and frameworks to runtimes, hosts, and devices.
  • Communicate findings to hardware architects, systems engineers, and software researchers through reports, presentations, and architecture reviews.
  • Define performance evaluation methodologies and benchmarking standards for adoption across hardware and software teams, and set the technical direction for workload characterization.
What You Bring
  • BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent industry experience. Required industry experience: 10+ years with a BS, 8+ years with an MS, or 5+ years with a PhD in performance engineering, AI systems, distributed systems, high-performance computing, or a related area. Candidates with additional experience and a record of technical leadership across teams may be considered at the Senior Staff level.
  • Ability to interpret workload traces, runtime telemetry, and performance data to identify bottlenecks and explain their underlying causes, including how workload characteristics interact with specific operations and mechanisms within software and hardware layers.
  • Knowledge of the LLM software stack, including serving and scheduling, attention and KV-cache management, kernel launch and memory-transfer overhead, and collective communication, and how these interact with accelerator compute throughput, memory hierarchy, memory bandwidth, and interconnect topology.
  • Experience characterizing agentic workflows, long-context processing, MoE models, or disaggregated inference deployments.
  • Experience profili
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Technologist - AI Systems & Performance Lab
Sr. Technologist - AI Systems & Performance Lab

SanDisk • California

On-site
USD 180,000 - 260,000
Staff Technologist-AI Architect
Staff Technologist-AI Architect

Dell Technologies • Santa Clara (CA)

On-site
USD 210,000 - 270,000
Staff AI Performance Engineer
Staff AI Performance Engineer

EngineersOfAI • Austin (TX)

On-site
USD 90,000 - 120,000
Intern, AI Systems Performance Engineer
Intern, AI Systems Performance Engineer

samsungsemiconductor • San Jose (CA)

On-site
USD 39,000 - 94,000
Relocation Support
Housing Stipend
Charitable giving match
+3
Sr Staff AI Platform Engineer
Sr Staff AI Platform Engineer

WEX • Maine

On-site
USD 180,000 - 240,000
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Software Engineer, AI Kernels & Performance Optimization — MTIA Software
Software Engineer, AI Kernels & Performance Optimization — MTIA Software

Meta • Bellevue (WA)

On-site
USD 180,000 - 260,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Member of Technical Staff, MLSys
Member of Technical Staff, MLSys

Bake AI Inc. • San Mateo (CA)

On-site
USD 180,000 - 240,000
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)

Veear Projects Inc. • Sunnyvale (CA)

On-site
USD 140,000 - 210,000