Senior AI Performance Engineer: LLM Systems & HPC

Samsung Semiconductor Inc.; San Jose (CA); On-site; USD 138,000 - 206,000; Full time

Job summary

Samsung Semiconductor Inc. is seeking a Senior LLM Systems Performance Engineer in San Jose, CA. This role involves building AI environments, analyzing system bottlenecks, and supporting co-design decisions for advanced AI platforms.

Ideal candidates will have an MS or PhD in a relevant field and over 5 years of experience in performance engineering. The role requires strong analytical skills and hands-on experience with NVIDIA GPUs and AI workloads.

The position offers a competitive salary range of $138,000 – $206,000 USD and aligns with a flexible work policy.

Qualifications

• 5+ years of experience in performance engineering, AI systems, or high-performance computing.
• Strong understanding of LLM inference and training systems.
• Experience with large-scale distributed AI workloads.

Responsibilities

• Build and operate representative AI environments.
• Collect workload traces and performance data from real-world AI applications.
• Analyze runtime and memory impact on application performance.
• Collaborate with teams to drive performance analysis for AI platforms.

Skills

Performance engineering

AI systems

Distributed systems

High-performance computing

Python

C++

Education

MS or PhD in Computer Science, Computer Engineering or Electrical Engineering

Tools

NVIDIA GPU architecture

Nsight Systems

Nsight Compute

PyTorch

vLLM

TensorRT-LLM

Job description

Samsung Semiconductor Inc. is seeking a Senior LLM Systems Performance Engineer in San Jose, CA. This role involves building AI environments, analyzing system bottlenecks, and supporting co-design decisions for advanced AI platforms.

Ideal candidates will have an MS or PhD in a relevant field and over 5 years of experience in performance engineering. The role requires strong analytical skills and hands-on experience with NVIDIA GPUs and AI workloads.

The position offers a competitive salary range of $138,000 – $206,000 USD and aligns with a flexible work policy.