Staff Engineer, AI System Architect (Hardware)

Samsungsemiconductor; San Jose (CA); On-site; USD 163,000 - 253,000; Full time

Job summary

Samsung Semiconductor is seeking a Ph.D. level candidate in Computer Science or Electrical Engineering with 5+ years' experience in system architecture for AI workloads. The candidate will conduct architectural research, develop simulation models, and analyze AI workloads to derive essential architecture requirements. The role involves daily onsite presence in San Jose, California, and requires strong knowledge of Python, C++, and PyTorch.

Salary range is $163,000—$253,000 USD. A commitment to fostering an inclusive environment is also highlighted in our Equal Opportunity Employment Policy.

Qualifications

• 5+ years of experience in system architecture for large-scale computing platforms focusing on AI workloads.
• Hands-on experience developing analytical and event-driven simulation models.
• Deep understanding of AI system hardware architectures including compute and memory hierarchies.

Responsibilities

• Conduct system-level architectural research for next-generation AI systems.
• Develop analytical and simulation-based system modeling frameworks.
• Analyze AI workloads to derive architecture requirements.

Skills

System Architecture for AI Workloads

Analytical and Event-Driven Simulation Models

Python

C++

PyTorch

AI Workloads (LLMs and DLRMs)

Communication Skills

Collaboration with Diverse Teams

Education

Ph.D. in Computer Science or Electrical Engineering

Job description

Location: Daily onsite presence at our San Jose office in alignment with our Flexible Work policy.

What You’ll Do

• Conduct system-level architectural research for next-generation AI systems, spanning compute, memory, and interconnect/network subsystems.
• Develop and maintain analytical and simulation-based system modeling frameworks to evaluate AI workloads and identify performance, scalability, and efficiency bottlenecks at rack- and system-scale.
• Analyze representative and emerging AI workloads (e.g., LLMs, DLRMs, and future AI models) to derive architecture requirements and trade-offs across compute, memory, networking, and power.
• Drive architecture-level design decisions through quantitative modeling, design-space exploration, and performance/power projections.
• Perform comparative studies of alternative system architectures, reporting performance and performance-per-watt metrics to guide strategic technology choices.
• Collaborate closely with cross-functional teams in hardware architecture, memory, interconnect, and system engineering to align modeling insights with implementation realities.
• Communicate architectural insights and recommendations through clear technical presentations and documentation.
• Occasional domestic and international travel (<10%).

What You Bring

• Ph.D. in Computer Science, Electrical Engineering, or a related field, with 5+ years of experience in system architecture for large-scale computing platforms, focusing on AI workloads.
• Proven hands‑on experience developing analytical and event‑driven simulation models for system-level performance evaluation.
• Deep understanding of AI system hardware architectures, including compute, memory hierarchies, and high-performance interconnects.
• Strong knowledge of modern and emerging AI workloads, including LLMs, DLRMs, and large-scale training and inference systems.
• Demonstrated ability to translate workload characteristics and modeling results into actionable architectural design decisions.
• Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation.
• Excellent written, verbal, and presentation communication skills, with the ability to influence technical direction across teams.
• Inclusive mindset, collaborating with diverse teams and adapting communication style to varied audiences.
• Curious and resilient approach to tackling complex, open-ended system-level challenges.
• Open and welcoming collaborative attitude toward building relationships and supporting others.

Base Pay Range: $163,000—$253,000 USD

Equal Opportunity Employment Policy Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.