Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor; San Jose (CA); On-site; USD 219,000 - 351,000; Full time

Benefits offered by this job

Medical/Dental/Vision benefits

Flexible work environment

401(k)

Paid time off

Charitable giving match

Job summary

Samsung Semiconductor is looking for a Principal Engineer, AI System Architect for our San Jose office. The candidate will lead a team focusing on innovative AI architectures aimed at tackling system-level bottlenecks. This role requires extensive experience in system architecture, particularly with AI workloads, and offers a competitive pay range.

Join a forward-thinking team dedicated to redefining next-generation AI systems while benefiting from a diverse package of wellbeing and incentive programs.

Qualifications

• Ph.D. preferred with 15+ years in system architecture for large-scale computing platforms focusing on AI.
• Hands-on experience with analytical and event-driven simulation models.
• Deep understanding of AI system hardware architectures.

Responsibilities

• Lead the architecture team in system-architecture strategy.
• Conduct architectural research across AI systems.
• Develop frameworks for performance evaluation of AI workloads.

Skills

Analytical and simulation modeling

AI workloads knowledge

Python

C++

PyTorch

Communication skills

Problem-solving mindset

Education

Ph.D. in Computer Science or Electrical Engineering

Job description

Principal Engineer, AI System Architect (Hardware)

Location: Daily onsite presence at our San Jose office in alignment with our Flexible Work policy.

Job ID: 42852

What You’ll Do

The Architecture Research Lab (ARL) focuses on addressing fundamental system‑level bottlenecks in modern AI, particularly in memory capacity/bandwidth and system‑scale communication. Leveraging Samsung’s world‑class memory technologies, ARL explores and defines next‑generation AI system architectures that deliver step‑function improvements in performance, efficiency, and scalability.

We are seeking a Principal AI System Architect who will play a Technical Lead role in bridging AI workloads, system architecture, and hardware design. In this role, you will develop system‑level performance models, drive architecture‑level design decisions, and propose forward‑looking AI system architectures that shape Samsung’s long‑term AI platform strategy.

• Technically lead the architecture team with strong direction, shaping system‑architecture strategy and advancing key innovations.
• Conduct system‑level architectural research for next‑generation AI systems, spanning compute, memory, and interconnect/network subsystems.
• Develop and maintain analytical and simulation‑based system modeling frameworks to evaluate AI workloads and identify performance, scalability, and efficiency bottlenecks at rack‑ and system‑scale.
• Analyze representative and emerging AI workloads (e.g., LLMs, DLRMs, and future AI models) to derive architecture requirements and trade‑offs across compute, memory, networking, and power.
• Drive architecture‑level design decisions through quantitative modeling, design‑space exploration, and performance/power projections.
• Perform comparative studies of alternative system architectures, reporting performance and performance‑per‑watt metrics to guide strategic technology choices.
• Collaborate closely with cross‑functional teams in hardware architecture, memory, interconnect, and system engineering to align modeling insights with implementation realities.
• Communicate architectural insights and recommendations through clear technical presentations and documentation.
• Occasional domestic and international travel.

What You Bring

• Ph.D. in Computer Science, Electrical Engineering, or a related field is preferred, with 15+ years of experience in system architecture for large‑scale computing platforms, with a strong focus on AI workloads.
• Proven hands‑on experience developing analytical and event‑driven simulation models for system‑level performance evaluation.
• Deep understanding of AI system hardware architectures, including compute, memory hierarchies, and high‑performance interconnects.
• Strong knowledge of modern and emerging AI workloads, including LLMs, DLRMs, and large‑scale training and inference systems.
• Demonstrated ability to translate workload characteristics and modeling results into actionable architectural design decisions.
• Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation.
• Excellent written, verbal, and presentation communication skills, with the ability to influence technical direction across teams.
• A collaborative mindset, intellectual curiosity, and resilience in tackling complex, open‑ended system‑level challenges.
• Inclusive, adaptable to diverse global norms and situations.
• Approaches challenges with curiosity and resilience, seeking data to build understanding.
• Builds relationships, offers support humbly, and welcomes diverse approaches.
• Innovative and creative, proactively exploring new ideas and adapting quickly to change.

What We Offer

The pay range below is for all roles at this level across all US locations and functions. Pay within this range varies by work location and may also depend on job‑related knowledge, skills, and experience. We also offer incentive opportunities that reward employees based on individual and company performance.

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones, including Medical/Dental/Vision/401(k). Our inclusive rewards plan empowers our people to care for their whole selves, and we invest in your future as an investment in ours.

Benefits include charitable giving match, paid time off, holidays, sick leave, fertility or adoption stipends, medical travel support, virtual veterinary care, on‑demand wellness apps, confidential therapy sessions, on‑site café and gym, virtual fitness classes, and a flexible environment to balance work and life.

Base Pay Range: $219,000—$351,000 USD

Equal Opportunity Employment Policy

Samsung Semiconductor is an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. All candidates are encouraged to request accommodations for disabilities, long‑term conditions, neurodivergent individuals, or pregnancy‑related support.

Commitment to Innovation and Fairness

We use Artificial Intelligence tools in the recruitment process to enhance efficiency. However, AI is used as a support tool, not a final decision‑maker. All hiring decisions are made by our human recruiting team and hiring managers to ensure fairness and holistic evaluation.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor are permitted to submit resumes for any job openings.

Applicant AI Use Policy

We prohibit the use of generative AI tools to misrepresent a candidate’s true skills and qualifications. Permitted uses are limited to basic preparation, grammar, and research. Violation may result in immediate disqualification from the hiring process.

Trade Secret Notice

By submitting an application, you agree not to disclose to Samsung—or encourage Samsung to use—any confidential or proprietary information (including trade secrets) belonging to a current or former employer or other entity.

Applicant Privacy Policy

https://semiconductor.samsung.com/about-us/careers/us/privacy/