Director of AI Workload Intelligence

SK hynix America; San Jose (CA); On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Top-tier health insurance

Paid time off

401k matching

FSA for Health Care & Dependent Care

Educational reimbursement up to $10,00

Donation matching & volunteering

Free meals

Job summary

SK hynix America seeks a Director of AI Workload Intelligence to lead global AI workloads analysis for HBF applicability and data-placement criteria. You will guide memory system strategies and collaborate with Compiler/Runtime teams from research to productization.

The role requires hands-on experience in AI inference systems, knowledge of Transformers/LLMs, and extensive tooling expertise across PyTorch, Hugging Face, and ONNX Runtime.

Qualifications

• Proven experience leading global AI system architecture initiatives and cross-functional teams.
• Hands-on experience in AI inference systems, ML systems, LLM serving, or heterogeneous accelerator software.
• Strong understanding of Transformers, LLMs, MoE, embedding/retrieval workloads, and multimodal inference.
• Experience with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton Inference Server.
• Experience in latency, throughput, memory footprint, and data movement analysis.

Responsibilities

• Lead global collaboration and drive AI workload-based HBF technology development from research to PoC and productization.
• Analyze AI models, algorithms, and workload trends for HBF applicability.
• Classify HBF-relevant memory objects such as weights, KV cache, activations, embeddings, adapters, and MoE experts.
• Define model-level criteria for data placement, caching, prefetching, and offload decisions.
• Analyze HBF integration points in vLLM, SGLang, TensorRT-LLM, PyTorch, and ONNX Runtime.
• Identify HBF-applicable AI model families and inference data objects.
• Develop memory-use taxonomy and HBF applicability criteria.
• Provide model-driven inputs to Compiler/Runtime and AI Inference SW Stack teams.

Skills

AI system architecture

Cross-functional leadership

LLM model analysis

AI inference systems

Transformer knowledge

Tools

PyTorch

Hugging Face

vLLM

SGLang

TensorRT-LLM

ONNX Runtime

Triton Inference Server

Job description

At SK hynix America, we are at the forefront of semiconductor innovation. As a global leader in HBM, DRAM, and NAND flash technologies, we develop the advanced memory solutions powering everything from advanced mobile technology to massive AI data centers. With major investments in the U.S. and a leading position in the global AI revolution, we build the critical infrastructure of the digital landscape and remain committed to sustainable operations.We invite innovative minds to be part of our journey. Here, you will be part of a collaborative team pioneering the next generation of memory technologies, expanding our market footprint, and defining the future of computing.

Work Model: Onsite

Job Title: Director of AI Workload Intelligence
Office Location: San Jose, CA
Job Type: Full-Time
Work Model: Onsite

Job Summary:

Focused on bridging AI intelligence with memory strategy, this Director-level position leads global initiatives to analyze LLM and multimodal workloads for HBF applicability. The leader will define data placement criteria, develop HBF-aware benchmark suites, and guide product strategy by translating model behaviors into concrete memory system values.

Responsibilities:

• Lead global collaboration and drive AI workload-based HBF technology development from research to PoC and productization.
• Analyze AI models, algorithms, and workload trends for HBF applicability.
• Classify HBF-relevant memory objects such as weights, KV cache, activations, embeddings, adapters, and MoE experts.
• Define model-level criteria for data placement, caching, prefetching, and offload decisions.
• Analyze HBF integration points in vLLM, SGLang, TensorRT-LLM, PyTorch, and ONNX Runtime.
• Identify HBF-applicable AI model families and inference data objects.
• Develop memory-use taxonomy and HBF applicability criteria.
• Provide model-driven inputs to Compiler/Runtime and AI Inference SW Stack teams.

Qualifications:

• Proven experience leading global AI system architecture initiatives and cross-functional teams.
• Hands-on experience in AI inference systems, ML systems, LLM serving, AI model analysis, AI framework/runtime analysis, or heterogeneous accelerator software.
• Strong understanding of Transformers, LLMs, MoE, recommendation models, embedding/retrieval workloads, and multimodal inference.
• Experience with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton Inference Server, or equivalent AI inference stacks.
• Experience in latency, throughput, token throughput, memory footprint, bandwidth, and data movement analysis.
• Top Tier health insurance at no employee cost
• Paid day offs: Paid Time Off, Company Holidays, Parental Leave, Happy Fridays
• 401k Matching
• Flexible Spending Account (FSA) for Health Care & Dependent Care
• Educational reimbursement up to $10,000 per year
• Donation Matching and volunteering opportunities
• Free Breakfast/Lunch/Dinner provided to employees

Compensation:

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. Pay within the provided range varies by work location and may also depend on job-related skills and experience. Your Recruiter can share more about the specific salary range for the job location during the hiring process.

Pay Range

$250,000 - $300,000 USD

SK hynix America is an Equal Employment Opportunity Employer. We provide equal employment opportunities to all qualified applicants and employees and prohibit discrimination and harassment of any type without regard to race, sex, pregnancy, sexual orientation, religion, age, gender identity, national origin, color, protected veteran or disability status, genetic information, or any other status protected under federal, state, or local applicable laws.

In compliance with federal law, SK hynix America also participates in the federal E-Verify program. Upon accepting an offer of employment, all newly hired individuals will be required to complete Form I-9, which includes verifying identity and legal authorization to work in the United States. Please review the official government posters detailing your rights and protections prior to applying:

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in SK hynix America’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification of Disability

Form CC-305

Page 1 of 1

OMB Control Number 1250-0005

Expires 07/31/2029

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.