AI Infrastructure Engineer — On-Prem & Agentic Systems

SK hynix memory solutions America Inc.; San Jose (CA); On-site; USD 140,000 - 165,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) match

Cafeteria and onsite gym

Job summary

SK hynix memory solutions America Inc. in San Jose is seeking a Sr. Staff AI Engineer to lead the design and management of on-prem AI infrastructure. This role involves building agentic AI systems to drive automation in enterprise settings, ensuring scalable environments that meet business demands.

Ideal candidates will have significant experience in AI/ML engineering and a track record of deploying impactful AI systems. The role complements innovative work in a collaborative environment with a competitive compensation package including benefits and 401(k).

Qualifications

• 2+ years of experience in AI/ML engineering, especially deployment on-prem or private cloud.
• Experience building agentic AI systems with state management and multi-step reasoning.
• Knowledge of RAG architectures and model fine-tuning techniques.

Responsibilities

• Design and deploy on-prem AI infrastructure including GPU clusters and orchestration.
• Develop and optimize RAG pipelines and build agentic AI systems.
• Collaborate with product teams to integrate AI capabilities into workflows.

Skills

Python

Model Control Protocols

Docker/Kubernetes

AI Serving Frameworks

RAG Architectures

Education

Bachelor of Science in CS, EE, ME, or applicable Engineering field

Tools

Linux

Vector databases (e.g., Milvus, Qdrant)

Job description

SK hynix memory solutions America Inc. in San Jose is seeking a Sr. Staff AI Engineer to lead the design and management of on-prem AI infrastructure. This role involves building agentic AI systems to drive automation in enterprise settings, ensuring scalable environments that meet business demands.

Ideal candidates will have significant experience in AI/ML engineering and a track record of deploying impactful AI systems. The role complements innovative work in a collaborative environment with a competitive compensation package including benefits and 401(k).