Senior Staff AI/ML Engineer — scalable AI & systems

Socket.dev; San Jose (CA); On-site; USD 163,000 - 253,000; Full time

Benefits offered by this job

Charitable giving match

4+ weeks paid time off

Fertility/adoption stipend

Medical travel support

Virtual vet care

Job summary

Samsung Semiconductor seeks a Senior Staff Engineer to build and optimize EDA design environments and large-scale compute infrastructure, establishing company-wide standards for EDA licensing and R&D software. You will design shared design environments across multiple teams to boost productivity and reduce costs.

The Applied AI Engineering team accelerates AI adoption across the organization, enabling frontier models to plan, retrieve, coordinate with tools, and execute multi-step workflows

Qualifications

• 10+ years BS, 8+ years MS, or 5+ years PhD in CS/EE or related field.
• Experience deploying LLM- or vision-powered systems in production with evaluation, A/B testing, and safe rollout practices.
• Hands-on with agentic AI frameworks (LangGraph, CrewAI, ADK) — orchestration and tooling.
• Experience with LLM inference optimization and serving (e.g., vLLM, TensorRT-LLM).
• Strong Python and C/C++ skills with PyTorch/TensorFlow and large-scale distributed systems experience.

Responsibilities

• Design, build, and productize agentic AI applications combining vision and language models end-to-end.
• Architect multi-agent systems with frameworks for orchestration, routing, memory, and human-in-the-loop workflows.
• Establish evaluation frameworks, metrics, benchmarks, and instrument trajectories for offline/online evaluation.
• Drive cost, performance, and latency trade-offs with model and deployment decisions.
• Optimize inference on accelerated hardware with quantization, batching, caching, and kernel-level tuning.
• Address memory bottlenecks and multi-discipline AI acceleration problems across teams.
• Collaborate with researchers and developers to deploy cutting-edge ML workloads.

Skills

Python

C/C++

LLM/ML frameworks

Multi-agent systems

PyTorch/TensorFlow

Education

BS in CS/EE

MS in CS/EE

PhD in related field

Tools

LangGraph

CrewAI

ADK

vLLM

TensorRT-LLM

PyTorch

TensorFlow

Job description

Samsung Semiconductor seeks a Senior Staff Engineer to build and optimize EDA design environments and large-scale compute infrastructure, establishing company-wide standards for EDA licensing and R&D software. You will design shared design environments across multiple teams to boost productivity and reduce costs.

The Applied AI Engineering team accelerates AI adoption across the organization, enabling frontier models to plan, retrieve, coordinate with tools, and execute multi-step workflows