ML and AI Knowledge Systems Engineer

Socket.dev; San Jose (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

AMD in San Jose, CA is hiring a hands-on ML engineer to lead GoldenEye’s retrieval, ranking, and answer-quality architecture. You will scale a prototype into a production platform, setting technical direction and mentoring engineers across hardware, software, and security teams.

You will own embeddings, retrieval pipelines, and evaluation frameworks, driving improvements in accuracy, latency, and cost while aligning with per-user access controls and governance.

Qualifications

• Production ML, search, ranking, or information-retrieval systems.
• Hands-on with RAG, embeddings, vector and keyword search, reranking, chunking, and evaluation.
• Practical experience with LLM prompting, structured generation, tool calling, evaluation, and reducing hallucinations.
• Experience designing ML evaluation datasets, metrics, experiments, and regression tests.
• Ability to translate ML research into rigorous experiments and production improvements.
• Strong software and systems engineering skills, APIs, asynchronous processing, observability, and production operations.
• Leadership experience mentoring engineers and influencing senior stakeholders.
• Experience with distributed inference systems and GPU performance optimization.
• Experience with AMD Instinct GPUs or comparable accelerators.
• Familiarity with vector databases, hybrid search, and authorization-aware retrieval.
• Familiarity with MCP, coding agents, or tool-based agent architectures.
• Background in hardware design, EDA, RTL, microarchitecture, firmware, compilers, or chip verification.
• Publications or patents are valued but not required.

Responsibilities

• Own architecture for embeddings, chunking, hybrid retrieval, and reranking.
• Build retrieval workflows across specs, RTL, verification assets, wikis, and trackers.
• Improve search for domain-specific content and code identifiers.
• Reduce hallucinations via grounded generation and source validation.
• Define source-authority and freshness policies for info.
• Create evaluation frameworks for retrieval relevance and answer quality.
• Leverage feedback and production data to improve models and systems.
• Collaborate with platform teams on scalable services and observability.

Skills

Production ML

Information retrieval

Search ranking

RAG

Embeddings

Chunking

Retrieval evaluation

LLM prompting

Tool calling

Observability

Distributed inference

GPU optimization

Vector databases

Education

Master’s or Doctoral in ML/IR/CS/EE

Tools

vLLM

Vector databases

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

The ROLE:

We are building GoldenEye, an internal AI knowledge platform that lets engineers ask natural-language questions across GPU design knowledge, including RTL, microarchitecture specifications, verification collateral, Confluence, and JIRA, and receive trustworthy answers with citations.

A prototype is already used by hardware and software teams. We are now scaling it to thousands of users, with the potential to serve more than 40,000 engineers worldwide.

We are seeking a hands-on PMTS-level ML engineer to lead GoldenEye’s retrieval, ranking, and answer-quality architecture. You will turn a promising prototype into an authoritative production platform while setting technical direction, mentoring engineers, and partnering with hardware, software, infrastructure, and security teams.

GoldenEye will make critical engineering knowledge easier to find, verify, and use, accelerating GPU design, verification, debugging, and bring-up. You will serve as the technical anchor for its ML core and shape its adoption across the engineering organization.

KEY RESPONSIBILITIES:

• Own the architecture for embeddings, chunking, hybrid retrieval, reranking, multi-query planning, and reciprocal-rank fusion.
• Build retrieval workflows across specifications, RTL, verification artifacts, wikis, and issue trackers.
• Improve search for domain-specific content such as ISA mnemonics, registers, signal names, acronyms, and code identifiers.
• Reduce hallucinations through grounded generation, citation enforcement, source validation, and conflict resolution.
• Define source-authority and freshness policies for conflicting or outdated information.
• Build an evaluation framework for retrieval relevance, answer correctness, citation faithfulness, latency, cost, and regressions.
• Use expert feedback, production data, hard negatives, and targeted failure cases to create representative evaluation datasets.
• Track advances in retrieval, RAG, agentic systems, evaluation, and efficient inference, and evaluate promising techniques against production requirements.
• Optimize embedding, reranking, and inference workloads on AMD Instinct GPUs, including multi-GPU and multi-node serving.
• Partner with platform teams on scalable services, indexing, data reconciliation, observability, and cluster orchestration.
• Advance Model Context Protocol (MCP) tools used by coding agents.
• Ensure retrieval, caching, and answer generation respect per-user access controls.
• Mentor engineers, review designs, and communicate technical decisions across organizations.

PREFERRED EXPERIENCE:

• Deep relevant experience building production ML, search, ranking, or information-retrieval systems.
• Hands-on experience with RAG, embeddings, vector and keyword search, reranking, chunking, and retrieval evaluation.
• Practical experience with LLM prompting, structured generation, tool calling, evaluation, and hallucination reduction.
• Experience designing ML evaluation datasets, metrics, experiments, and regression tests.
• Demonstrated ability to translate current ML or information-retrieval research into rigorous experiments and production improvements.
• Strong software and systems engineering skills, including APIs, asynchronous processing, observability, and production operations.
• Experience leading architecture, mentoring engineers, and influencing senior technical stakeholders.
• Experience with distributed inference systems such as vLLM and GPU performance optimization.
• Experience with AMD Instinct GPUs or comparable accelerators.
• Experience with vector databases, hybrid search, distributed indexing, or authorization-aware retrieval.
• Familiarity with MCP, coding agents, or tool-based agent architectures.
• Experience with hardware design, EDA, RTL, microarchitecture, firmware, compilers, or chip verification.
• Technical thought leadership demonstrated through publications, patents, open-source contributions, conference participation, or influential production systems. Publications are valued but not required.

PREFERRED ACADEMIC CREDENTIALS:

• Master’s or Doctoral degree in machine learning, information retrieval, NLP, computer science, electrical or computer engineering, or a related field.

Location:

San Jose, CA

#LI-G11

#LI-HYBRID

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.