ML and AI Knowledge Systems Engineer

Advanced Micro Devices, Inc.; San Jose (CA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

AMD in San Jose is seeking a hands-on ML engineer to lead GoldenEye's retrieval, ranking, and answer-quality architecture, turning a prototype into a production platform.

You will mentor engineers, define sources and policies, and collaborate with hardware, software, and platform teams to deliver fast, reliable, citation‑driven knowledge access for thousands of engineers.

Qualifications

• Deep relevant experience building production ML, search, ranking, or information-retrieval systems.
• Hands-on experience with RAG, embeddings, vector and keyword search, reranking, chunking, and retrieval evaluation.
• Practical experience with LLM prompting, structured generation, tool calling, evaluation, and hallucination reduction.

Responsibilities

• Own the architecture for embeddings, chunking, hybrid retrieval, reranking, multi‑query planning, and reciprocal‑rank fusion.
• Build retrieval workflows across specifications, RTL, verification artifacts, wikis, and issue trackers.
• Improve search for domain‑specific content such as ISA mnemonics, registers, signal names, acronyms, and code identifiers.
• Reduce hallucinations through grounded generation, citation enforcement, source validation, and conflict resolution.
• Define source‑authority and freshness policies for conflicting or outdated information.
• Build an evaluation framework for retrieval relevance, answer correctness, citation faithfulness, latency, cost, and regressions.
• Use expert feedback, production data, hard negatives, and targeted failure cases to create representative evaluation datasets.
• Track advances in retrieval, RAG, agentic systems, evaluation, and efficient inference, and evaluate promising techniques against production requirements.
• Optimize embedding, reranking, and inference workloads on AMD Instinct GPUs, including multi‑GPU and multi‑node serving.
• Partner with platform teams on scalable services, indexing, data reconciliation, observability, and cluster orchestration.
• Advance Model Context Protocol (MCP) tools used by coding agents.
• Ensure retrieval, caching, and answer generation respect per‑user access controls.
• Mentor engineers, review designs, and communicate technical decisions across organizations.

Skills

Production ML systems

Search & Retrieval

RAG & embeddings

LLM prompting

Distributed systems

GPU optimization

Education

Master's or PhD in ML/IR/CS/EE

Tools

vLLM

Vector databases

AMD Instinct GPUs

Distributed computing

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology has the power to solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you're designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger – technology that moves the world forward. Join us and, together, we'll advance your career.

The ROLE:

We are building GoldenEye, an internal AI knowledge platform that lets engineers ask natural-language questions across GPU design knowledge, including RTL, microarchitecture specifications, verification collateral, Confluence, and JIRA, and receive trustworthy answers with citations.

A prototype is already used by hardware and software teams. We are now scaling it to thousands of users, with the potential to serve more than 40,000 engineers worldwide.

We are seeking a hands‑on PMTS‑level ML engineer to lead GoldenEye's retrieval, ranking, and answer-quality architecture. You will turn a promising prototype into an authoritative production platform while setting technical direction, mentoring engineers, and partnering with hardware, software, infrastructure, and security teams.

GoldenEye will make critical engineering knowledge easier to find, verify, and use, accelerating GPU design, verification, debugging, and bring‑up. You will serve as the technical anchor for its ML core and shape its adoption across the engineering organization.

KEY RESPONSIBILITIES:

• Own the architecture for embeddings, chunking, hybrid retrieval, reranking, multi‑query planning, and reciprocal‑rank fusion.


• Build retrieval workflows across specifications, RTL, verification artifacts, wikis, and issue trackers.


• Improve search for domain‑specific content such as ISA mnemonics, registers, signal names, acronyms, and code identifiers.


• Reduce hallucinations through grounded generation, citation enforcement, source validation, and conflict resolution.


• Define source‑authority and freshness policies for conflicting or outdated information.


• Build an evaluation framework for retrieval relevance, answer correctness, citation faithfulness, latency, cost, and regressions.


• Use expert feedback, production data, hard negatives, and targeted failure cases to create representative evaluation datasets.


• Track advances in retrieval, RAG, agentic systems, evaluation, and efficient inference, and evaluate promising techniques against production requirements.


• Optimize embedding, reranking, and inference workloads on AMD Instinct GPUs, including multi‑GPU and multi‑node serving.


• Partner with platform teams on scalable services, indexing, data reconciliation, observability, and cluster orchestration.


• Advance Model Context Protocol (MCP) tools used by coding agents.


• Ensure retrieval, caching, and answer generation respect per‑user access controls.


• Mentor engineers, review designs, and communicate technical decisions across organizations.

PREFERRED EXPERIENCE:

• Deep relevant experience building production ML, search, ranking, or information‑retrieval systems.


• Hands‑on experience with RAG, embeddings, vector and keyword search, reranking, chunking, and retrieval evaluation.


• Practical experience with LLM prompting, structured generation, tool calling, evaluation, and hallucination reduction.


• Experience designing ML evaluation datasets, metrics, experiments, and regression tests.


• Demonstrated ability to translate current ML or information‑retrieval research into rigorous experiments and production improvements.


• Strong software and systems engineering skills, including APIs, asynchronous processing, observability, and production operations.


• Experience leading architecture, mentoring engineers, and influencing senior technical stakeholders.


• Experience with distributed inference systems such as vLLM and GPU performance optimization.


• Experience with AMD Instinct GPUs or comparable accelerators.


• Experience with vector databases, hybrid search, distributed indexing, or authorization‑aware retrieval.


• Familiarity with MCP, coding agents, or tool‑based agent architectures.


• Experience with hardware design, EDA, RTL, microarchitecture, firmware, compilers, or chip verification.


• Technical thought leadership demonstrated through publications, patents, open‑source contributions, conference participation, or influential production systems. Publications are valued but not required.

PREFERRED ACADEMIC CREDENTIALS:

• Master's or Doctoral degree in machine learning, information retrieval, NLP, computer science, electrical or computer engineering, or a related field.

Location: San Jose, CA

#LI-G11

#LI-HYBRID

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's \"Responsible AI Policy\" is available here.

This posting is for an existing vacancy.