Agentic AI Architect

Altera

San Jose (CA)

On-site

USD 149,000 - 238,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Altera is seeking an Agentic AI Architect to lead the design of next-generation agentic AI systems integrated with FPGA/ASIC platforms. This role sits at the intersection of AI, hardware acceleration, and multi-agent orchestration in a high-impact environment.

You will architect end-to-end AI systems, optimize LLM workflows, and collaborate with hardware teams on EDA and system integration to enable scalable AI deployments on heterogeneous compute platforms.

Qualifications

  • Master’s or Bachelor’s degree with 10+ years of experience in AI/ML systems, distributed systems or hardware–software co-design.
  • Deep understanding of LLM architectures, RAG, and agentic AI concepts.
  • Hands-on production experience with LLM applications, orchestration workflows, and heterogeneous hardware (CPU/CPU/FPGA).
  • Familiarity with hardware acceleration for AI workloads and performance optimization across the stack.

Responsibilities

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration.
  • Architect RAG pipelines for enterprise-scale knowledge integration.
  • Define end-to-end AI system architecture from data ingestion to reasoning and action.
  • Develop workflows with tool-using agents, planning and reasoning agents, and multi-agent collaboration frameworks.
  • Evaluate and integrate leading LLMs (open-source and proprietary).
  • Collaborate with hardware teams on FPGA acceleration and EDA/system integration.
  • Build internal platforms using LangChain, LlamaIndex, and a custom agent orchestration framework.
  • Lead architecture reviews and mentor senior engineers.

Skills

AI/ML systems
Distributed systems
Hardware–software co-design
LLMs
Multi-agent orchestration

Education

Master’s or Bachelor’s degree with 10+ years of experience

Tools

Python
C++
APIs & microservices
Cloud/edge AI deployment
LLM inference optimization (FPGA)

Job description

Job Details

We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.

This Role Sits At The Intersection Of
  • Large Language Models (LLMs)
  • Agent frameworks & autonomous systems
  • Retrieval-Augmented Generation (RAG)
  • Hardware-aware AI system design (FPGA / ASIC / EDA)
Key Responsibilities
  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
  • Architect RAG pipelines for enterprise-scale knowledge integration
  • Define end-to-end AI system architecture from data ingestion → reasoning → action
  • Develop advanced workflows using:
    • tool-using agents
    • planning & reasoning agents
    • multi-agent collaboration frameworks
  • Evaluate and integrate leading LLMs (open-source and proprietary)
  • Optimize prompt engineering, memory, and reasoning capabilities
  • Co-design AI systems with:
    • FPGA acceleration
    • ASIC platforms
    • heterogeneous compute (CPU/GPU/FPGA)
  • Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
  • Collaborate with hardware teams on EDA and system integration
  • Build internal platforms using:
    • LangChain
    • LlamaIndex
    • custom agent orchestration framework
  • Develop reusable components for:
    • memory management
    • tool integration
    • knowledge retrieval
  • Lead architecture reviews and guide engineering teams
  • Mentor senior engineers and influence cross-functional teams
  • Drive innovation in AI + hardware convergence
What Makes This Role Unique
  • Opportunity to define agentic AI architecture for hardware-driven systems
  • Work at the convergence of:
    • AI reasoning systems
    • FPGA acceleration
    • next-generation computing platforms
  • High-impact role influencing future AI + semiconductor integration
Impact
  • intelligent system orchestration
  • real-time decision-making pipelines
  • scalable AI deployment on FPGA platforms
Summary
  • bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture
  • and drive innovation in next-generation AI systems.

The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.

$149.1K - $238.2K USD

We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.

Qualifications
  • Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
    • AI/ML systems
    • Distributed systems
    • Hardware–software co-design
    • Recognized expertise in AI/ Large Language Models (LLMs)
  • Deep understanding of:
    • LLM architectures and inference
    • RAG systems and vector databases
    • Agentic AI / autonomous agents
  • Hands-on experience building:
    • Production-grade LLM applications
    • Multi-step reasoning and orchestration workflows
    • Strong background in:
      • FPGA / ASIC / EDA systems
      • Heterogeneous computing architectures
    • Familiarity with:
      • Hardware acceleration for AI workloads
      • Performance optimization across system stack
    Technical Skills
    • Programming:
      • Python
      • C++ (preferred)
    • Experience with:
      • Distributed systems design
      • APIs and microservices architecture
      • Cloud and/or edge AI deployment
    • Hands-on experience with:
      • LLM fine-tuning, quantization, and model distillation
      • On-device / edge AI deployment
      • Robotics, autonomous systems, or real-time AI pipelines
    • Knowledge of:
      • Compiler stacks (e.g., MLIR, TVM)
      • AI model optimization for FPGA platforms
    Job Type

    Regular

    Shift

    Shift 1 (United States of America)

    Primary Location:

    San Jose, California, United States

    Posting Statement

    All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Agentic AI Architect
Agentic AI Architect

191 Altera Corporation • San Jose (CA)

On-site
USD 149,000 - 238,000
Agentic AI Engineer
Agentic AI Engineer

Robotics Technologies • San Jose (CA)

On-site
USD 105,000 - 149,000
Agentic AI Engineer
Agentic AI Engineer

Robotic Process Automation LLC • San Jose (CA)

On-site
USD 150,000 - 230,000
Sr. AI Architect
Sr. AI Architect

Ampcus, Inc • Chantilly (VA)

On-site
USD 180,000 - 260,000
Agentic AI Engineer
Agentic AI Engineer

Valiant Technologies LLC • Los Angeles (CA)

On-site
USD 150,000 - 190,000
Agentic AI Engineer
Agentic AI Engineer

Quantum Technologies LLC • Los Angeles (CA)

On-site
USD 150,000 - 230,000
Agentic AI Engineer
Agentic AI Engineer

Robotic Process Automation LLC • Los Angeles (CA)

On-site
USD 140,000 - 190,000
Agentic AI Developer
Agentic AI Developer

Cortex41 • United States

Remote
USD 130,000 - 190,000
Agentic AI Engineer
Agentic AI Engineer

Ethereum Technologies LLC • San Jose (CA)

On-site
USD 150,000 - 190,000
Agentic AI Developer
Agentic AI Developer

Valiant Technologies LLC • San Jose (CA)

On-site
USD 150,000 - 230,000