Agentic AI Architect

191 Altera Corporation

San Jose (CA)

On-site

USD 149,000 - 238,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Altera Corporation in San Jose, California seeks a senior Agentic AI Architect to lead design of agentic AI systems integrated with FPGA/ASIC platforms, bridging software intelligence and hardware acceleration.

You will define architecture, drive technical strategy, mentor engineers, and collaborate with hardware teams on EDA and system integration for scalable AI pipelines on FPGA-rich environments.

Qualifications

  • 10+ years in AI/ML systems and distributed software.

Responsibilities

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration.
  • Architect RAG pipelines for enterprise-scale knowledge integration.
  • Define end-to-end AI system architecture from data ingestion to reasoning to action.
  • Develop workflows with tool-using agents and reasoning agents for multi-agent collaboration.
  • Evaluate and integrate leading LLMs (open-source and proprietary).
  • Co-design AI systems with FPGA/ASIC hardware acceleration and heterogeneous compute.

Skills

AI/ML systems
LLMs
Distributed systems
RAG systems
Hardware–software co-design
Multi-agent orchestration
Python
C++
APIs
Cloud/edge AI deployment
On-device/edge AI deployment

Education

Master’s or Bachelor’s degree in AI/ML or related field

Tools

LangChain
LlamaIndex
MLIR
TVM

Job description

Job Details: Job Description: We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms. This role sits at the intersection of: Large Language Models (LLMs) Agent frameworks & autonomous systems Retrieval-Augmented Generation (RAG) Hardware-aware AI system design (FPGA / ASIC / EDA) You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration.

Key Responsibilities
  • AI Architecture & System Design
    • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
    • Architect RAG pipelines for enterprise-scale knowledge integration
    • Define end-to-end AI system architecture from data ingestion → reasoning → action
  • Agentic AI & LLM Development
    • Develop advanced workflows using: tool-using agents planning & reasoning agents multi-agent collaboration frameworks
    • Evaluate and integrate leading LLMs (open-source and proprietary)
    • Optimize prompt engineering, memory, and reasoning capabilities
  • Hardware-Aware AI Optimization
    • Co-design AI systems with: FPGA acceleration ASIC platforms heterogeneous compute (CPU/GPU/FPGA)
    • Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
    • Collaborate with hardware teams on EDA and system integration
  • Framework & Platform Development
    • Build internal platforms using LangChain LlamaIndex custom agent orchestration framework
    • Develop reusable components for: memory management tool integration knowledge retrieval
  • Technical Leadership
    • Lead architecture reviews and guide engineering teams
    • Mentor senior engineers and influence cross-functional teams
    • Drive innovation in AI + hardware convergence
What Makes This Role Unique

Opportunity to define agentic AI architecture for hardware-driven systems Work at the convergence of: AI reasoning systems FPGA acceleration next-generation computing platforms High-impact role influencing future AI + semiconductor integration

Impact

You will help shape how AI agents interact with hardware, enabling: intelligent system orchestration real-time decision-making pipelines scalable AI deployment on FPGA platforms

Summary

This role is ideal for a senior technical leader who can: bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture and drive innovation in next-generation AI systems.

The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance. $149.1K - $238.2K USD

We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.

Qualifications
  • Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
    • AI/ML systems
    • Distributed systems
    • Hardware–software co-design
  • Recognized expertise in AI/ Large Language Models (LLMs)
  • Deep understanding of:
    • LLM architectures and inference
    • RAG systems and vector databases
  • Agentic AI / autonomous agents
  • Hands-on experience building:
    • Production-grade LLM applications
    • Multi-step reasoning and orchestration workflows
    • Scalable and reliable AI systems in production
  • Strong background in:
    • FPGA / ASIC / EDA systems
    • Heterogeneous computing architectures
  • Familiarity with:
    • Hardware acceleration for AI workloads
    • Performance optimization across system stack
  • Technical Skills Programming:
    • Python
    • C++ (preferred)
  • Experience with:
    • Distributed systems design
    • APIs and microservices architecture
    • Cloud and/or edge AI deployment
  • Hands-on experience with:
    • LLM fine-tuning, quantization, and model distillation
    • On-device / edge AI deployment
    • Robotics, autonomous systems, or real-time AI pipelines
  • Knowledge of:
    • Compiler stacks (e.g., MLIR, TVM)
    • AI model optimization for FPGA platforms
Job Type
  • Regular
  • Shift: Shift 1 (United States of America)
  • Primary Location: San Jose, California, United States
  • Additional Locations:
Posting Statement

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation or any other characteristic protected by local law, regulation, or ordinance.

About Altera

Altera: Accelerating Innovators Altera provides leadership programmable solutions that are easy-to-use and deploy in applications from cloud to edge, offering limitless AI possibilities. Our end-to-end broad portfolio of products including FPGAs, CPLDs, Intellectual Property, development tools, System on Modules, SmartNICs and IPUs provide the flexibility to accelerate innovation. Altera is helping to shape the future through pioneering innovation that unlocks extraordinary possibilities for everyone on the planet.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Lead Architect - Silicon Design Execution
AI Lead Architect - Silicon Design Execution

191 Altera Corporation • San Jose (CA)

On-site
USD 206,000 - 303,000
Agentic AI Architect
Agentic AI Architect

Altera • San Jose (CA)

On-site
USD 149,000 - 238,000
AI Platform & Security Engineer
AI Platform & Security Engineer

Altera • San Jose (CA)

On-site
USD 187,000 - 299,000
AI Platform & Security Engineer
AI Platform & Security Engineer

191 Altera Corporation • San Jose (CA)

On-site
USD 187,000 - 299,000
RTL Engineer – Physical AI Solutions
RTL Engineer – Physical AI Solutions

Altera • San Jose (CA)

On-site
USD 149,000 - 238,000
AI Lead Architect - Silicon Design Execution
AI Lead Architect - Silicon Design Execution

Altera • San Jose (CA)

On-site
USD 206,000 - 303,000
Senior Lead Design Engineer
Senior Lead Design Engineer

191 Altera Corporation • San Jose (CA)

On-site
USD 232,000 - 330,000
AI Lead Architect - Silicon Design Execution
AI Lead Architect - Silicon Design Execution

Altera Corporation • San Jose (CA)

Hybrid
USD 206,000 - 303,000
RTL Engineer – Physical AI Solutions
RTL Engineer – Physical AI Solutions

Altera Corporation • San Jose (CA)

On-site
USD 149,000 - 238,000
FPGA IP Software Development Engineer
FPGA IP Software Development Engineer

191 Altera Corporation • San Jose (CA)

On-site
USD 133,000 - 213,000