Paid Inference Architecture Intern (12-Week)

The Consensus; San Jose (CA); On-site; USD 55,104 - 82,656; Part time

Benefits offered by this job

12-week paid internship

Housing support for relocation

Daily lunch and dinner in office

Direct mentorship from industry leads

Office in San Jose, CA

Job summary

Etched in San Jose, CA is offering a 12-week paid internship in Inference Architecture for Fall '26, Spring '27, and Summer '27. Candidates will contribute to designing and optimizing AI accelerator compute architectures and performance for inference workloads.

You will port models, build testing abstractions, and help scale our runtime, with mentorship from industry leaders and hands-on work on cutting-edge architectural problems. Relocation housing support and daily meals are provided.

Qualifications

• Pursuing a Bachelor's, Master’s, or PhD in CS, CE, applied mathematics, or related field.
• Proficiency in Python and C++.
• Understanding of performance-sensitive distributed software systems.

Responsibilities

• Port models to our architecture and build testing capabilities.
• Help build, scale, and maintain the runtime for multi-node inference and state management.
• Optimize routing and communication layers using collectives.
• Use profiling tools to identify bottlenecks and correctness issues.
• Co-design HW instructions and model architecture operations to maximize performance.
• Develop high-performance software components for the Model Toolkit.

Skills

Python

C++

Education

Bachelor’s/Master’s/PhD candidate

Tools

PyTorch

JAX

Job description

Etched in San Jose, CA is offering a 12-week paid internship in Inference Architecture for Fall '26, Spring '27, and Summer '27. Candidates will contribute to designing and optimizing AI accelerator compute architectures and performance for inference workloads.

You will port models, build testing abstractions, and help scale our runtime, with mentorship from industry leaders and hands-on work on cutting-edge architectural problems. Relocation housing support and daily meals are provided.