Research Engineer, Algorithms

Aimlroles; Palo Alto (CA); Presencial; USD 180 000 - 260 000; Tempo integral

Resumo da oferta

Normal Computing is an applied AI company building the hardware and software foundations for in-memory AI inference. You will create algorithms that run on our memory-centric hardware, redefining how attention and long-context decoding map to this substrate.

This co-design role blends architecture decisions with algorithm development, testing in simulators and on silicon as hardware evolves. The ideal candidate combines deep large-model inference knowledge with mathematical insight and hands-on

Qualificações

• Strong understanding of large model inference and attention mechanisms.
• Experience optimizing inference: quantization, sparsity, kernel fusion, or memory-efficient attention.
• Track record of implementing algorithms close to hardware from theory to working hardware.

Responsabilidades

• Develop algorithms for LLM inference on in-memory hardware.
• Collaborate with hardware/architecture teams to shape native computations.
• Design numerical methods that exploit hardware dynamics.
• Build evaluation frameworks and benchmarks for hardware or simulation.
• Translate model workloads into hardware design constraints and opportunities.
• Prototype and iterate rapidly as hardware evolves toward silicon.
• Optimize performance at both gate and algorithmic levels.

Conhecimentos

Large model inference

Attention mechanisms

Memory bandwidth

Inference optimization

Python programming

Systems programming

Cross-team collaboration

First principles reasoning

Formação académica

PhD preferred in ML/Math/Physics/EE

Ferramentas

FPGA

Descrição da oferta de emprego

Normal Computing | Build with Us

Normal is an applied AI company solving the hardest problems in AI and silicon. We build foundational hardware and software for the semiconductor industry, critical AI infrastructure, and the broader systems that power our world, in partnership with the world's most advanced institutions. We work as one team across New York City, Silicon Valley (Mountain View), London, Copenhagen, and Seoul.

The Role

Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. You will develop the computational methods that make LLM inference run efficiently on it. The core challenge is rethinking how operations like attention, memory access, and long-context decoding should behave on hardware that computes inside memory, rather than adapting standard GPU kernels to a new chip.

Your job is to develop the algorithms that exploit this natively: understand which parts of LLM workloads are best suited to in-memory execution, design numerical methods that map onto the hardware's physical behavior, and validate them against our simulators and FPGA prototypes first, and against silicon as it arrives.

This is a co-design role. The hardware and the algorithms are developed in parallel, which means you will influence architectural decisions rather than implement against a fixed specification. The strongest candidates have a deep understanding of both large model inference and the mathematics of stochastic systems, and have built systems that run on real hardware.

What You Will Own

• Algorithm Development: Develop algorithms for LLM inference workloads running on our in-memory hardware. Success means algorithms that measurably improve LLM inference on our hardware, demonstrated in simulation and then on silicon.

• Software/Hardware Co-Design: Work directly with hardware and architecture teams to shape what the chip can and should compute natively.

• Numerical Methods: Design numerical methods that exploit thermal noise and analog dynamics rather than working around them.

• Evaluation & Benchmarks: Build evaluation frameworks and benchmarks that characterize algorithm behavior on real hardware or simulation.

• Workload Translation: Translate insights about model workloads into constraints and opportunities for hardware design.

• Rapid Prototyping: Prototype and iterate rapidly as hardware evolves from simulation to silicon.

• Performance Optimization: Optimize performance at both the gate level and the algorithmic level.

What Makes You a Great Fit

• Deep understanding of large model inference: attention mechanisms, KV cache, long-context decoding, memory bandwidth constraints

• Experience with inference optimization: quantization, sparsity, kernel fusion, or memory-efficient attention

• Familiarity with stochastic systems, probabilistic methods, numerical analysis, or analog computation

• Experience implementing algorithms close to hardware, beyond high-level frameworks

• Comfort reasoning from first principles about what a novel substrate can do efficiently

• Track record of taking ideas from theory to working implementation on real hardware

• Strong programming skills in Python and at least one systems language

• Collaborative instinct and ability to work across hardware, architecture, and software teams

Bonus Points

• PhD in machine learning, applied mathematics, physics, electrical engineering, or a related field

• Exposure to analog or mixed-signal systems, in-memory compute, or non-von-Neumann architectures

• Experience working on hardware that did not yet exist when you joined

• Publications or open-source work in efficient inference, stochastic algorithms, or novel computing

Equal Employment Opportunity Statement

Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.

Accessibility Accommodations

Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at [e-mail].

By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice.