Senior SoC Architect

MemryX Inc.; Ann Arbor (MI); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Health benefits

401(k) matching

Equity incentives

Life insurance

Unlimited PTO

Parental leave

Tuition reimbursement

Professional development

Career advancement

Job summary

MemryX Inc. is seeking a Senior SoC Architect to drive system-level architecture for next-gen AI accelerators in edge computing. You’ll bridge software requirements with hardware implementation, translating workloads into scalable architectures and guiding decisions through silicon bring-up.

Ideal candidates have extensive ASIC/SoC experience, a strong background in AI architectures, and proven leadership in cross-functional teams within a startup-like environment.

Qualifications

• BS or MS in Electrical/Computer Engineering or related field.
• 15+ years of ASIC/SoC design experience.
• 3+ years in a lead architectural role.
• Proven track record architecting and taping out complex SoCs.
• Deep knowledge of AI architectures.

Responsibilities

• Define the overall SoC architecture including memory hierarchy, IP selection, interconnects, coherency, I/O, security, and power management.
• Own SoC architecture specs and roadmaps; author and maintain architectural documents.
• Evaluate tradeoffs in performance, power, area, cost, and schedule for edge workloads.
• Develop performance models to guide decisions across hardware and software.
• Collaborate with RTL, verification, firmware, compiler, and app teams across the lifecycle.

Skills

SoC architecture

ASIC/SoC design

Leadership

AI architectures

Performance modeling

C++/SystemC

Cross-functional

HW/SW co-design

Education

BS in Electrical Engineering

MS in Electrical Engineering

Tools

SystemC

C++

Job description

Who We Are

MemryX Inc. is a semiconductor company focused on delivering high-performance, low-power AI accelerators for edge computing. Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei and Hsinchu Taiwan, and Riyadh, Saudi Arabia.

Who We Are

MemryX Inc. is a semiconductor company focused on delivering high-performance, low-power AI accelerators for edge computing. Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei and Hsinchu Taiwan, and Riyadh, Saudi Arabia.
Our unique compute-near-memory architecture minimizes data movement and enables massively parallel, scalable on-chip AI inference. We’ve co-designed a full hardware-software stack (compiler, runtime, and APIs) to make AI development both easy and high-performance. Powered by MemryX Compute Engines, our decentralized many-core dataflow design delivers industry-leading throughput and efficiency, ideal for smart edge devices.
We are currently in production with our MX3 AI accelerator and actively developing next-generation MX4, backed by top-tier VCs. At MemryX, you’ll join a collaborative, innovation-driven team that empowers you to shape the future of edge AI.

Who You Are

• Communicative & Collaborative: You’re open, honest, and thrive on feedback.
• Curious & Innovative: You love brainstorming new ideas and turning them into reality.
• Tech-Driven: Passionate about advancing AI and edge computing.
• Adaptable: Energized by the fast pace and ambiguity of a startup environment.

Why You’ll Love Working Here

• Hands-On Learning: Structured rotations across hardware and software domains.
• Innovative Culture: Rapid prototyping, continuous learning, and a true startup mindset.
• Career Path: Clear progression from junior engineer to specialist and beyond.
• Great Perks: Competitive salary, equity grants, comprehensive health benefits, and more.

About The Role

The Senior SoC Architect will define and drive the system-level architecture for our next- generation SoCs for AI and edge-computing applications. You will turn innovative ideas into reality by bridging the gap between software requirements and hardware implementation. By translating product and workload requirements into scalable system architectures, you will guide key technical decisions from early exploration through silicon bring-up, leading cross-functional efforts to deliver high-performance, power-efficient silicon solutions.

What You’ll Do

• Architecture Definition: Define the overall SoC architecture, including memory hierarchy, IP selection, high-speed interconnects, coherency, I/O, security, and power- management architectures.
• Specifications & Roadmaps: Own SoC architecture specifications and roadmaps. Author, review, and maintain comprehensive architectural and micro-architecture documents.
• Trade-off Analysis: Evaluate architectural tradeoffs, balancing performance, power, area (PPA), cost, and schedule specifically for edge computing workloads.
• Performance Modeling: Analyze target AI workloads, and develop performance models to guide architectural decisions and identify bottlenecks across hardware and software.
• Cross-Functional Collaboration: Partner with RTL, verification, firmware, compiler, and application teams throughout the development lifecycle to translate product requirements into actionable engineering plans.
• Lifecycle Execution: Lead architecture reviews, document requirements, and ensure alignment between product goals and implementation. Support pre-silicon validation, post-silicon bring-up, performance characterization, and optimization.

What We Expect To See

• BS or MS in Electrical Engineering, Computer Engineering, or a related technical field.
• 15+ years of industry experience in ASIC/SoC design, with at least 3+ years functioning in a lead architectural capacity.
• Proven track record of successfully architecting and taping out complex, high-performance SoCs.
• A tech-driven passion for hardware development and deep knowledge of AI architectures.
• High adaptability and the energy required to thrive in the fast pace and ambiguity of a startup environment.
• Open, honest communication skills and a collaborative mindset that thrives on feedback.

What We Would Be Happy To See

• Ph.D. in Electrical Engineering, Computer Architecture, or a related discipline.
• Hands-on experience with performance modeling (e.g., C++, SystemC) and architectural simulation tools.
• Familiarity with rapid prototyping methodologies and hardware-software co-design.
• Previous experience operating within a true startup mindset, demonstrating a strong desire for continuous learning.
• Knowledge of advanced packaging technologies (e.g., chiplets, 2.5D/3D integration).

Reports to

Senior Director of Engineering

Location

Ann Arbor, MI

Work Schedule

Full-time

Why Join MemryX?

We offer more than just a job - we offer a career with purpose!

The benefits outlined below reflect MemryX’s current benefits package for U.S.-based employees. Benefits for employees hired outside of the United States may vary based on location and will be provided in accordance with applicable local laws, regulations, and company practices.

• Comprehensive medical, dental, and vision coverage. MemryX covers 100% of the employee premium!
• Matching 401(k).
• Equity incentive packages.
• Company-paid life insurance coverage for all employees.
• Unlimited paid time off.
• Generous paid parental leave.
• Growth and learning opportunities, including tuition reimbursement and professional development support.
• Potential for advancement in a growing organization.

Employment Opportunity and Benefits of Employment:

We are committed to creating and fostering a diverse and inclusive workplace environment for all of our employees. We are an equal opportunity employer.