Senior SoC Architect

MemryX; Ann Arbor (MI); On-site; USD 180,000 - 280,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) match

Equity incentives

Life insurance

Unlimited PTO

Parental leave

Tuition reimbursement

Career development

Job summary

MemryX, a semiconductor company focused on high-performance AI accelerators for edge computing, is seeking a Senior SoC Architect in Ann Arbor, MI. This role leads system-level architecture for next-generation SoCs, translating product requirements into scalable designs and guiding cross-functional teams through silicon bring-up.

You’ll define memory hierarchies, interconnects, security and power architectures, perform performance modeling, and drive architectural decisions from exploration to

Qualifications

• BS or MS in Electrical/Computer Engineering or related field.
• 15+ years in ASIC/SoC design; 3+ years in lead architectural role.
• Proven track record architecting and taping out complex SoCs.
• Deep knowledge of AI architectures and hardware development.
• Adaptable, startup-friendly with strong communication.

Responsibilities

• Define overall SoC architecture, memory, interconnects, I/O, security, and power architectures.
• Own architecture specifications and roadmaps; produce docs.
• Evaluate architectural tradeoffs for edge computing workloads.
• Develop performance models for AI workloads.
• Collaborate with RTL, verification, firmware, compiler, and applications teams.
• Lead pre-silicon to post-silicon validation and optimization.

Skills

ASIC/SoC design

Architectural leadership

AI architectures

Communication

Startup mindset

Education

Electrical/Computer Engineering degree

Tools

SystemC

C++

Job description

About this position

MemryX Inc. is a semiconductor company focused on delivering high-performance, low-power AI accelerators for edge computing. Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei and Hsinchu Taiwan, and Riyadh, Saudi Arabia.

Our unique compute-near-memory architecture minimizes data movement and enables massively parallel, scalable on-chip AI inference. We’ve co-designed a full hardware-software stack (compiler, runtime, and APIs) to make AI development both easy and high-performance. Powered by MemryX Compute Engines, our decentralized many-core dataflow design delivers industry-leading throughput and efficiency, ideal for smart edge devices.

We are currently in production with our MX3 AI accelerator and actively developing next-generation MX4, backed by top-tier VCs. At MemryX, you’ll join a collaborative, innovation-driven team that empowers you to shape the future of edge AI.

Who We Are:

MemryX Inc. is a semiconductor company focused on delivering high-performance, low-power AI accelerators for edge computing. Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei and Hsinchu Taiwan, and Riyadh, Saudi Arabia.

Who You Are

• Communicative & Collaborative: You’re open, honest, and thrive on feedback.
• Curious & Innovative: You love brainstorming new ideas and turning them into reality.
• Tech-Driven: Passionate about advancing AI and edge computing.
• Adaptable: Energized by the fast pace and ambiguity of a startup environment.

Why You’ll Love Working Here:

• Hands-On Learning: Structured rotations across hardware and software domains.
• Innovative Culture: Rapid prototyping, continuous learning, and a true startup mindset.
• Career Path: Clear progression from junior engineer to specialist and beyond.
• Great Perks: Competitive salary, equity grants, comprehensive health benefits, and more.

About The Role

The Senior SoC Architect will define and drive the system-level architecture for our next- generation SoCs for AI and edge-computing applications. You will turn innovative ideas into reality by bridging the gap between software requirements and hardware implementation. By translating product and workload requirements into scalable system architectures, you will guide key technical decisions from early exploration through silicon bring-up, leading cross-functional efforts to deliver high-performance, power-efficient silicon solutions.

What You'll Do:

• Architecture Definition: Define the overall SoC architecture, including memory hierarchy, IP selection, high-speed interconnects, coherency, I/O, security, and power- management architectures.
• Specifications & Roadmaps: Own SoC architecture specifications and roadmaps. Author, review, and maintain comprehensive architectural and micro-architecture documents.
• Trade-off Analysis: Evaluate architectural tradeoffs, balancing performance, power, area (PPA), cost, and schedule specifically for edge computing workloads.
• Performance Modeling: Analyze target AI workloads, and develop performance models to guide architectural decisions and identify bottlenecks across hardware and software.
• Cross-Functional Collaboration: Partner with RTL, verification, firmware, compiler, and application teams throughout the development lifecycle to translate product requirements into actionable engineering plans.
• Lifecycle Execution: Lead architecture reviews, document requirements, and ensure alignment between product goals and implementation. Support pre-silicon validation, post-silicon bring-up, performance characterization, and optimization.

What We Expect to See:

• BS or MS in Electrical Engineering, Computer Engineering, or a related technical field.
• 15+ years of industry experience in ASIC/SoC design, with at least 3+ years functioning in a lead architectural capacity.
• Proven track record of successfully architecting and taping out complex, high-performance SoCs.
• A tech-driven passion for hardware development and deep knowledge of AI architectures.
• High adaptability and the energy required to thrive in the fast pace and ambiguity of a startup environment.
• Open, honest communication skills and a collaborative mindset that thrives on feedback.

What We Would Be Happy to See:

• Ph.D. in Electrical Engineering, Computer Architecture, or a related discipline.
• Hands-on experience with performance modeling (e.g., C++, SystemC) and architectural simulation tools.
• Familiarity with rapid prototyping methodologies and hardware-software co-design.
• Previous experience operating within a true startup mindset, demonstrating a strong desire for continuous learning.
• Knowledge of advanced packaging technologies (e.g., chiplets, 2.5D/3D integration).

Reports to : Senior Director of Engineering

Work Schedule : Full-time

Why Join MemryX?

We offer more than just a job - we offer a career with purpose!

The benefits outlined below reflect MemryX’s current benefits package for U.S.-based employees. Benefits for employees hired outside of the United States may vary based on location and will be provided in accordance with applicable local laws, regulations, and company practices.

• Comprehensive medical, dental, and vision coverage. MemryX covers 100% of the employee premium!
• Matching 401(k).
• Equity incentive packages.
• Company-paid life insurance coverage for all employees .
• Unlimited paid time off.
• Generous paid parental leave.
• Growth and learning opportunities, including tuition reimbursement and professional development support.
• Potential for advancement in a growing organization.

Employment Opportunity and Benefits of Employment: We are committed to creating and fostering a diverse and inclusive workplace environment for all of our employees. We are an equal opportunity employer.

Share this Job: