Senior SoC Architect

MemryX; Ann Arbor (MI); On-site; USD 200,000 - 320,000; Full time

Benefits offered by this job

Medical benefits

401(k) matching

Equity incentives

Life insurance

Unlimited PTO

Parental leave

Tuition reimbursement

Job summary

MemryX is seeking a Senior SoC Architect to define the system-level architecture for next-generation AI and edge-computing SoCs. You will bridge software requirements and hardware implementation, guiding decisions from exploration to silicon bring-up.

You will lead cross-functional teams across RTL, verification, firmware, and compiler, translating workloads into scalable architectures for high performance and power efficiency.

Qualifications

• BS or MS in Electrical Engineering, Computer Engineering, or a related technical field.
• 15+ years of industry experience in ASIC/SoC design, with at least 3+ years in a lead architectural role.
• Proven track record of architecting and taping out complex, high-performance SoCs.
• Strong knowledge of AI architectures and hardware development.
• Open, collaborative communication and startup mindset.

Responsibilities

• Define the overall SoC architecture, including memory hierarchy, IP selection, interconnects, coherency, I/O, security, and power management.
• Own architecture specifications and roadmaps; author and maintain docs.
• Evaluate architectural tradeoffs for edge computing workloads.
• Develop performance models to guide decisions and identify bottlenecks.
• Lead cross-functional collaboration with RTL, verification, firmware, compiler, and apps teams.

Skills

Architecture design

Leadership

Cross-functional collaboration

Performance modeling

Hardware-software co-design

Education

BS or MS in Electrical Engineering, Computer Engineering, or related field

Tools

SystemC

RTL design tools

Job description

About this position

MemryX Inc. is a semiconductor company focused on delivering high-performance, low-power AI accelerators for edge computing. Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei and Hsinchu Taiwan, and Riyadh, Saudi Arabia.

Our unique compute-near-memory architecture minimizes data movement and enables massively parallel, scalable on-chip AI inference. We’ve co-designed a full hardware-software stack (compiler, runtime, and APIs) to make AI development both easy and high-performance. Powered by MemryX Compute Engines, our decentralized many-core dataflow design delivers industry-leading throughput and efficiency, ideal for smart edge devices.

We are currently in production with our MX3 AI accelerator and actively developing next-generation MX4, backed by top-tier VCs. At MemryX, you’ll join a collaborative, innovation-driven team that empowers you to shape the future of edge AI.

Who We Are:

• Communicative & Collaborative: You’re open, honest, and thrive on feedback.
• Curious & Innovative: You love brainstorming new ideas and turning them into reality.
• Tech-Driven: Passionate about advancing AI and edge computing.
• Adaptable: Energized by the fast pace and ambiguity of a startup environment.

Why You’ll Love Working Here:

• Hands-On Learning: Structured rotations across hardware and software domains.
• Innovative Culture: Rapid prototyping, continuous learning, and a true startup mindset.
• Career Path: Clear progression from junior engineer to specialist and beyond.
• Great Perks: Competitive salary, equity grants, comprehensive health benefits, and more.

About The Role

The Senior SoC Architect will define and drive the system-level architecture for our next- generation SoCs for AI and edge-computing applications. You will turn innovative ideas into reality by bridging the gap between software requirements and hardware implementation. By translating product and workload requirements into scalable system architectures, you will guide key technical decisions from early exploration through silicon bring-up, leading cross-functional efforts to deliver high-performance, power-efficient silicon solutions.

What You'll Do:

• Architecture Definition: Define the overall SoC architecture, including memory hierarchy, IP selection, high-speed interconnects, coherency, I/O, security, and power- management architectures.
• Specifications & Roadmaps: Own SoC architecture specifications and roadmaps. Author, review, and maintain comprehensive architectural and micro-architecture documents.
• Trade-off Analysis: Evaluate architectural tradeoffs, balancing performance, power, area (PPA), cost, and schedule specifically for edge computing workloads.
• Performance Modeling: Analyze target AI workloads, and develop performance models to guide architectural decisions and identify bottlenecks across hardware and software.
• Cross-Functional Collaboration: Partner with RTL, verification, firmware, compiler, and application teams throughout the development lifecycle to translate product requirements into actionable engineering plans.
• Lifecycle Execution: Lead architecture reviews, document requirements, and ensure alignment between product goals and implementation. Support pre-silicon validation, post-silicon bring-up, performance characterization, and optimization.

What We Expect to See:

• BS or MS in Electrical Engineering, Computer Engineering, or a related technical field.
• 15+ years of industry experience in ASIC/SoC design, with at least 3+ years functioning in a lead architectural capacity.
• Proven track record of successfully architecting and taping out complex, high-performance SoCs.
• A tech-driven passion for hardware development and deep knowledge of AI architectures.
• High adaptability and the energy required to thrive in the fast pace and ambiguity of a startup environment.
• Open, honest communication skills and a collaborative mindset that thrives on feedback.

What We Would Be Happy to See:

• Ph.D. in Electrical Engineering, Computer Architecture, or a related discipline.
• Hands-on experience with performance modeling (e.g., C++, SystemC) and architectural simulation tools.
• Familiarity with rapid prototyping methodologies and hardware-software co-design.
• Previous experience operating within a true startup mindset, demonstrating a strong desire for continuous learning.
• Knowledge of advanced packaging technologies (e.g., chiplets, 2.5D/3D integration).

Reports to

Senior Director of Engineering

Work Schedule

Full-time

Why Join MemryX?

We offer more than just a job - we offer a career with purpose!

The benefits outlined below reflect MemryX’s current benefits package for U.S.-based employees. Benefits for employees hired outside of the United States may vary based on location and will be provided in accordance with applicable local laws, regulations, and company practices.

• Comprehensive medical, dental, and vision coverage. MemryX covers 100% of the employee premium!
• Matching 401(k).
• Equity incentive packages.
• Company-paid life insurance coverage for all employees .
• Unlimited paid time off.
• Generous paid parental leave.
• Growth and learning opportunities, including tuition reimbursement and professional development support.
• Potential for advancement in a growing organization.

Employment Opportunity and Benefits of Employment:

We are committed to creating and fostering a diverse and inclusive workplace environment for all of our employees. We are an equal opportunity employer.