Principal Software Engineer Manager (AI Infrastructure) - North America Software Center

TSMC - Taiwan Semiconductor Manufacturing Company Limited; Washington; On-site; USD 167,000 - 242,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Life Insurance

401(k) match

Paid time off

Onsite fitness amenities

Job summary

TSMC Washington is seeking a Principal Software Engineer Manager (AI Infrastructure) to lead a high-performing team building enterprise AI infrastructure. The role combines deep technical leadership in AI platforms with people management across North America and Taiwan.

You will architect scalable AI services, drive Kubernetes-based platforms, and mentor engineers to deliver reliable, high-throughput infrastructure for internal and external foundation models.

Qualifications

• BS/MS/PhD in Computer Science or related field.
• 12+ years of software engineering experience.
• 5+ years leading architecture for distributed systems or cloud infrastructure.
• 3+ years hands-on experience designing enterprise AI platforms.
• 3+ years of formal people management experience (managing teams of senior/staff engineers).
• Strong technical communication skills for collaborating with global cross-functional teams.

Responsibilities

• Hire, lead, and develop a world-class team of AI infrastructure and distributed systems engineers.
• Define AI Platform Architecture and drive long-term technical direction.
• Build scalable AI infrastructure for LLM serving, GPU scheduling, and model lifecycle management.
• Design distributed systems for high availability, multi-region deployment, and DR.
• Drive engineering best practices for Kubernetes, Platform-as-a-Service, and AI deployment automation.
• Define technical strategy across multiple teams and mentor senior engineers.

Skills

Distributed systems

People leadership

Go

Python

Java

REST APIs

Microservices

AI platform design

Cloud infrastructure

Education

BS in Computer Science

MS/PhD preferred

Tools

Kubernetes

Docker

Helm

ArgoCD

Triton Inference Server

Ray

Kubeflow

MLflow

Job description

Join TSMC Washington and help power the future of global technology. At TSMC, we don't just manufacture semiconductors—we innovate to transform industries and enhance lives worldwide. As the world’s leading dedicated semiconductor foundry, we partner with the world's most innovative tech companies to drive breakthroughs across high-performance computing, automotive, AI, consumer electronics, and green energy.

At the North America Software Center, you will thrive in an environment where cutting-edge software engineering meets advanced precision manufacturing. Explore career opportunities with TSMC and join an elite engineering

Who We're Looking For:

The North America Software Center builds next-generation AI infrastructure, hybrid cloud platforms, data engineering ecosystems, and developer platforms supporting thousands of engineers and high-volume manufacturing facilities worldwide.

We are seeking an experienced and visionary Principal Software Engineer Manager (AI Infrastructure) to build and lead a high-performing engineering team dedicated to defining and delivering TSMC's Enterprise AI Infrastructure Platform.

In this dual-impact leadership role, you will combine deep technical expertise in distributed systems and AI platforms with strong people leadership. You will architect scalable, high-throughput AI infrastructure (supporting both internal and external foundation models) while mentoring top engineering talent and collaborating closely with engineering teams across North America and Taiwan.

Key Responsibilities:

• People Leadership & Team Development. Hire, lead, and develop a world-class team of AI infrastructure and distributed systems engineers. Foster a culture of technical excellence, continuous learning, innovation, and psychological safety. Set quarterly engineering roadmaps, establish agile delivery standards, and ensure high operational reliability.
• Define AI Platform Architecture. Drive long-term technical direction for: AI Platform, Enterprise AI Gateway, Multi-model inference platform, GPU infrastructure, AI governance, AI observability.
• Build Enterprise AI Infrastructure:Design highly scalable platforms supporting LLM serving, GPU scheduling, Model routing, Model lifecycle management, RAG infrastructure, Vector databases, AI orchestration.
• Design Distributed Systems:Lead architecture for high availability AI services, multi-region deployment, disaster recovery, service mesh, distributed caching, event-driven architecture, global load balancing.
• AI Platform Engineering:Drive engineering best practices for: Kubernetes, Platform-as-a-Service, AI deployment automation.
• Technical Leadership:Define technical strategy across multiple engineering teams. Lead architecture reviews. Mentor senior engineers. Driving engineering excellence. Influence technical decisions across North America and Taiwan. Partner with product managers, architects, and engineering leaders to define long-term roadmaps.

Minimum Requirements:

• BS/MS/PhD in Computer Science or related field.
• 12+ years of software engineering experience.
• 5+ years leading architecture for distributed systems or cloud infrastructure.
• 3+ years hands-on experience designing enterprise AI platforms.
• 3+ years of formal people management experience (managing teams of senior/staff engineers).
• Strong technical communication skills for collaborating with global cross-functional teams.

Required Technical Experience:

AI Infrastructure, strong experience with:

• LLM inference
• Enterprise AI Gateway
• AI serving infrastructure
• GPU scheduling
• Multi-model AI architecture
• Model lifecycle management

Experience with technologies such as:

• NVIDIA GPU ecosystem
• vLLM
• TensorRT-LLM
• Triton Inference Server
• Ray
• Kubeflow
• MLflow

Cloud Native Infrastructure Deep expertise with:

• Kubernetes
• Docker
• Helm
• ArgoCD
• Service Mesh

• AWS or Azure or GCP

Software Engineering

• Strong programming skills in one or more of Go, Python, JAVA.
• Experience with:
  • REST APIs
  • Microservices
  • SDKs

Eligibility:

Applicants must have legal authorization to work in the United States. We currently cannot provide sponsorship or take over sponsorship of an employment visa. Employment at TSMC is contingent upon passing a background check and drug screening. In compliance with Washington state regulations, cannabis (marijuana) use will not be included in the drug screening.

Work Location & Schedule:

This position is based on-site at our Vancouver, Washington location during core business hours, Monday through Friday from 8 am to 5 pm. Additional hours may be required to meet project demands.

Compensation and Benefits:

• At TSMC, your base pay is just one component of your comprehensive compensation package. For new hires in this position, the starting base salary typically ranges between $166,800 and $223,050 per year. The full base salary range for this Job Grade extends from $166,800 - $241,800 depending on factors such as skills, qualifications, education, experience, tenure, and position level. TSMC’s total compensation package also includes market-competitive pay, profit sharing and incentive bonuses, and tuition assistance.
• Comprehensive benefits include medical, dental, and vision insurance, life insurance, and access to a 401(k) plan with employer match.
• Employees enjoy 12 holidays per year and accrue paid time off annually.
• Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.

EOE Statement:

TSMC Washington, LLC is committed to employing a diverse workforce and provides Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, or any other characteristic protected by applicable law. TSMC is an equal opportunity employer prizing diversity and inclusion. We are committed to treating all employees and applicants for employment with respect and dignity. If you require reasonable accommodation due to a disability during the application or the recruiting process, please feel free to notify us at [e-mail]. TSMC confirms to all applicants its commitment to meet TSMC’s obligations under applicable employment law.