Principal Technical Lead, Software Engineering (AI Infrastructure) - North America Software Center

TSMC - Taiwan Semiconductor Manufacturing Company Limited; Washington; On-site; USD 166,800 - 241,800; Full time

Benefits offered by this job

Medical, dental and vision insurance

401(k) with employer match

Paid holidays and PTO

Job summary

TSMC Washington seeks a seasoned AI Infrastructure Tech Leader to define and build an enterprise-scale AI Infrastructure Platform. You will guide architecture, strategy, and cross‑regional collaboration to deploy secure, scalable AI services for thousands of engineers across North America and Taiwan.

Lead engineering teams, drive Kubernetes and deployment automation, and shape long-term roadmaps while partnering with product managers and architects to deliver robust AI platforms.

Qualifications

• BS/MS/PhD in Computer Science or related field.
• 12+ years of software engineering experience.
• 5+ years leading architecture for distributed systems or cloud infrastructure.
• 3+ years hands-on experience designing enterprise AI platforms.
• 3+ years’ experience as a Principal/Staff/Distinguished Engineer or Technical Lead.
• Strong technical communication skills for collaborating with global cross-functional teams.

Responsibilities

• Define AI Platform Architecture and strategy for enterprise AI infrastructure.
• Build highly scalable AI infrastructure for LLM serving and model lifecycle management.
• Design distributed systems for high availability, multi-region deployment, disaster recovery, and service mesh.
• Drive Kubernetes, Platform-as-a-Service, and AI deployment automation practices.
• Provide technical leadership across North America and Taiwan, mentoring engineers and influencing roadmaps.

Skills

AI infrastructure

Distributed systems

Cloud infrastructure

Go/Python/Java

Strong technical communication

Education

BS/MS/PhD in Computer Science

Tools

NVIDIA GPU ecosystem

vLLM

TensorRT-LLM

Triton Inference Server

Ray

Kubeflow

MLflow

Job description

Join TSMC Washington and help power the future of technology. At TSMC, we don't just make semiconductors; we innovate to transform industries and enhance lives. As the world’s leading semiconductor foundry, we partner with top tech companies to drive advancements in industries such as healthcare, automotive, consumer electronics, and renewable energy. At TSMC Washington, you'll thrive where innovation meets precision manufacturing, and integrity guides our high standards and customer trust. Our visionary leaders collaborate with clients to achieve groundbreaking results, ensuring our leadership in the semiconductor sector. Explore career opportunities with TSMC Washington and join a company with a commitment to excellence and innovation.

Who We're Looking For:

We develop next-generation AI infrastructure, cloud platforms, data infrastructure, developer platforms, and site reliability engineering (SRE) capabilities supporting engineering teams and manufacturing facilities worldwide. As TSMC accelerates AI adoption across the enterprise, we are building enterprise-scale AI platforms that enable secure, scalable, and reliable AI services across global regions.

We are seeking a talented and experienced AI Infrastructure Tech Leader to define and build TSMC's enterprise AI Infrastructure Platform.

As the Principal Technical Lead - AI Infrastructure, you will serve as one of the senior technical leaders responsible for defining the architecture and technical strategy of TSMC's next-generation AI platform.

You will design and lead enterprise-scale AI infrastructure that enables thousands of engineers across multiple global regions to securely develop, deploy, and operate AI applications using both internal and external foundation models.

You will collaborate with engineering teams in North America and Taiwan to build a highly scalable AI platform supporting model serving, inference, AI gateways, GPU infrastructure, observability, governance, and platform automation.

This role combines deep expertise in distributed systems, cloud infrastructure, AI platforms, and software architecture.

Key Responsibilities:

• Define AI Platform Architecture.Lead the architecture and technical strategy for enterprise AI infrastructure. Drive long-term technical direction for: AI Platform, Enterprise AI Gateway, Multi-model inference platform, GPU infrastructure, AI governance, AI observability.
• Build Enterprise AI Infrastructure:Design highly scalable platforms supporting LLM serving, GPU scheduling, Model routing, Model lifecycle management, RAG infrastructure, Vector databases, AI orchestration.
• Design Distributed Systems:Lead architecture for high availability AI services, multi-region deployment, disaster recovery, service mesh, distributed caching, event-driven architecture, global load balancing.
• AI Platform Engineering:Drive engineering best practices for: Kubernetes, Platform-as-a-Service, AI deployment automation.
• Technical Leadership:Define technical strategy across multiple engineering teams. Lead architecture reviews. Mentor senior engineers. Driving engineering excellence. Influence technical decisions across North America and Taiwan. Partner with product managers, architects, and engineering leaders to define long-term roadmaps.

Minimum Requirements:

• BS/MS/PhD in Computer Science or related field.
• 12+ years of software engineering experience.
• 5+ years leading architecture for distributed systems or cloud infrastructure.
• 3+ years hands‑on experience designing enterprise AI platforms.
• 3+ years’ experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
• Strong technical communication skills for collaborating with global cross‑functional teams.

Required Technical Experience:

AI Infrastructure, strong experience with:

• LLM inference
• Enterprise AI Gateway
• AI serving infrastructure
• GPU scheduling
• Multi-model AI architecture
• Model lifecycle management

Experience with technologies such as:

• NVIDIA GPU ecosystem
• vLLM
• TensorRT-LLM
• Triton Inference Server
• Ray
• Kubeflow
• MLflow

Cloud Native Infrastructure Deep expertise with:

• Kubernetes
• Docker
• Helm
• ArgoCD
• Service Mesh
• AWS or Azure or GCP

Software Engineering

• Strong programming skills in one or more of Go, Python, JAVA.
• Experience with:
  • REST APIs
  • Microservices
  • SDKs

Eligibility:

Applicants must have legal authorization to work in the United States. We currently cannot provide sponsorship or take over sponsorship of an employment visa. Employment at TSMC is contingent upon passing a background check and drug screening. In compliance with Washington state regulations, cannabis (marijuana) use will not be included in the drug screening.

Work Location & Schedule:

This position is based on-site at our Vancouver, Washington location during core business hours, Monday through Friday from 8 am to 5 pm. Additional hours may be required to meet project demands.

Compensation and Benefits:

• At TSMC, your base pay is just one component of your comprehensive compensation package. For new hires in this position, the starting salary typically ranges between $166,800 and $223,050 per year. The full salary range for this Job Grade extends from $166,800 - $241,800 depending on factors such as skills, qualifications, education, experience, tenure, and position level. TSMC’s total compensation package also includes market‑competitive pay, profit sharing and incentive bonuses, and tuition assistance.
• Comprehensive benefits include medical, dental, and vision insurance, life insurance, and access to a 401(k) plan with employer match.
• Employees enjoy 12 holidays per year and accrue paid time off annually.
• Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.

EOE Statement:

TSMC Washington, LLC is committed to employing a diverse workforce and provides Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, or any other characteristic protected by applicable law.

TSMC is an equal opportunity employer prizing diversity and inclusion. We are committed to treating all employees and applicants for employment with respect and dignity. If you require reasonable accommodation due to a disability during the application or the recruiting process, please feel free to notify us at [e-mail]. TSMC confirms to all applicants its commitment to meet TSMC’s obligations under applicable employment law.

TSMC Core Values

At TSMC, we invite talented individuals who share our vision and values to contribute to our continued success. Our core values are the foundation of our culture, guiding every decision and action. We seek applicants who deeply resonate with these principles and embody them in their work.

• Integrity: Tell the truth. We do not brag. We do not make commitments lightly. Once we make a commitment, we devote ourselves completely to meeting that commitment.
• Commitment: Employees are dedicated to the company, view the company’s success as their own and work diligently to make their best contributions. As commitment is mutual, the Company strives to serve the best interests of its employees.
• Innovation: Innovation is the wellspring of the Company's growth. It means more than new ideas; it means putting ideas into practice.
• Customer Trust: We strive to build deep and enduring relationships with our customers, who trust and rely on us to be part of their success over the long term.

(For more details on TSMC’s Core Values, please visit：https://www.tsmc.com/english/aboutTSMC/values)