Principal Technical Program Manager

Bazeta; United States; Remote; USD 170,000 - 210,000; Full time

Job summary

Microsoft’s Azure HPC & AI Infrastructure team seeks a Principal Technical Program Manager to lead AI networking architecture for large-scale AI training and inference workloads. You will define strategy, drive multi-year roadmaps, and collaborate with GPU platforms, datacenter ops, and suppliers to deliver high-performance networking across hyperscale systems.

The role requires deep technical leadership, cross-team coordination, and the ability to translate workload requirements into

Qualifications

• Bachelor’s Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience.
• 6+ years of experience managing cross-functional and/or cross-team projects.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.

Responsibilities

• Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure.
• Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
• Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
• Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
• Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
• Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
• Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
• Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.

Job description

# Principal Technical Program ManagerUnited States2 hours agoID 5521017Price on request## DetailsEmployment type: Full-timeRemote: YesCompany: Microsoft## DescriptionWork site: 0 days / week in-office – remote. United States, Multiple Locations. Overview The Azure HPC & AI Infrastructure team defines and delivers the systems that power some of the world’s largest AI training and inference workloads. As Microsoft continues to expand the scale and sophistication of its AI infrastructure, networking is a key defining technology determining system performance, reliability, efficiency, and speed of deployment. We are seeking a Principal Technical Lead for AI Infrastructure Networking to provide technical leadership for the networking architectures that connect GPU and accelerated computing infrastructure. This role will help deliver the next generation of networking capabilities behind Microsoft’s AI infrastructure, spanning technologies including InfiniBand, RDMA, high-performance Ethernet, network interface devices, switches, optics, and emerging AI interconnect architectures. This is a highly cross-functional technical leadership role operating at the intersection of AI systems architecture, networking, GPU platforms, datacenter infrastructure, software, operations, and silicon and networking suppliers. The successful candidate will define technical strategy, shape architecture and roadmap decisions, and drive complex infrastructure programs from early technology evaluation through qualification, deployment, and operation at hyperscale. The role requires both deep technical expertise and the ability to operate effectively in highly ambiguous environments where technology, business requirements, and customer demand are evolving rapidly. You will work with senior engineering and product leaders across Microsoft as well as strategic technology partners to make decisions that influence the performance, reliability, scalability, and economics of Microsoft’s AI infrastructure. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities • Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure. Use fleet telemetry, performance analysis, customer signals, and operational incidents to identify systemic improvements and influence future architecture and product investments. • Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions. • Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency. • Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies. • Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations. • Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments. • Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost. • Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency. Qualifications Required qualifications • Bachelor’s Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience. • 6+ years of experience managing cross-functional and/or cross-team projects. Other requirements • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. Preferred qualifications • Bachelor’s Degree AND 15+ years experience engineering, product/technical program management, data analysis, or product development OR equivalent experience. • 10+ years of experience managing cross-functional and/or cross-team projects. • 6+ year(s) experience designing, developing, deploying, or operating distributed large-scale datacenter, cloud, HPC, accelerated computing, or AI infrastructure. • 6+ year(s) deep technical experience with high-performance networking technologies such as InfiniBand, Ethernet, RDMA/RoCE, network interface devices, switches, routing and switching architectures, congestion management, optics, or high-speed interconnects. • 6+ year(s) experience evaluating complex system architectures and translating workload requirements into technical requirements, architecture decisions, and executable engineering plans.... Source: Jobspresso (https://jobspresso.co/job/principal-technical-program-manager/)This listing comes from a partner feed. Apply on the source website.