Remote Principal AI Infrastructure Networking Lead

Bazeta; United States; Remote; USD 170,000 - 210,000; Full time

Job summary

Microsoft’s Azure HPC & AI Infrastructure team seeks a Principal Technical Program Manager to lead AI networking architecture for large-scale AI training and inference workloads. You will define strategy, drive multi-year roadmaps, and collaborate with GPU platforms, datacenter ops, and suppliers to deliver high-performance networking across hyperscale systems.

The role requires deep technical leadership, cross-team coordination, and the ability to translate workload requirements into

Qualifications

• Bachelor’s Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience.
• 6+ years of experience managing cross-functional and/or cross-team projects.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.

Responsibilities

• Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure.
• Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
• Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
• Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
• Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
• Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
• Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
• Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.

Job description

Microsoft’s Azure HPC & AI Infrastructure team seeks a Principal Technical Program Manager to lead AI networking architecture for large-scale AI training and inference workloads. You will define strategy, drive multi-year roadmaps, and collaborate with GPU platforms, datacenter ops, and suppliers to deliver high-performance networking across hyperscale systems.

The role requires deep technical leadership, cross-team coordination, and the ability to translate workload requirements into