Software Development Engineer - Agentic AI / ML Infrastructure

Experis Technology Group; California; Remote; USD 90,000 - 115,000; Full time

Job summary

ManpowerGroup, through its Experis division, seeks a Software Development Engineer focused on AI/ML infrastructure. You will own end-to-end Python systems, build LL-powered workflows, and debug distributed GPU workloads at scale.

You'll work with PyTorch ecosystems, ROCm tooling, and production-grade tooling, contributing to production pipelines, CI, and evidence-backed reporting while partnering with leads and client teams in a fast-paced environment.

Qualifications

• Bachelor's degree or higher in CS/EE or related field; equivalent practical experience accepted.
• 10+ years of professional software engineering, including 5+ years developing production Python systems at scale.
• Distributed ML training or inference on GPU clusters, including multi-node jobs and log/metric correlation.
• Strong hands-on experience with PyTorch and production familiarity with Megatron-LM, DeepSpeed, TorchTitan, vLLM.
• ML debugging and performance engineering across throughput, memory, numerical stability and profiling.

Responsibilities

• Architect and implement Python agent frameworks, including tool adapters, orchestration loops, and production-ready interfaces.
• Build LLM-powered workflows with bounded prompts, allowlisted tools, structured JSON outputs, and evidence-backed reporting.
• Integrate agents with AMD GPU and ML ecosystem (ROCm, PyTorch, distributed training/inference stacks, profilers, logs).
• Own quality and evaluation infrastructure: tests, JSON Schema validation, regression suites, accuracy metrics, CI integration.
• Address ML ops challenges on training and inference clusters, including multi-node failure analysis and performance regression investigations.

Skills

Distributed ML training

Python production systems

GPU clusters

End-to-end ownership

CI integration

Education

Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or related field

Tools

PyTorch

Megatron-LM

DeepSpeed

TorchTitan

vLLM

Job description

Our client is seeking a Software Development Engineer to join their team. As a Software Development Engineer, you will be part of a senior individual contributor effort supporting agentic AI / ML infrastructure work across the software stack. The ideal candidate will have a strong drive to deliver production-grade Python systems, the ability to debug distributed GPU workloads with evidence-based analysis, and the confidence to own complex components end-to-end while collaborating with technical leads and partner teams.

Job Title: Software Development Engineer - AI / ML

Location: California, CA (Remote)

Pay Range: $90

Visa sponsorship not available

What's the Job?

Architect and implement Python agent frameworks, including tool adapters, orchestration loops, structured outputs, session handling, and production-ready CLI or service interfaces. Build LLM-powered workflows using frameworks such as LiteLLM, DSPy, or equivalent, with bounded prompts, allowlisted tools, budget caps, structured JSON outputs, and evidence-backed reporting. Integrate agents with the AMD GPU and ML software ecosystem, including ROCm tooling, PyTorch, distributed training and inference stacks, profilers, cluster metrics, log pipelines, and debug utilities. Own quality and evaluation infrastructure, including fixture-driven tests, JSON Schema validation, regression suites, accuracy metrics, and CI integration prior to rollout. Solve ML operations challenges on training and inference clusters, including multi-node failure analysis, performance regression investigation, configuration and launch issues, and operational automation.

What's Needed?

• Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field; equivalent practical experience accepted.
• 10+ years of professional software engineering experience, including 5+ years developing production Python systems at scale.
• Deep experience with distributed ML training or inference on GPU clusters, including multi-node jobs, collective communication failures, and log/metric correlation across ranks and nodes.
• Strong hands-on experience with PyTorch and production familiarity with large-scale stacks such as Megatron-LM, DeepSpeed, TorchTitan, vLLM, or equivalent.
• Proven ML debugging and performance engineering experience across throughput regressions, memory errors, numerical instability, misconfiguration, and profiler/trace analysis.

What's in it for me?

• Opportunity to build production-grade intelligent agents that reduce manual toil in ML operations.
• Senior ownership of end-to-end components, from design and implementation to evaluation and rollout readiness.
• Hands-on impact across training and inference clusters, including distributed failure investigation and performance regression work.
• Collaboration with framework, performance, and field teams to incorporate feedback and iterate based on production and pilot learnings.
• Clear delivery expectations, including deployment-ready artifacts such as Docker/Kubernetes packaging, runbooks, and documentation.

Benefits

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay

About ManpowerGroup

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells. ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.