Software Developer jobs in United States
Software Engineer - AI System & Infrastructure
Huawei Technologies Canada Co., Ltd.
Technicien Informatique
Teledyne Technologies Incorporated
Connect with headhunters to apply for similar jobsSoftware Engineer - AI System & Infrastructure
Job summary
Join a forward-thinking company as an Engineer in the Intelligent Cloud Infrastructure Lab, where you will tackle the challenges of AI system scalability and performance. This role is pivotal in innovating technologies and architectures for next-generation cloud infrastructure. You'll lead projects to optimize AI infrastructure, ensuring high-performance designs that meet the demands of modern applications. Collaborate with diverse teams to deliver impactful solutions while contributing to a robust ecosystem. If you're passionate about cutting-edge technology and eager to make a difference, this opportunity is perfect for you.
Qualifications
- Master's or PhD in Computer Science or Engineering required.
- Experience in building large scale, high-performance systems essential.
Responsibilities
- Identify scalability and performance issues in AI systems.
- Collaborate with teams to enhance system scalability and performance.
Skills
Education
Tools
Huawei Canadahas an immediate 12-month contract opening foran Engineer.
About the team:
The Intelligent Cloud Infrastructure Lab aims to innovate technologies, algorithms, systems, and platforms for next-generation cloud infrastructure. The lab addresses scalability, performance, and resource utilization challenges in existing cloud services while preparing for future challenges with appropriate technologies and architectures. Additionally, the lab aims to understand industry dynamics and technology trends to create a robust ecosystem.
About the job:
Understand AI System and Infrastructure technology landscape, and identify scalability/performance issues or challenges of current LLM/multi-modal LLM systems
Initiate and charter innovation projects to build or re-architect AI infrastructure platform, and plan milestones accordingly
Provide/contribute a scalable and high-performance architecture design or re-design for the infrastructure system that is optimized for AI training and inferencing, which includes but not limited to cluster management and scheduling, LLM model deployment, elastic LLM as well as AI container cold/warm start-up optimization, and so on.
Collaborate with internal and external teams to deliver the project or project features that improve our overall system scalability and performance.
The target annual compensation (based on 2080 hours per year) ranges from $78,000 to $168,000 depending on education, experience and demonstrated expertise.
About the ideal candidate:
Master/PhD degree in Computer Science, Computer Engineering
Experience in building large scale and high-performance distributed system
Experience in Nvidia TensorRT and/or Triton servers. Experience in container virtualization technologies
Knowledge & experience in distributed system design & development, including serverless technologies
Work experience in one or more of the following technologies: vLLM, Ray, SGLang, Kubernetes, TensorRT-LLM, Pytorch framework, Cuda libraries, GPU technologies
Work experience in one or more of the following programming languages: C/C++, Go, Java, Rust, python, C#.
Have excellent interpersonal and communication skills to collaborate with multiple teams and build strong partnerships effectively.
Demonstrated success working on software engineering problems that span multiple products
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.
job faster
Follow us
