AI Framework Software Engineer - vLLM

Intel Corporation; Prescott (AZ); On-site; USD 45,000 - 81,000; Full time

Job summary

Intel Corporation in Shanghai seeks an AI Frameworks Engineer to design and optimize AI software, contributing to distributed algorithms and improving performance across hardware backends.

You will collaborate with researchers, implement model/data parallelism, and enhance AI stacks such as vLLM and PyTorch while supporting open-source initiatives.

Qualifications

• Master's degree or bachelor with 2+ years of domain experience is required.
• Proficiency in Python and C++ is required.
• Foundational knowledge of AI frameworks such as vLLM and PyTorch is expected.
• Ability to debug and optimize software for performance is essential.

Responsibilities

• Design, develop, and optimize AI frameworks for high-performance applications.
• Implement distributed algorithms including model/data parallelism and asynchronous data communication.
• Transform computational graphs and develop ML primitives in mathematical libraries.
• Profile distributed DL models to identify bottlenecks and propose improvements.
• Collaborate with DL researchers to integrate advancements into AI frameworks.
• Contribute to open-source projects and ensure compliance with industry standards.

Skills

Python

C++

AI frameworks

Deep learning concepts

Debugging

English communication

Open-source collaboration

Education

Master's degree in Computer Science

Bachelor's degree with 2+ years experience

Tools

vLLM

PyTorch

Open-source ecosystems

GPU architectures

Job description

Job Details:

Job Description:

The Role and Impact: As an AI Frameworks Engineer, you will play an integral role in designing and optimizing cutting-edge artificial intelligence software and frameworks. You will contribute to developing distributed algorithms, enhancing deep learning models, and improving AI software performance across diverse hardware backends. By collaborating with researchers and engineers, your work will directly influence Intel's ability to deliver advanced AI solutions, enabling transformative capabilities in the field of artificial intelligence.

Business group:

This role is part of Intel's Artificial Intelligence engineering group, a team dedicated to developing innovative AI software solutions and frameworks that enhance performance and efficiency across Intel products. The group focuses on advancing AI technologies and creating impactful solutions that empower customers and drive Intel's leadership in the AI industry.

Key Responsibilities:

• Design, develop, and optimize AI frameworks such as vLLM and PyTorch for high-performance applications.
• Implement distributed algorithms, including model/data parallel frameworks and asynchronous data communication in machine learning and deep learning systems.
• Transform computational graph representations of neural network models and develop machine learning primitives in mathematical libraries.
• Profile distributed deep learning models to identify bottlenecks and propose performance-enhancing solutions.
• Collaborate with deep learning researchers to integrate advancements into AI frameworks.
• Contribute to open-source projects, ensuring compliance with industry standards and delivering impactful innovations.

Qualifications:

Minimum Qualifications:

• Master degree of Computer Science or bachelor degree with at least 2 years of domain working experience.
• Proficiency in Python and C++ programming languages.
• Foundational knowledge of AI frameworks such as vLLM, PyTorch and deep learning concepts.
• Demonstrated ability to debug and optimize software for performance.

Preferred Qualifications:

• Familiarity with performance optimization technologies and techniques.
• Experience working with large language models and related inference stacks.
• Background in contributing to open-source projects or collaborating within open-source ecosystems.
• Strong problem-solving skills and ability to analyze complex technical challenges.
• Effective communication skills, including proficiency in written and spoken English.
• Familiarity with the GPU architecture and concepts is a big plus

Join Intel to explore the forefront of AI innovation, make meaningful contributions to the field, and collaborate with industry leaders to shape the future of artificial intelligence.

Job Type:

College Grad

Shift:

Shift 1 (China)

Primary Location:

PRC, Shanghai

Posting Statement:

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust

N/A

Work Model for this Role

Job posting details (such as work model, location or time type) are subject to change.

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.