Staff Machine Learning Engineer - ML Frameworks

Adobe Inc.; San Jose (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Adobe Inc. is seeking a senior AI/ML infrastructure engineer to advance the Firefly training and deployment platform.

You will design robust systems using Kubernetes on AWS, optimize distributed training, and collaborate with data scientists and researchers to accelerate experimentation. You bring a PhD or Masters in CS and 5+ years of industry experience, with strong Python skills, GPU resource management, and distributed PyTorch expertise.

Qualifications

• PhD or Masters in computer science or related field; 5+ years industry experience.
• Proficiency with Python and building systems, frameworks, and SDKs.
• Experience with GPU resource management, training orchestration.
• Experience with ML and distributed PyTorch.
• Strong analytical, problem-solving, and quantitative skills.
• Excellent communication and teamwork.

Responsibilities

• Design, develop, and maintain robust AI/ML infrastructure for training and deployment of large-scale models on AWS using Kubernetes and Python.
• Improve distributed training performance and scalability with GPUs; support FSDP and model parallelism.
• Scale orchestration and scheduling, accelerate AutoML experiments and similar.
• Collaborate with data scientists and ML researchers to optimize the training pipeline and resource utilization.
• Drive infrastructure innovation to support pioneering ML research and development.

Skills

Python

Distributed training

Model serving

Analytical skills

Communication

Education

PhD or Master’s in CS

Tools

Kubernetes

AWS

PyTorch

Job description

The Opportunity

Firefly is the new family of creative generative AI models coming to Adobe products that offers a new way to conceptualize, build, and scale content.

It's a natural extension of the technology Adobe has produced over the past 40 years.

At the core of Firefly are our commercially safe AI models trained on hundreds of millions of images owned or licensed by Adobe. We are hiring for a highly strategic and visible role to help evolve these models. This is an opportunity to reach millions of creatives, helping them reinvent the way they work.

What you will Do

• Design, develop, and maintain robust AI/ML infrastructure solutions to support the training and deployment of large-scale AI models, using Kubernetes and Python on AWS cloud
• Implement and improve distributed training frameworks leveraging GPUs to improve performance and scalability. Improve resiliency, elasticity, data loading and provide out-of-the-box support for FSDP and model parallelism
• Help train better models by improving orchestration and scheduling, scaling the number of jobs, faster experimentation with AutoML and similar
• Collaborate with data scientists and ML researchers to streamline the model training pipeline and ensuring efficient resource utilization
• Drive innovation in infrastructure practices to support pioneering machine learning research and development

What you need to succeed

• PhD or Master's in computer science or related field and 5+ years of hands-on industryexperience
• Proven proficiency with Python and developing systems, frameworks and SDKs
• Experience with infrastructure and understanding of model serving, training, orchestration, and management of GPU resources
• Experience with machine learning and distributed Pytorch
• Strong critical thinking, analytical and quantitative problem-solving ability
• Excellent communication, relationship skills and a strong teammate

While not required, it's an added plus if you also have:

• Experience with KubeFlow, MLFlow, Ray, SageMaker, or similar
• Experience with Pyt orch distributed, MPI, Megatron, Horovod and other AI training frameworks

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe's industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We're on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours.

Let's Adobe together

At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us