Staff Machine Learning Engineer - ML Frameworks

Adobe; San Jose (CA); On-site; USD 212,000 - 307,000; Full time

Job summary

Adobe is seeking a senior AI/ML infrastructure engineer to design, build and optimize scalable training and deployment systems for Firefly, leveraging Kubernetes, Python, and AWS cloud services.

You will collaborate with researchers to improve orchestration, scheduling, and resource utilization, while advancing training pipelines and model serving on GPU resources.

Qualifications

• PhD or Master’s in computer science or related field required.
• Proven proficiency with Python and developing systems, frameworks and SDKs.
• Experience with infrastructure, model serving, training orchestration and GPU resource management.
• Experience with machine learning and distributed PyTorch.
• Strong analytical, problem-solving and quantitative skills.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, develop, and maintain AI/ML infrastructure for large-scale models using Kubernetes and Python on AWS.
• Implement and improve distributed training frameworks to enhance performance and scalability.
• Improve resiliency, data loading, and support for FSDP and model parallelism.
• Scale jobs and accelerate experiments with AutoML and related tooling.
• Collaborate with data scientists and ML researchers to optimize training pipelines and resource usage.
• Drive innovative infrastructure practices to support cutting-edge ML research.

Skills

Python programming

Distributed PyTorch

Analytical skills

Communication skills

Team collaboration

Education

PhD or Master’s in Computer Science or related field

Tools

KubeFlow

MLFlow

Ray

SageMaker

MPI

Megatron

Horovod

Job description

The Opportunity

Firefly is the new family of creative generative AI models coming to Adobe products that offers a new way to conceptualize, build, and scale content. It’s a natural extension of the technology Adobe has produced over the past 40 years. At the core of Firefly are our commercially safe AI models trained on hundreds of millions of images owned or licensed by Adobe. We are hiring for a highly strategic and visible role to help evolve these models. This is an opportunity to reach millions of creatives, helping them reinvent the way they work.

What you will Do

• Design, develop, and maintain robust AI/ML infrastructure solutions to support the training and deployment of large-scale AI models, using Kubernetes and Python on AWS cloud
• Implement and improve distributed training frameworks leveraging GPUs to improve performance and scalability
• Improve resiliency, elasticity, data loading and provide out-of-the-box support for FSDP and model parallelism
• Help train better models by improving orchestration and scheduling, scaling the number of jobs, faster experimentation with AutoML and similar
• Collaborate with data scientists and ML researchers to streamline the model training pipeline and ensuring efficient resource utilization
• Drive innovation in infrastructure practices to support pioneering machine learning research and development

What you need to succeed

• PhD or Master’s in computer science or related field and 5+ years of hands-on industry experience
• Proven proficiency with Python and developing systems, frameworks and SDKs
• Experience with infrastructure and understanding of model serving, training, orchestration, and management of GPU resources
• Experience with machine learning and distributed Pytorch
• Strong critical thinking, analytical and quantitative problem-solving ability
• Excellent communication, relationship skills and a strong teammate
• While not required, it’s an added plus if you also have:
• Experience with KubeFlow, MLFlow, Ray, SageMaker, or similar
• Experience with Pytorch distributed, MPI, Megatron, Horovod and other AI training frameworks

#FireflyGenAI

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity. Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let’s Adobe together At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create. Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more. Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email [e-mail]. AI Use Guidelines for Interviews: Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process. At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.

Expected Pay Range

Expected Pay Range: Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $172,500 -- $306,625 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $211,800 - $306,625 In Washington, the pay range for this position is $201,000 - $291,150 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP). In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

State-Specific Notices

California: Fair Chance Ordinances Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances. Colorado: Application Window Notice If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs. Massachusetts: Massachusetts Legal Notice It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Equal Employment Opportunity and Accessibility

Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email [e-mail].