Customer Engineer, Infrastructure

Anyscale; San Francisco (CA); Sur place; USD 180 000 - 230 000; Plein temps

Avantages offerts par ce poste

Competitive salary and equity

Health/dental/vision coverage

Flexible time off

Paid parental leave

Mental health support

Résumé du poste

Anyscale is seeking a Customer Engineer in San Francisco to guide post-sale onboarding, adoption, and growth for customers using Ray. You will troubleshoot and resolve tickets, collaborate with engineering on complex issues, and act as a trusted technical advisor across accounts.

The role emphasizes ML/AI, LLM, vLLM, and working in a fast-paced, collaborative environment to drive consumption and customer success.

Qualifications

• 7+ years of ML experience in a dynamic startup-like environment.
• Strong ability to develop data pipelines for training, fine-tuning and inference/serving of LLMs.
• Experience managing ML infra across AWS/GCP/Azure.
• Excellent communication and interpersonal skills.
• Willingness to mentor peers and up-level teammates.

Responsabilités

• Resolve customer issues and drive successful adoption of Anyscale.
• Serve as a technical advisor and internal champion for key customers.
• Own customer issues end-to-end from triage to resolution.
• Support follow-the-sun model for high-priority tickets.
• Contribute to internal tools, playbooks, and best practices.
• Collaborate with product and engineering to improve the product experience.
• Build strong relationships with technical stakeholders within customer accounts.

Connaissances

Machine Learning

Data pipelines

Cloud platforms

Communication

Mentorship

Troubleshooting

Outils

Kubernetes

Terraform

Github Actions

Ray

Description du poste

About Anyscale

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the role

The Customer Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.

Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space.

In this role, you’ll be able to

• Resolve customer issues and help in their successful adoption of Anyscale platform
• Be a technical advisor, and internal champion for our key customers
• Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution
• Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets
• Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution
• Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns
• Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience
• Build and maintain strong relationships with technical stakeholders within customer accounts

Qualifications

• 7+ years of experience in a Machine Learning role in a dynamic, fast-paced, startup-like environment
• Strong organizational skills and ability to manage multiple customer needs simultaneously
• Proficient at developing data pipelines for training, fine-tuning and inference/serving of LLMs
• Experience running and optimizing infrastructure for distributed ML workloads on the major cloud platforms (AWS/EKS, GCP/GKE or Azure/AKS)
• Excellent communication and interpersonal skills.
• Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things
• Willingness to up-level the knowledge and skills of your peers through mentorship, trainings and shadowing

Bonus

• Experience with Ray
• Knowledge of MLOps platforms
• Knowledge of container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), CI/CD tools (e.g. Github Actions)

Why Anyscale

• We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
• Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
• We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
• Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
• Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
• We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.