Software Engineer (Ray Data)

Carbon Data Solutions; San Francisco (CA); On-site; USD 150,000 - 195,000; Full time

Job summary

Anyscale is seeking a software engineer for the Ray Data team to scale data processing pipelines and inference workloads across diverse environments, from laptops to clusters.

You will optimize performance, ensure fault tolerance, and collaborate with AI-native companies to deploy scalable ML pipelines. The role requires 3–4 years of relevant experience and a strong background in distributed systems and data processing.

Qualifications

• 3-4 years of relevant work experience.
• Solid background in building scalable and fault-tolerant distributed systems.
• Experience with data processing, database internals.
• Passionate about large scale systems and performance for AI.

Responsibilities

• Improve the performance of Ray Data and multi-modal batch inference use cases.
• Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.
• Build data loading solutions for production training workloads.
• Focus on stability and fault tolerance at high scale.
• Work with customers and AI-native companies in scaling their AI workloads.

Skills

Distributed systems

Data processing

Performance optimization

Python

Ray Data

Tools

Ray Data

Python

Job description

About Anyscale

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About Ray Data Team

Ray Data is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.

The Ray Data team currently develops and maintains Ray Data. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.

As part of this role, you will:

• Improve the performance of Ray Data and multi-modal batch inference use cases.
• Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.
• Building data loading solutions for production training workloads.
• Focus on stability and fault tolerance at high scale
• Working with customers and new age AI native companies in scaling their AI workloads.

We'd love to hear from you if have:

• At least 3-4 years of relevant work experience
• Solid background in building scalable and fault-tolerant distributed systems
• Experience with data processing, database internals.
• Passionate about large scale systems and performance for AI.

Why Anyscale

• We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
• Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
• We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
• Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
• Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
• We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish