Job Description
About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
About the role:
Anyscale is looking for a strong Engineering Leader to manage the Ray Core (Core Runtime) team, which includes both the open source Ray distributed computing framework, and proprietary features. We are looking for candidates with experience to manage through managers or tech leads.
As an open source project, Ray is about making general purpose distributed computing easy, and Ray Core is the fundamental architecture behind this “infinite laptop” mission. The Ray Core team is responsible for developing this core distributed computing framework (with basic abstractions of Tasks, Actors, Objects) to support Ray developers, and other Ray libraries (e.g. Datasets, ML libraries). The work also includes adding proprietary features to make the Anyscale SaaS offering more competitive. The work will be essential in our path towards Ray 2.0, and also in the next phase of the Anyscale product.
You can learn more about Ray Core with these materials:
- Our research papers on NSDI ‘21 and HotOS ‘21 describing the architectural vision of a Distributed Futures system
- How Ray Core’s flexible scheduling and shared data plane enable high performance in third generation ML platforms
In this position, you will guide the vision, recruit, and enable a high-performing team. This team is critical to everything that Anyscale and Ray achieve and will play a pivotal role in the success of the company.
