Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

A hyperparameter optimization framework

Modin: Scale your Pandas workflows by changing a single line of code

Redis-based components for Scrapy.

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Lingvo

Fast job queuing and RPC in python with asyncio and redis.

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Distributed ML Training and Fine-Tuning on Kubernetes

Official Implementation of 'Fast AutoAugment' in PyTorch.

MLBox is a powerful Automated Machine Learning python library.

[unmaintained] An open-source convolutional neural networks platform for research in medical image analysis and image-guided therapy

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Making data lake work for time series

TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"

Redis for humans. 🌎🌍🌏

Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.

The Runhouse Python client. Distribute and run AI workloads magically in Python, like PyTorch for ML infra.