SkyPilot

Run AI Workloads on Any Cloud with Hugging Face Storage: Zero Egress via SkyPilot

Hugging Face and SkyPilot have joined forces, allowing models and datasets to be stored on the Hugging Face Hub while compute tasks run on any cloud or cluster. The new integration via the hf:// scheme provides data mounting without egress fees for reads, simplifying the use of GPUs from different providers without data duplication.

Hugging Face