2-stage pruning to favor distributed inference (local device compute half of the model, upload the feature for further computing on stronger devices or cloud).
-
Updated
May 31, 2018 - Python
#
distributed-inferencing
Here are 3 public repositories matching this topic...
ShadowSWARM is a streamlined framework for setting up a multi-node, GPU-accelerated, distributed system for PyTorch workloads using Docker Swarm
-
Updated
Jan 14, 2025 - Shell
An adaptive AI task partitioning and offloading framework for distributed DNN inference across Raspberry Pi, laptop, and GPU desktop nodes, optimizing energy consumption and latency in a heterogeneous end-edge-cloud environment.
iot internet-of-things edge-computing computing-continuum distributed-inferencing dnn-partitioning task-oflloading
-
Updated
Jun 10, 2026 - Python
Improve this page
Add a description, image, and links to the distributed-inferencing topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the distributed-inferencing topic, visit your repo's landing page and select "manage topics."