Instructions to use shadow-llm/robot-dog-detached-shadow with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use shadow-llm/robot-dog-detached-shadow with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLMWithHiddenProjection model = AutoModelForCausalLMWithHiddenProjection.from_pretrained("shadow-llm/robot-dog-detached-shadow", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add model card and robotics tag
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,9 +1,38 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
-
|
| 4 |
---
|
| 5 |
|
| 6 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
| 8 |
```bibtex
|
| 9 |
@article{li2026shadowpeft,
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
---
|
| 5 |
|
| 6 |
+
# ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
|
| 7 |
+
|
| 8 |
+
[ShadowPEFT](https://huggingface.co/papers/2604.19254) is a parameter-efficient fine-tuning (PEFT) framework that augments a frozen large base model with a lightweight, centralized, and detachable *Shadow* network. Unlike standard LoRA-style adapters, ShadowPEFT performs layer-level refinement through a depth-shared shadow module. This design allows the shadow module to be architecturally decoupled from the backbone, enabling it to be trained and deployed as a standalone component, which is particularly beneficial for edge computing and robotics.
|
| 9 |
+
|
| 10 |
+
- **Paper:** [ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning](https://huggingface.co/papers/2604.19254)
|
| 11 |
+
- **Repository:** [https://github.com/ShadowLLM/shadow-peft](https://github.com/ShadowLLM/shadow-peft)
|
| 12 |
+
|
| 13 |
+
## Sample Usage
|
| 14 |
+
|
| 15 |
+
To use this shadow model, first install the `shadow-peft` library:
|
| 16 |
+
|
| 17 |
+
```bash
|
| 18 |
+
pip install shadow-peft
|
| 19 |
+
```
|
| 20 |
+
|
| 21 |
+
Then, you can load the pre-trained projected shadow model using the following code:
|
| 22 |
+
|
| 23 |
+
```python
|
| 24 |
+
from shadow_peft import AutoModelForCausalLMWithHiddenProjection
|
| 25 |
+
|
| 26 |
+
# Load the pre-trained projected shadow model
|
| 27 |
+
shadow_model = AutoModelForCausalLMWithHiddenProjection.from_pretrained(
|
| 28 |
+
"shadow-llm/Qwen3-0.6B-H8B",
|
| 29 |
+
freeze_backbone=False, # keep backbone trainable (default)
|
| 30 |
+
freeze_embed_tokens=True, # freeze input embeddings (default)
|
| 31 |
+
freeze_lm_head=True, # freeze lm_head (default)
|
| 32 |
+
)
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
## Citation
|
| 36 |
|
| 37 |
```bibtex
|
| 38 |
@article{li2026shadowpeft,
|