Add model card and robotics tag

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +31 -2
README.md CHANGED
@@ -1,9 +1,38 @@
1
  ---
2
  library_name: transformers
3
- tags: []
4
  ---
5
 
6
- # Cite it
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
8
  ```bibtex
9
  @article{li2026shadowpeft,
 
1
  ---
2
  library_name: transformers
3
+ pipeline_tag: robotics
4
  ---
5
 
6
+ # ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
7
+
8
+ [ShadowPEFT](https://huggingface.co/papers/2604.19254) is a parameter-efficient fine-tuning (PEFT) framework that augments a frozen large base model with a lightweight, centralized, and detachable *Shadow* network. Unlike standard LoRA-style adapters, ShadowPEFT performs layer-level refinement through a depth-shared shadow module. This design allows the shadow module to be architecturally decoupled from the backbone, enabling it to be trained and deployed as a standalone component, which is particularly beneficial for edge computing and robotics.
9
+
10
+ - **Paper:** [ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning](https://huggingface.co/papers/2604.19254)
11
+ - **Repository:** [https://github.com/ShadowLLM/shadow-peft](https://github.com/ShadowLLM/shadow-peft)
12
+
13
+ ## Sample Usage
14
+
15
+ To use this shadow model, first install the `shadow-peft` library:
16
+
17
+ ```bash
18
+ pip install shadow-peft
19
+ ```
20
+
21
+ Then, you can load the pre-trained projected shadow model using the following code:
22
+
23
+ ```python
24
+ from shadow_peft import AutoModelForCausalLMWithHiddenProjection
25
+
26
+ # Load the pre-trained projected shadow model
27
+ shadow_model = AutoModelForCausalLMWithHiddenProjection.from_pretrained(
28
+ "shadow-llm/Qwen3-0.6B-H8B",
29
+ freeze_backbone=False, # keep backbone trainable (default)
30
+ freeze_embed_tokens=True, # freeze input embeddings (default)
31
+ freeze_lm_head=True, # freeze lm_head (default)
32
+ )
33
+ ```
34
+
35
+ ## Citation
36
 
37
  ```bibtex
38
  @article{li2026shadowpeft,