shadow-peft-models
Collection
pretrained weights and data for the ShadowPEFT paper โข 30 items โข Updated โข 4
Theoretically, it can. But the current version does not support multiple shadows.
Thx for following! @cahlen
For reproduction, we public the scripts and hyperparameters used in the paper:
https://github.com/ShadowLLM/shadow-peft/blob/main/experiment/best_script.md
Here is a playground that shows how the detached and attached shadow work:
https://github.com/ShadowLLM/shadow-peft/blob/main/examples/robot_intent_playground.ipynb