Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ license: mit
5
+ ---
6
+
7
+ # GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models
8
+
9
+ This repository contains the model checkpoint for **GDSD** (Guided Denoiser Self-Distillation), as introduced in the paper [GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models](https://huggingface.co/papers/2605.29398).
10
+
11
+ GDSD is a reinforcement learning (RL) framework designed to improve the denoiser of diffusion large language models (dLLMs). It reduces RL to a likelihood-free self-distillation objective by matching the dLLM's denoiser logits to an advantage-guided self-teacher. This approach bypasses the training–inference mismatch (TIM) biases common in ELBO-based methods and leads to more stable training dynamics.
12
+
13
+ ## Resources
14
+
15
+ - **Paper:** [GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models](https://arxiv.org/abs/2605.29398)
16
+ - **GitHub Repository:** [GaryBall/GDSD](https://github.com/GaryBall/GDSD)
17
+
18
+ ## Citation
19
+
20
+ If you find GDSD helpful, please consider citing the following work:
21
+
22
+ ```bibtex
23
+ @misc{tang2026gdsdreinforcementlearningguided,
24
+ title={GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models},
25
+ author={Xiaohang Tang and Keyue Jiang and Che Liu and Qifang Zhao and Xiaoxiao Xu and Sangwoong Yoon and Ilija Bogunovic},
26
+ year={2026},
27
+ eprint={2605.29398},
28
+ archivePrefix={arXiv},
29
+ primaryClass={cs.LG},
30
+ url={https://arxiv.org/abs/2605.29398},
31
+ }
32
+ ```