How to use from the
Use from the
PEFT library
Task type is invalid.

Code2LoRA โ€” direct-projection hypernetwork

Final checkpoint of the direct-projection Code2LoRA hypernetwork used in the paper. Maps a repository-level embedding into a rank-16 LoRA adapter for Qwen/Qwen2.5-Coder-1.5B in a single forward pass.

Files

File Description
code2lora_direct.pt Trained Code2LoRAHead weights (~2.7 GB, fp32). Loaded with torch.load(map_location="cpu").

Training recipe

  • 3 epochs on the code2lora/code2lora-data-snapshots dataset.
  • AdamW + cosine schedule, max-seq-len 8192, bf16, single H100 80 GB.
  • See code2lora/code2lora for the trainer code.

Companion model

code2lora/code2lora-gru -- the streaming-recurrent variant trained on commit deltas.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support