N8Programs commited on
Commit
38d3937
·
verified ·
1 Parent(s): 136c9c9

Add tentative BestTerm-440M model card

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: N8Programs/NextTerm-440M
4
+ tags:
5
+ - qwen3
6
+ - oeis
7
+ - sequence-modeling
8
+ - slerp
9
+ ---
10
+
11
+ # BestTerm-440M Checkpoint
12
+
13
+ Tentative checkpoint for `BestTerm-440M`.
14
+
15
+ This is a global parameter-vector SLERP between the released `N8Programs/NextTerm-440M` base model and the hot b-file-only continued-pretraining checkpoint at 500M tokens, with interpolation `t=0.80`.
16
+
17
+ ## Quick Scores
18
+
19
+ Ryskina & Knight sequence completion, exact next-term accuracy:
20
+
21
+ - Greedy, old PyTorch/Transformers sanity path: `38/57` (`66.67%`).
22
+ - Beam search, `num_beams=4`, comma stop and EOS/PAD suppressed: `40/57` (`70.18%`).
23
+
24
+ Other preservation checks from the same sweep:
25
+
26
+ - OEIS-Eval-Neo: `6532/19034` (`34.318%`).
27
+ - M1 Competition 111 macro MAPE: `17.582548`.
28
+ - Polynomial continuation: arithmetic `94.5625%`, quadratic `86.3043%`, cubic `74.5682%`, quartic `67.9524%`.
29
+
30
+ ## Notes
31
+
32
+ This checkpoint is tentative and was selected as the aggressive Ryskina/M1 point on the base-to-hot500 SLERP sweep. The more conservative preservation point was `t=0.60`.