TalalWasim commited on
Commit
32e30bb
·
verified ·
1 Parent(s): ca2004b

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/eval_20260718_092843.log +0 -0
  2. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/eval_results.jsonl +0 -0
  3. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/fast_eval.tsv +0 -0
  4. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/eval_20260718_094415.log +0 -0
  5. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/eval_results.jsonl +0 -0
  6. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/fast_eval.tsv +0 -0
  7. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/eval_20260718_083412.log +0 -0
  8. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/eval_results.jsonl +0 -0
  9. runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/fast_eval.tsv +0 -0
  10. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/eval_20260718_080038.log +0 -0
  11. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/eval_results.jsonl +0 -0
  12. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/fast_eval.tsv +0 -0
  13. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/eval_20260718_081606.log +0 -0
  14. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl +0 -0
  15. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv +0 -0
  16. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/eval_20260718_070720.log +0 -0
  17. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/eval_results.jsonl +0 -0
  18. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/fast_eval.tsv +0 -0
  19. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/eval_20260718_050453.log +0 -0
  20. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/eval_results.jsonl +0 -0
  21. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/fast_eval.tsv +0 -0
  22. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/hybrid/eval_results.jsonl +0 -0
  23. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/hybrid/fast_eval.tsv +0 -0
  24. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/slow/eval_results.jsonl +0 -0
  25. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/slow/fast_eval.tsv +0 -0
  26. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/eval_20260718_063245.log +0 -0
  27. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/eval_results.jsonl +0 -0
  28. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/fast_eval.tsv +0 -0
  29. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/eval_20260718_064842.log +0 -0
  30. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/eval_results.jsonl +0 -0
  31. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/fast_eval.tsv +0 -0
  32. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/eval_20260718_053933.log +0 -0
  33. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/eval_results.jsonl +0 -0
  34. runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/fast_eval.tsv +0 -0
  35. runs_laq_lt/eval/cocolt_1ep_hires/summary.txt +112 -0
  36. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/eval_20260718_093618.log +0 -0
  37. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/eval_results.jsonl +0 -0
  38. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/eval_20260718_084032.log +0 -0
  39. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/eval_results.jsonl +0 -0
  40. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/fast_eval.tsv +0 -0
  41. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/eval_20260718_082201.log +0 -0
  42. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/eval_20260718_050702.log +0 -0
  43. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/eval_20260718_052310.log +0 -0
  44. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/eval_20260718_054145.log +0 -0
  45. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/fast/eval_results.jsonl +0 -0
  46. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/fast/fast_eval.tsv +0 -0
  47. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/hybrid/eval_results.jsonl +0 -0
  48. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/hybrid/fast_eval.tsv +0 -0
  49. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/slow/eval_results.jsonl +0 -0
  50. runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/slow/fast_eval.tsv +0 -0
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/eval_20260718_092843.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/eval_20260718_094415.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/eval_20260718_083412.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/legacy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/eval_20260718_080038.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/eval_20260718_081606.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/eval_20260718_070720.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_greedy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/eval_20260718_050453.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed0/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/eval_20260718_063245.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/eval_20260718_064842.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/eval_20260718_053933.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/coco/paper_seed1/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_1ep_hires/summary.txt ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ==============================================================================
2
+ EVAL SUMMARY | cocolt_1ep_hires
3
+ ==============================================================================
4
+
5
+ Metric: mean-over-IoU (fastevaluate). BPS = boxes/second, batch 1, 1 GPU.
6
+ fallback% = switch_to_ar / forward_steps (fraction of block-decisions; paper implies ~7-8%)
7
+
8
+ profile mode | F1 P R F1@.5 | BPS steps boxes fallb%
9
+ ---------------------------------------------------------------------------------
10
+ paper_seed0 slow | 53.2 55.7 50.8 72.2 | 2.71 67.5 7.06 0.0
11
+ paper_seed0 fast | 51.5 61.5 44.4 66.9 | 8.82 15.1 6.88 0.0
12
+ paper_seed0 hybrid | 52.7 62.4 45.6 68.2 | 8.00 18.2 6.97 4.8
13
+
14
+ paper_seed1 slow | 53.4 56.0 51.0 72.2 | 2.71 67.3 7.05 0.0
15
+ paper_seed1 fast | 51.5 61.4 44.4 66.9 | 8.75 15.1 6.88 0.0
16
+ paper_seed1 hybrid | 52.5 62.2 45.4 68.0 | 8.02 18.1 6.95 4.8
17
+
18
+ paper_greedy slow | 55.9 58.3 53.8 73.2 | 2.78 69.2 7.25 0.0
19
+ paper_greedy fast | 53.5 58.4 49.3 70.2 | 9.17 15.0 7.00 0.0
20
+ paper_greedy hybrid | 54.6 59.1 50.7 71.3 | 8.26 18.6 7.15 5.3
21
+
22
+ legacy slow | 55.9 58.3 53.8 73.2 | 2.77 69.2 7.25 0.0
23
+ legacy fast | 53.5 58.4 49.4 70.2 | 9.20 15.1 7.01 0.0
24
+ legacy hybrid | 54.6 59.0 50.7 71.3 | 8.22 18.6 7.15 5.2
25
+
26
+ paper is STOCHASTIC (nucleus sampling). Mean +/- half-spread over 2 seeds:
27
+ ---------------------------------------------------------------------------------
28
+ paper (mean) slow | F1 53.3+/-0.1 BPS 2.7+/-0.0 fallback% 0.0+/-0.0
29
+ paper (mean) fast | F1 51.5+/-0.0 BPS 8.8+/-0.0 fallback% 0.0+/-0.0
30
+ paper (mean) hybrid | F1 52.6+/-0.1 BPS 8.0+/-0.0 fallback% 4.8+/-0.0
31
+
32
+ -> a gap smaller than the spread is NOT evidence. Use paper_greedy
33
+ (deterministic) for tight comparisons.
34
+
35
+ INTEGRITY legacy/slow (55.93) vs paper_greedy/slow (55.93) -> OK (identical, as required)
36
+
37
+ B1 READ-OUT hybrid fallback rate (switch_to_ar/forward_steps): legacy 5.2% vs paper 4.8% (paper ~7-8%; the RELATIVE legacy>paper gap is the primary signal)
38
+ The 0.9 abnormality threshold is calibrated on the SHARPENED (T=0.7 +
39
+ top-p) distribution. Greedy's flatter softmax trips it far more often, so
40
+ legacy should be markedly higher. If they match, B1 has not taken effect.
41
+
42
+ ==============================================================================
43
+ PROMPT-SHAPE (n_cats) OOD -- profile: paper_greedy
44
+ ==============================================================================
45
+ Training chunks each image's categories into queries of 1..3. The eval set
46
+ asks for the image's FULL list, and 28.8% of eval queries have >3 categories
47
+ -- a prompt shape the model never saw. Caveat: images with more categories
48
+ also have more objects, so a drop may be difficulty, not novelty.
49
+
50
+ --- paper_greedy/slow ---
51
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
52
+
53
+ n_cats | N | F1 | P | R | F1@.5
54
+ --------------------------------------------------
55
+ 1 | 1025 | 74.0 | 78.3 | 70.1 | 86.0
56
+ 2 | 1522 | 67.1 | 69.3 | 65.0 | 82.5
57
+ 3 | 980 | 58.3 | 62.1 | 54.9 | 74.8
58
+ 4-5 | 935 | 54.9 | 58.6 | 51.6 | 72.7
59
+ 6+ | 490 | 50.4 | 54.3 | 47.0 | 68.5
60
+
61
+ n_cats | N | F1 | P | R | F1@.5
62
+ --------------------------------------------------
63
+ <=3 (IN) | 3527 | 62.3 | 64.8 | 59.9 | 78.1
64
+ >3 (OOD) | 1425 | 51.6 | 54.8 | 48.7 | 69.7
65
+
66
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
67
+ is real: training never showed the model a 4+-category query.
68
+ Careful: bigger images have more categories AND more objects, so a
69
+ small drop may just be task difficulty, not prompt-shape OOD.
70
+
71
+ --- paper_greedy/fast ---
72
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
73
+
74
+ n_cats | N | F1 | P | R | F1@.5
75
+ --------------------------------------------------
76
+ 1 | 1025 | 71.6 | 76.6 | 67.3 | 84.2
77
+ 2 | 1522 | 64.4 | 68.1 | 61.1 | 79.7
78
+ 3 | 980 | 55.5 | 60.7 | 51.2 | 72.1
79
+ 4-5 | 935 | 52.4 | 59.2 | 47.1 | 69.3
80
+ 6+ | 490 | 47.9 | 56.7 | 41.4 | 64.7
81
+
82
+ n_cats | N | F1 | P | R | F1@.5
83
+ --------------------------------------------------
84
+ <=3 (IN) | 3527 | 59.5 | 63.4 | 56.0 | 75.2
85
+ >3 (OOD) | 1425 | 49.1 | 56.0 | 43.7 | 66.0
86
+
87
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
88
+ is real: training never showed the model a 4+-category query.
89
+ Careful: bigger images have more categories AND more objects, so a
90
+ small drop may just be task difficulty, not prompt-shape OOD.
91
+
92
+ --- paper_greedy/hybrid ---
93
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
94
+
95
+ n_cats | N | F1 | P | R | F1@.5
96
+ --------------------------------------------------
97
+ 1 | 1025 | 73.3 | 78.6 | 68.6 | 86.0
98
+ 2 | 1522 | 66.0 | 69.4 | 62.9 | 81.4
99
+ 3 | 980 | 56.9 | 61.9 | 52.5 | 73.0
100
+ 4-5 | 935 | 53.2 | 59.5 | 48.1 | 70.3
101
+ 6+ | 490 | 48.4 | 56.8 | 42.1 | 65.2
102
+
103
+ n_cats | N | F1 | P | R | F1@.5
104
+ --------------------------------------------------
105
+ <=3 (IN) | 3527 | 61.2 | 64.8 | 57.9 | 76.7
106
+ >3 (OOD) | 1425 | 49.6 | 56.1 | 44.5 | 66.7
107
+
108
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
109
+ is real: training never showed the model a 4+-category query.
110
+ Careful: bigger images have more categories AND more objects, so a
111
+ small drop may just be task difficulty, not prompt-shape OOD.
112
+
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/eval_20260718_093618.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/eval_20260718_084032.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/eval_20260718_082201.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/eval_20260718_050702.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/eval_20260718_052310.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/eval_20260718_054145.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_native/coco/paper_seed1/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff