TalalWasim commited on
Commit
ca2004b
·
verified ·
1 Parent(s): 9822cca

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. runs_laq_lt/eval/cocolt_1ep_native/coco/legacy/slow/eval_20260718_084605.log +0 -0
  2. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/fast_eval.tsv +0 -0
  3. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/eval_20260718_095209.log +0 -0
  4. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/eval_results.jsonl +0 -0
  5. runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/fast_eval.tsv +0 -0
  6. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/eval_20260718_080610.log +0 -0
  7. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/eval_results.jsonl +0 -0
  8. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/fast_eval.tsv +0 -0
  9. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl +0 -0
  10. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv +0 -0
  11. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/eval_20260718_071101.log +0 -0
  12. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/eval_results.jsonl +0 -0
  13. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/fast_eval.tsv +0 -0
  14. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/eval_results.jsonl +0 -0
  15. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/fast_eval.tsv +0 -0
  16. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/eval_results.jsonl +0 -0
  17. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/fast_eval.tsv +0 -0
  18. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/eval_20260718_041228.log +0 -0
  19. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/eval_results.jsonl +0 -0
  20. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/fast_eval.tsv +0 -0
  21. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/eval_20260718_063612.log +0 -0
  22. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/eval_results.jsonl +0 -0
  23. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/fast_eval.tsv +0 -0
  24. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/eval_20260718_065239.log +0 -0
  25. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/eval_results.jsonl +0 -0
  26. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/fast_eval.tsv +0 -0
  27. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/eval_results.jsonl +0 -0
  28. runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/fast_eval.tsv +0 -0
  29. runs_laq_lt/eval/cocolt_2ep_hires/summary.txt +112 -0
  30. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/eval_20260718_185514.log +0 -0
  31. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/eval_results.jsonl +0 -0
  32. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/fast_eval.tsv +0 -0
  33. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/eval_20260718_191117.log +0 -0
  34. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/eval_results.jsonl +0 -0
  35. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/fast_eval.tsv +0 -0
  36. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/eval_20260718_175856.log +0 -0
  37. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/eval_results.jsonl +0 -0
  38. runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/fast_eval.tsv +0 -0
  39. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/eval_20260718_172343.log +0 -0
  40. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/eval_results.jsonl +0 -0
  41. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/fast_eval.tsv +0 -0
  42. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/eval_20260718_173943.log +0 -0
  43. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl +0 -0
  44. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv +0 -0
  45. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/eval_20260718_162750.log +0 -0
  46. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/eval_results.jsonl +0 -0
  47. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/fast_eval.tsv +0 -0
  48. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/eval_20260718_142330.log +0 -0
  49. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/eval_results.jsonl +0 -0
  50. runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/fast_eval.tsv +0 -0
runs_laq_lt/eval/cocolt_1ep_native/coco/legacy/slow/eval_20260718_084605.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/eval_20260718_095209.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/legacy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/eval_20260718_080610.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/eval_20260718_071101.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_greedy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/eval_20260718_041228.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed0/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/eval_20260718_063612.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/eval_20260718_065239.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/coco/paper_seed1/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/cocolt_2ep_hires/summary.txt ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ==============================================================================
2
+ EVAL SUMMARY | cocolt_2ep_hires
3
+ ==============================================================================
4
+
5
+ Metric: mean-over-IoU (fastevaluate). BPS = boxes/second, batch 1, 1 GPU.
6
+ fallback% = switch_to_ar / forward_steps (fraction of block-decisions; paper implies ~7-8%)
7
+
8
+ profile mode | F1 P R F1@.5 | BPS steps boxes fallb%
9
+ ---------------------------------------------------------------------------------
10
+ paper_seed0 slow | 54.5 57.1 52.2 73.4 | 2.70 67.3 7.05 0.0
11
+ paper_seed0 fast | 53.1 63.0 45.8 68.2 | 8.91 15.2 6.95 0.0
12
+ paper_seed0 hybrid | 54.2 63.6 47.1 69.6 | 8.05 18.3 7.06 4.6
13
+
14
+ paper_seed1 slow | 54.5 57.0 52.3 73.0 | 2.71 67.3 7.04 0.0
15
+ paper_seed1 fast | 53.0 63.0 45.8 68.2 | 8.90 15.3 6.96 0.0
16
+ paper_seed1 hybrid | 54.0 63.5 46.9 69.3 | 8.05 18.2 7.05 4.5
17
+
18
+ paper_greedy slow | 56.8 58.9 54.9 74.0 | 2.78 70.4 7.38 0.0
19
+ paper_greedy fast | 55.2 59.8 51.2 72.0 | 9.17 15.2 7.07 0.0
20
+ paper_greedy hybrid | 56.2 60.2 52.6 73.1 | 8.34 18.7 7.21 5.1
21
+
22
+ legacy slow | 56.8 58.9 54.9 74.0 | 2.76 70.4 7.38 0.0
23
+ legacy fast | 55.2 59.8 51.2 71.9 | 9.23 15.2 7.07 0.0
24
+ legacy hybrid | 56.1 60.2 52.6 73.1 | 8.32 18.7 7.21 5.1
25
+
26
+ paper is STOCHASTIC (nucleus sampling). Mean +/- half-spread over 2 seeds:
27
+ ---------------------------------------------------------------------------------
28
+ paper (mean) slow | F1 54.5+/-0.0 BPS 2.7+/-0.0 fallback% 0.0+/-0.0
29
+ paper (mean) fast | F1 53.0+/-0.0 BPS 8.9+/-0.0 fallback% 0.0+/-0.0
30
+ paper (mean) hybrid | F1 54.1+/-0.1 BPS 8.1+/-0.0 fallback% 4.6+/-0.0
31
+
32
+ -> a gap smaller than the spread is NOT evidence. Use paper_greedy
33
+ (deterministic) for tight comparisons.
34
+
35
+ INTEGRITY legacy/slow (56.83) vs paper_greedy/slow (56.83) -> OK (identical, as required)
36
+
37
+ B1 READ-OUT hybrid fallback rate (switch_to_ar/forward_steps): legacy 5.1% vs paper 4.6% (paper ~7-8%; the RELATIVE legacy>paper gap is the primary signal)
38
+ The 0.9 abnormality threshold is calibrated on the SHARPENED (T=0.7 +
39
+ top-p) distribution. Greedy's flatter softmax trips it far more often, so
40
+ legacy should be markedly higher. If they match, B1 has not taken effect.
41
+
42
+ ==============================================================================
43
+ PROMPT-SHAPE (n_cats) OOD -- profile: paper_greedy
44
+ ==============================================================================
45
+ Training chunks each image's categories into queries of 1..3. The eval set
46
+ asks for the image's FULL list, and 28.8% of eval queries have >3 categories
47
+ -- a prompt shape the model never saw. Caveat: images with more categories
48
+ also have more objects, so a drop may be difficulty, not novelty.
49
+
50
+ --- paper_greedy/slow ---
51
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
52
+
53
+ n_cats | N | F1 | P | R | F1@.5
54
+ --------------------------------------------------
55
+ 1 | 1025 | 74.1 | 78.2 | 70.3 | 87.2
56
+ 2 | 1522 | 67.8 | 69.2 | 66.5 | 82.9
57
+ 3 | 980 | 59.8 | 63.4 | 56.5 | 76.5
58
+ 4-5 | 935 | 55.5 | 58.8 | 52.5 | 73.0
59
+ 6+ | 490 | 51.7 | 56.0 | 48.0 | 70.5
60
+
61
+ n_cats | N | F1 | P | R | F1@.5
62
+ --------------------------------------------------
63
+ <=3 (IN) | 3527 | 62.9 | 64.5 | 61.3 | 78.4
64
+ >3 (OOD) | 1425 | 52.7 | 56.1 | 49.7 | 70.7
65
+
66
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
67
+ is real: training never showed the model a 4+-category query.
68
+ Careful: bigger images have more categories AND more objects, so a
69
+ small drop may just be task difficulty, not prompt-shape OOD.
70
+
71
+ --- paper_greedy/fast ---
72
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
73
+
74
+ n_cats | N | F1 | P | R | F1@.5
75
+ --------------------------------------------------
76
+ 1 | 1025 | 72.1 | 76.8 | 68.0 | 85.1
77
+ 2 | 1522 | 65.6 | 69.2 | 62.3 | 80.8
78
+ 3 | 980 | 57.6 | 63.0 | 53.0 | 73.8
79
+ 4-5 | 935 | 54.5 | 61.9 | 48.7 | 71.4
80
+ 6+ | 490 | 49.1 | 57.4 | 42.9 | 66.0
81
+
82
+ n_cats | N | F1 | P | R | F1@.5
83
+ --------------------------------------------------
84
+ <=3 (IN) | 3527 | 61.1 | 65.2 | 57.4 | 76.5
85
+ >3 (OOD) | 1425 | 51.0 | 58.2 | 45.4 | 67.8
86
+
87
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
88
+ is real: training never showed the model a 4+-category query.
89
+ Careful: bigger images have more categories AND more objects, so a
90
+ small drop may just be task difficulty, not prompt-shape OOD.
91
+
92
+ --- paper_greedy/hybrid ---
93
+ predictions: 4952 | eval queries: 4952 | unbucketed: 0
94
+
95
+ n_cats | N | F1 | P | R | F1@.5
96
+ --------------------------------------------------
97
+ 1 | 1025 | 74.1 | 78.4 | 70.2 | 87.0
98
+ 2 | 1522 | 66.8 | 69.2 | 64.6 | 82.0
99
+ 3 | 980 | 58.6 | 64.0 | 54.0 | 75.0
100
+ 4-5 | 935 | 55.1 | 62.4 | 49.3 | 72.4
101
+ 6+ | 490 | 50.0 | 57.4 | 44.3 | 67.4
102
+
103
+ n_cats | N | F1 | P | R | F1@.5
104
+ --------------------------------------------------
105
+ <=3 (IN) | 3527 | 62.5 | 65.8 | 59.4 | 78.2
106
+ >3 (OOD) | 1425 | 51.8 | 58.7 | 46.3 | 68.9
107
+
108
+ If '>3 (OOD)' is materially below '<=3 (IN)', the prompt-shape gap
109
+ is real: training never showed the model a 4+-category query.
110
+ Careful: bigger images have more categories AND more objects, so a
111
+ small drop may just be task difficulty, not prompt-shape OOD.
112
+
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/eval_20260718_185514.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/eval_20260718_191117.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/eval_20260718_175856.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/legacy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/eval_20260718_172343.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/eval_20260718_173943.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/hybrid/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/eval_20260718_162750.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_greedy/slow/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/eval_20260718_142330.log ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/eval_results.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
runs_laq_lt/eval/refcocolt_1ep_hires/coco/paper_seed0/fast/fast_eval.tsv ADDED
The diff for this file is too large to render. See raw diff