LongShOT Leaderboard

106 models

Rankings

Model Leaderboard

Performance rankings across 4 task categories on LongShOTBench. All scores in %.

Last updated: November 6, 2026

CP Core PerceptionRE ReasoningInfo InformationMM Multimodal
Score Category Modality Duration
#ModelParamsInputOverallCPREInfoMMVisualAudioSpeechShortMedLong
LongShOTAgent
LongShOTAgent
Agentic Systems
AgentV+A66.70
56.6075.0670.3064.8465.8058.9667.3765.1166.6664.36
Qwen3-Omni-30B-A3B-T
Qwen3-Omni-30B-A3B-T
Omni-modal Models
30B (3B active)V+A64.20
51.2372.4466.1566.9762.5357.2263.9458.0563.6060.81
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview
Proprietary (Closed-source API)
APIV+A56.97
44.6765.9857.5859.6353.2048.0654.5948.5353.0953.75
4Voxtral-Mini-3B-2507
Voxtral-Mini-3B-2507
Audio-Only LLMs
3BAudio49.61
41.3758.3751.4847.2348.7943.7550.0142.2649.0048.89
5Voxtral-Small-24B-2507
Voxtral-Small-24B-2507
Audio-Only LLMs
24BAudio48.56
39.6656.1249.9348.5447.2341.8648.3842.1347.4547.17
6Qwen3-VL-235B-A22B-T
Qwen3-VL-235B-A22B-T
Video-native VLMs
235B (22B active)Video47.59
40.5054.6246.6748.5646.1944.9046.8842.5644.8148.67
7Qwen3-VL-32B-T
Qwen3-VL-32B-T
Video-native VLMs
32BVideo46.72
39.3952.0745.7349.7244.8644.1445.5141.7343.9546.62
8Vero-Qwen3I-8B
Vero-Qwen3I-8B
Video-native VLMs
8BVideo46.18
41.0850.6043.7549.2744.2243.5844.6242.5743.8444.97
9Kimi-K2.6
Kimi-K2.6
Video-native VLMs
1.1TVideo45.07
38.1651.5043.7846.8343.1441.3443.8439.9743.5442.51
10Qwen3-VL-30B-A3B-T
Qwen3-VL-30B-A3B-T
Video-native VLMs
30B (3B active)Video43.71
36.5250.0942.3845.8741.7740.3842.4636.4941.0343.35
11Qwen3-VL-235B-A22B-I
Qwen3-VL-235B-A22B-I
Video-native VLMs
235B (22B active)Video42.58
36.6446.4241.2246.0140.5239.3540.9643.4739.5142.21
12Qwen3-VL-8B-T
Qwen3-VL-8B-T
Video-native VLMs
8BVideo42.18
35.1147.9640.3145.3439.8938.7140.4840.0839.2940.97
13Gemma-3-27B
Gemma-3-27B
Frame-based VLMs
27BFrames41.97
35.4348.3640.5443.5640.2938.6640.8938.2638.8542.92
14Intern-S1-mini
Intern-S1-mini
Video-native VLMs
14BVideo41.45
34.4746.6840.3744.2839.7238.4440.2433.6539.0241.31
15Nemotron-3-Nano-Omni-30B-A3B-R
Nemotron-3-Nano-Omni-30B-A3B-R
Omni-modal Models
30B (3B active)V+A41.22
31.7350.4642.6540.0340.0034.6740.9740.7640.1739.65
16Qwen3-VL-32B-I
Qwen3-VL-32B-I
Video-native VLMs
32BVideo40.59
35.3444.2938.3844.3438.4736.9038.8740.2338.3738.50
17Gemma-3-12B
Gemma-3-12B
Frame-based VLMs
12BFrames40.10
32.9047.0238.4242.0737.8336.4538.4731.8436.5740.38
18Qwen3-Omni-30B-A3B-I
Qwen3-Omni-30B-A3B-I
Omni-modal Models
30B (3B active)V+A38.89
31.3647.4337.8538.9236.8233.8437.6729.3237.0636.87
19Gemma-4-31B
Gemma-4-31B
Frame-based VLMs
31BFrames38.87
31.8544.6937.1641.7936.6035.5037.0536.3835.7437.85
20Step3-VL-10B
Step3-VL-10B
Video-native VLMs
10BVideo38.67
31.6045.0336.1841.8736.6935.1037.1633.7035.7038.54
21GLM-4.5V
GLM-4.5V
Video-native VLMs
106B (12B active)Video37.77
31.4142.8036.3940.4836.0333.8936.5933.7434.9538.03
22Qwen3-VL-4B-T
Qwen3-VL-4B-T
Video-native VLMs
4BVideo37.74
30.7842.8336.0541.3235.8234.7436.2434.6635.3536.68
23MiMo-VL-7B-RL-2508
MiMo-VL-7B-RL-2508
Video-native VLMs
7BVideo36.89
29.5541.6735.3740.9634.5632.7535.1129.5334.3635.09
24Qwen2.5-VL-32B-I
Qwen2.5-VL-32B-I
Video-native VLMs
32BVideo36.13
30.8640.1234.3539.1634.5632.3934.9633.8033.8335.87
25Gemma-3-4B
Gemma-3-4B
Frame-based VLMs
4BFrames35.80
28.8641.5134.0838.7533.7532.2334.2732.0832.8535.47
26Gemma-4-26B-A4B
Gemma-4-26B-A4B
Frame-based VLMs
25B (3.8B active)Frames34.76
29.7840.4433.1335.6832.6931.8433.0332.7232.8832.12
27Qwen3-VL-8B-I
Qwen3-VL-8B-I
Video-native VLMs
8BVideo34.47
28.5738.0532.1939.0431.6930.9832.0631.0731.5332.03
28GLM-4.6V-Flash
GLM-4.6V-Flash
Video-native VLMs
9BVideo33.82
26.5638.5331.7538.4431.2429.9631.7029.3830.5932.50
29Ovis2.6-30B-A3B
Ovis2.6-30B-A3B
Video-native VLMs
30B (3B active)Video32.85
26.8737.3431.7835.4131.4129.5631.8633.7231.0331.88
30Qwen3.6-27B
Qwen3.6-27B
Video-native VLMs
27BVideo32.81
25.1238.5530.7836.7930.1028.8030.6626.2730.0130.40
31Qwen2.5-VL-72B-I
Qwen2.5-VL-72B-I
Video-native VLMs
72BVideo32.28
26.9135.6130.7135.9030.5328.2730.9227.2929.8831.80
32Qwen3.6-35B-A3B
Qwen3.6-35B-A3B
Video-native VLMs
35B (3B active)Video31.86
23.5337.5428.9937.3828.1926.5128.7129.7027.9528.52
33Qwen3.5-27B
Qwen3.5-27B
Video-native VLMs
27BVideo31.83
23.0838.7329.2836.2428.8926.4529.4927.5528.4029.86
34Qwen3.5-35B-A3B
Qwen3.5-35B-A3B
Video-native VLMs
35B (3B active)Video31.10
22.4437.9528.1035.8927.4725.5528.0326.5526.9328.49
35Qwen3-VL-30B-A3B-I
Qwen3-VL-30B-A3B-I
Video-native VLMs
30B (3B active)Video30.81
27.1833.5229.2933.2329.3628.8129.6930.7829.1229.67
36R-4B
R-4B
Video-native VLMs
4BVideo30.49
24.3035.7928.8932.9728.7327.5329.1531.3427.8130.24
37Fun-Audio-Chat-8B
Fun-Audio-Chat-8B
Audio-Only LLMs
8BAudio30.45
25.2534.6230.2831.6429.5827.1630.1226.4329.6729.64
38Qwen3.5-122B-A10B
Qwen3.5-122B-A10B
Video-native VLMs
122B (10B active)Video30.36
22.8136.2630.1632.2228.3726.1228.9431.3427.5629.66
39InternVL3.5-241B-A28B
InternVL3.5-241B-A28B
Video-native VLMs
241B (28B active)Video29.88
24.5833.8227.8533.2627.6125.7227.9626.2427.2428.34
40InternVL3-38B
InternVL3-38B
Video-native VLMs
38BVideo29.57
25.1034.0126.8132.3527.2225.5027.5127.4727.0027.63
41GLM-4.1V-9B-T
GLM-4.1V-9B-T
Video-native VLMs
9BVideo29.45
23.1535.5027.5231.6627.7526.3628.1423.7427.2228.93
42InternVL3-78B
InternVL3-78B
Video-native VLMs
78BVideo29.15
24.3832.7627.4032.0827.3925.8027.6826.9227.0727.85
43Qwen3-VL-4B-I
Qwen3-VL-4B-I
Video-native VLMs
4BVideo28.36
23.7930.7925.9532.9126.1925.1026.4427.0125.9426.65
44VideoRFT-7B
VideoRFT-7B
Video-native VLMs
7BVideo28.03
23.7730.1826.7131.4727.0725.5727.2926.2327.0127.13
45ERNIE-4.5-VL-28B-A3B
ERNIE-4.5-VL-28B-A3B
Video-native VLMs
28B (3B active)Video27.96
24.2531.7525.3430.4926.6125.5126.9724.1225.9627.87
46LongVT-RL
LongVT-RL
Video-native VLMs
7BVideo27.82
22.5329.1526.5033.0926.0125.5526.1926.9625.8726.11
47DeepEyes-7B
DeepEyes-7B
Video-native VLMs
7BVideo27.80
23.6331.2324.8031.5226.2224.9326.5127.0625.8726.80
48Ovis2.5-9B
Ovis2.5-9B
Video-native VLMs
9BVideo27.73
22.3831.1425.8231.5825.4324.5425.7525.4325.0326.19
49Video-R2
Video-R2
Video-native VLMs
7BVideo27.72
22.8130.0526.3731.6526.2125.2626.4823.4725.8227.08
50Molmo2-8B
Molmo2-8B
Video-native VLMs
8BVideo27.55
22.9629.5924.3033.3525.4224.5025.5828.6825.3325.37
51InternVL3-14B
InternVL3-14B
Video-native VLMs
14BVideo27.36
23.7131.0524.8529.8225.8724.0926.1423.8525.3426.88
52Qwen3.5-9B
Qwen3.5-9B
Video-native VLMs
9BVideo27.26
19.4632.6625.4531.4823.7222.1624.1622.1623.6523.88
53RePlan-Qwen2.5-VL-7B
RePlan-Qwen2.5-VL-7B
Video-native VLMs
7BVideo27.09
22.6030.0624.3331.3725.4124.2725.6724.8625.2825.66
54Gemma-4-E4B
Gemma-4-E4B
Omni-modal Models
8B (4.5B eff)V+A26.91
22.6228.3324.9831.7025.3125.0425.6026.1025.0825.57
55Video-R1-7B
Video-R1-7B
Video-native VLMs
7BVideo26.88
22.3628.5825.0031.5725.3123.9825.5225.4225.0325.80
56TimeSearch-R
TimeSearch-R
Video-native VLMs
7BVideo26.86
22.4930.5824.6029.7725.4324.1825.6922.9725.3325.77
57InternVL3.5-38B
InternVL3.5-38B
Video-native VLMs
38BVideo26.15
21.6829.3923.3130.2224.2122.9124.4624.0723.9024.77
58InternVL3.5-8B
InternVL3.5-8B
Video-native VLMs
8BVideo26.08
21.0628.4023.7931.0823.8122.3724.0023.1723.6624.05
59PixelReasoner-RL-v1
PixelReasoner-RL-v1
Video-native VLMs
7BVideo25.96
21.3729.5723.7529.1624.3323.1724.6021.8524.1524.82
60VideoChat-R1-7B
VideoChat-R1-7B
Video-native VLMs
7BVideo25.95
21.4928.1124.5729.6525.1123.8225.3620.4624.7126.05
61Qwen2.5-VL-7B-I
Qwen2.5-VL-7B-I
Video-native VLMs
7BVideo25.66
21.5627.9424.1928.9824.3323.1224.6124.5424.0924.76
62InternVL2.5-78B
InternVL2.5-78B
Video-native VLMs
78BVideo25.38
20.6528.3122.9229.6423.2921.9323.5920.9722.8324.27
63Ovis2-16B
Ovis2-16B
Frame-based VLMs
16BFrames25.04
20.1428.6121.5729.8223.1022.0223.4023.0522.9823.30
64InternVL3-8B
InternVL3-8B
Video-native VLMs
8BVideo24.40
20.8726.4121.9428.3822.7421.7822.9122.7822.4423.30
65Kimi-VL-A3B-T
Kimi-VL-A3B-T
Frame-based VLMs
8B (3B active)Frames23.91
17.6827.9822.2527.7421.6420.3022.0519.0421.6121.71
66InternVL2.5-38B
InternVL2.5-38B
Video-native VLMs
38BVideo23.88
20.2126.9520.7127.6622.2621.0422.6221.8521.7823.17
67Qwen2.5-VL-7B-VRAG
Qwen2.5-VL-7B-VRAG
Video-native VLMs
7BVideo23.35
20.5624.2821.6826.8822.7022.9022.8819.5622.4523.30
68MiniCPM-o 4.5
MiniCPM-o 4.5
Omni-modal Models
8BV+A23.25
19.1225.9622.1725.7521.7820.9822.0220.0821.8321.75
69Phi-4-R-Vision-15B
Phi-4-R-Vision-15B
Video-native VLMs
15BVideo23.13
19.2626.5020.1726.6021.4421.1321.6823.3520.7122.60
70R1-Onevision-7B
R1-Onevision-7B
Video-native VLMs
7BVideo22.81
18.7926.6320.5325.2922.0421.0522.2919.9421.9222.35
71Qwen3.5-4B
Qwen3.5-4B
Video-native VLMs
4BVideo22.64
16.6427.1520.6226.1620.1719.0420.4320.4420.3619.68
72AURA-32B
AURA-32B
Video-native VLMs
32BVideo22.26
19.2824.5920.1325.0421.1220.8021.2819.7721.0421.37
73InternVL3.5-4B-I
InternVL3.5-4B-I
Video-native VLMs
4BVideo22.20
19.0224.9319.5825.2520.9919.9621.1818.6420.7721.50
74Keye-VL-1.5-8B
Keye-VL-1.5-8B
Video-native VLMs
8BVideo22.12
17.2525.5119.6326.0720.1919.9920.4219.9119.9220.65
75Audio Flamingo 3
Audio Flamingo 3
Audio-Only LLMs
8BAudio22.04
18.7424.4621.1923.7721.3718.5421.8422.9921.7120.79
76Gemma-4-E2B
Gemma-4-E2B
Omni-modal Models
5B (2.3B eff)V+A21.84
18.9726.1621.6720.5622.2321.3922.4826.3322.3721.64
77NVIDIA Nemotron Nano 12B VL
NVIDIA Nemotron Nano 12B VL
Video-native VLMs
12BVideo21.74
17.4323.0119.6526.8619.7219.2119.9915.6719.4320.41
78HumanSense Omni-R
HumanSense Omni-R
Omni-modal Models
7BV+A21.63
18.5923.1720.6424.1320.8818.9121.2223.1320.9420.84
79EchoInk-R1-7B
EchoInk-R1-7B
Omni-modal Models
7BV+A21.46
18.1822.4720.7724.4120.7319.0021.0522.6721.2319.83
80MiniCPM-V 4.5
MiniCPM-V 4.5
Video-native VLMs
8BVideo21.34
17.6423.9719.0724.6819.4719.0919.7718.7219.3419.81
81Qwen2.5-Omni-7B
Qwen2.5-Omni-7B
Omni-modal Models
7BV+A21.28
18.1423.1720.7723.0320.6418.8220.9921.9721.0619.95
82SpaceThinker-3B
SpaceThinker-3B
Video-native VLMs
3BVideo20.65
16.9221.1219.5025.0419.1518.2319.3417.7518.4620.51
83Qwen3-VL-2B-I
Qwen3-VL-2B-I
Video-native VLMs
2BVideo20.35
17.7821.1217.8824.6218.7318.5018.8220.1418.4119.28
84Ovis2-8B
Ovis2-8B
Frame-based VLMs
8BFrames19.92
15.6522.4618.0423.5417.9817.9418.1716.5617.4619.00
85Qwen2.5-VL-3B-I
Qwen2.5-VL-3B-I
Video-native VLMs
3BVideo19.88
16.4921.1517.2124.6718.2517.8818.4113.3117.9819.03
86MiniCPM-o 2.6
MiniCPM-o 2.6
Omni-modal Models
8BV+A19.37
15.3620.5116.8524.7717.1216.7217.3211.5317.1117.45
87Qwen3.5-2B
Qwen3.5-2B
Video-native VLMs
2BVideo19.03
16.9620.1618.3920.6118.2117.5918.3715.5418.2318.22
88Baichuan-Omni 1.5
Baichuan-Omni 1.5
Omni-modal Models
7BV+A18.97
15.7819.9916.1823.9017.3116.4917.4515.1016.9418.07
89Qwen2.5-Omni-3B
Qwen2.5-Omni-3B
Omni-modal Models
3BV+A18.10
15.8018.4516.9621.1917.4616.3117.7317.7417.5917.29
90SALMONN2+ 7B
SALMONN2+ 7B
Omni-modal Models
7BV+A17.69
14.2619.2116.4620.8316.1813.9716.5113.7916.4116.00
91Ovis2-4B
Ovis2-4B
Frame-based VLMs
4BFrames17.67
14.2318.3415.5322.6115.7415.9415.8014.3815.2616.64
92Qwen3.5-0.8B
Qwen3.5-0.8B
Video-native VLMs
0.8BVideo16.88
14.9716.8315.5920.1515.9015.9215.9912.7215.9615.93
93OmniAtlas-Qwen2.5-7B
OmniAtlas-Qwen2.5-7B
Omni-modal Models
7BV+A16.02
14.7416.5716.9315.8216.7416.1116.9917.3516.8016.62
94VideoLLaMA3-7B
VideoLLaMA3-7B
Video-native VLMs
7BVideo15.93
12.2916.7813.9720.6913.8013.5513.8812.2913.5714.28
95Kimi-VL-A3B-I
Kimi-VL-A3B-I
Frame-based VLMs
8B (3B active)Frames15.75
12.6017.1013.5119.8114.0914.1414.3010.2213.9914.43
96OmniVinci-9B
OmniVinci-9B
Omni-modal Models
9BV+A15.54
13.4416.1714.7117.8414.1613.7614.3912.8814.5813.44
97Monet-7B
Monet-7B
Video-native VLMs
7BVideo13.57
10.6315.5511.5516.5612.4812.7212.6110.1912.1413.23
98LLaVA-OneVision-7B
LLaVA-OneVision-7B
Video-native VLMs
7BVideo13.20
10.9014.2111.9315.7711.8711.8212.0310.9411.8212.05
99Qwen2-Audio-7B-I
Qwen2-Audio-7B-I
Audio-Only LLMs
7BAudio13.09
10.6112.7311.4217.6011.8611.3612.099.3611.5112.71
100VideoMind
VideoMind
Agentic Systems
AgentV+A11.85
9.6811.1110.2516.3810.128.7310.1312.879.5811.05
101Tempo-6B
Tempo-6B
Video-native VLMs
6BVideo9.70
6.429.687.2615.437.305.797.3211.167.486.88
102SenseNova-SI-1.3-8B
SenseNova-SI-1.3-8B
Video-native VLMs
8BVideo9.47
7.4110.537.7312.228.799.388.956.018.429.57
103Video-RAG
Video-RAG
Agentic Systems
AgentV+A8.17
6.517.819.319.067.706.627.889.227.238.61
104Vgent
Vgent
Agentic Systems
AgentV+A7.99
5.628.386.9211.046.626.256.715.665.718.47
105OneThinker-8B
OneThinker-8B
Video-native VLMs
8BVideo7.26
6.917.858.495.797.447.717.576.036.778.67
106VideoScore2
VideoScore2
Video-native VLMs
7BVideo3.17
2.923.532.743.492.993.012.914.723.042.84