Minimum Model Size (params)

Maximum Model Size (params)

0 72

Rank	T	Model Name	Average ⬆️	AlGhafa	ArabicMMLU	EXAMS	MadinahQA	AraTrust	ALRAGE	ArbMMLU-HT
100	💬	Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2	75.59	78.21	75.05	59.22	75.34	89.83	77.62	73.87

Rank	T	Model Name	Average ⬆️	AlGhafa	ArabicMMLU	EXAMS	MadinahQA	AraTrust	ALRAGE	ArbMMLU-HT
1	💬	rombodawg/Rombos-LLM-V2.5-Qwen-72b	75.59	78.21	75.05	59.22	75.34	89.83	77.62	73.87
2	🤝	Sakalti/Ultiima-72B	75.51	78.17	75.04	59.22	75.15	89.65	77.43	73.9
3	💬	meta-llama/Llama-3.3-70B-Instruct	74.47	80.36	69.76	66.67	72.91	88.05	75.83	67.68
4	💬	MaziyarPanahi/calme-2.1-qwen2.5-72b	73.1	78.1	70.85	59.78	60.57	89.06	80.24	73.09
5	💬	MaziyarPanahi/calme-2.2-qwen2.5-72b	72.72	78.14	70.6	59.78	58.43	89.22	79.93	72.96
6	💬	Qwen/Qwen2.5-72B-Instruct	72.39	78.22	71.43	58.66	58.11	89.21	78.85	72.23
7	🤝	maldv/Qwentile2.5-32B-Instruct	72.02	78	68.24	50.84	73.6	88.07	78.72	66.67
8	🤝	Sakalti/Saka-14B	71.87	76.26	70.84	55.68	70.01	88.29	77.48	64.56
9	💬	Sakalti/SakaMoe-3x14B-Instruct	71.85	75.94	70.66	54.56	71.62	88.8	77.26	64.14
10	💬	FreedomIntelligence/AceGPT-v2-32B-Chat	70.88	77.33	68.92	53.26	73.77	84.72	76.89	61.24
11	💬	tanliboy/lambda-qwen2.5-32b-dpo-test	70.85	78.17	69.92	56.05	59.83	86.53	78.66	66.8
12	🔶	freewheelin/free-evo-qwen72b-v0.8-re	70.67	76.28	67.77	53.82	74.29	86.78	73.27	62.47
13	🔶	maldv/Awqward2.5-32B-Instruct	70.41	78.01	68.08	55.87	56.96	88.27	79.27	66.38
14	🟢	Qwen/Qwen2-72B	70.14	78.56	66.54	53.82	61.37	89.22	73.4	68.06
15	💬	FreedomIntelligence/AceGPT-v2-70B-Chat	70.07	76.59	65.14	55.31	65.64	86.69	72.82	68.31
16	💬	Qwen/Qwen2.5-32B-Instruct	69.99	78.11	68.03	55.12	57.1	86.66	79.15	65.74
17	💬	Daemontatox/Cogito-R1	69.75	77.67	67.23	54.19	57.21	87.74	79.44	64.74
18	🔶	huihui-ai/Qwen2.5-32B-Instruct-abliterated	69.51	78.05	67.09	53.26	56.47	87.04	79.05	65.62
19	🟢	Qwen/Qwen2.5-72B	69.37	77.16	64.65	46.37	65.02	88.55	77.37	66.44
20	💬	tanliboy/lambda-qwen2.5-14b-dpo-test	68.26	74.78	67.22	55.49	54.03	88.83	78.54	58.93
21	🔶	AXCXEPT/EZO-Qwen2.5-32B-Instruct	67.97	75	66.98	54.38	53.71	89.15	75.86	60.68
22	🟩	FreedomIntelligence/AceGPT-v2-70B	67.2	58.73	68.02	56.24	68.35	84.35	68.94	65.74
23	💬	CohereForAI/aya-expanse-32b	67.17	77.61	60.63	51.02	53.45	89	79.64	58.86
24	🔶	recoilme/recoilme-gemma-2-9B-v0.4	66.43	74.37	53.99	47.86	67.43	84.54	80.37	56.43
25	💬	CohereForAI/aya-23-35B	66.09	75.89	62.5	49.91	62.49	84.21	73.67	53.98
26	💬	Navid-AI/Yehia-7B-preview	65.68	70.81	64.9	52.14	54.37	87.49	76.64	53.4
27	🟢	Qwen/Qwen2.5-32B	65.45	77.05	59.82	49.53	55.82	83.01	76.68	56.24
28	💬	inceptionai/jais-family-30b-16k-chat	65.43	71.22	61.22	50.09	66.26	81.57	74.95	52.73
29	💬	inceptionai/jais-adapted-70b-chat	65.28	75.16	63.77	52.51	53.56	83.74	72.34	55.9
30	💬	ALLaM-AI/ALLaM-7B-Instruct-preview	65.25	69.49	64.9	51.58	54.24	86.93	76.81	52.81
31	💬	inceptionai/jais-family-30b-8k-chat	64.87	71.34	60.69	50.47	63.92	83.14	72.64	51.91
32	💬	v000000/Qwen2.5-Lumen-14B	64.11	72.66	61.92	53.82	38.08	87.03	78.85	56.39
33	🔶	rombodawg/Rombos-LLM-V2.6-Qwen-14b	63.85	74.12	60.11	54	36.09	86.77	78.92	56.96
34	💬	Qwen/Qwen2-7B-Instruct	63.61	73.24	60.01	47.3	59.5	82.77	71.13	51.3
35	💬	v000000/Qwen2.5-14B-Gutenberg-1e-Delta	63.55	72.51	60.85	53.45	36.39	86.86	78.68	56.08
36	💬	Qwen/Qwen2.5-14B-Instruct	63.18	72.25	60.02	53.63	35.58	86.11	78.91	55.73
37	💬	Cran-May/T.E-8.1	62.95	73.23	52.8	40.97	62.34	82.09	75.77	53.42
38	🔶	huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2	62.55	70.69	59.49	45.25	63.54	74.21	77.74	46.91
39	💬	FreedomIntelligence/AceGPT-v2-8B-Chat	62.35	73.48	61.32	49.72	55.89	74.19	70.94	50.89
40	💬	arcee-ai/Arcee-Spark	62.34	72.9	59.16	48.23	51.39	82.61	70.74	51.33
41	🔶	SeaLLMs/SeaLLM-7B-v2.5	61.85	71.37	57.98	48.23	57.99	80.75	67.92	48.69
42	💬	Orion-zhen/Qwen2.5-7B-Instruct-Uncensored	61.82	72.04	49.92	37.06	64.23	80.43	76.63	52.46
43	🟢	FreedomIntelligence/AceGPT-v2-32B	61.74	54.93	63.15	48.6	59.71	83.96	68.96	52.87
44	💬	Qwen/Qwen2.5-7B-Instruct	59.8	65.6	52.25	39.66	62.73	80.68	77.37	40.33
45	🔶	Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2	59.7	70.16	55.27	44.88	57.33	72.24	75.75	42.27
46	🔶	airev-ai/emirati-14b-v2	58.7	74.64	49.38	41.71	30.91	81.77	77.23	55.27
47	🔶	recoilme/recoilme-gemma-2-9B-v0.2	58.68	72.55	42.4	33.33	51.37	86.53	80.51	44.04
48	💬	SeaLLMs/SeaLLMs-v3-7B-Chat	58.14	71.11	50.97	44.32	50.54	78.05	63.8	48.16
49	💬	inceptionai/jais-adapted-13b-chat	58.08	67.28	54.23	47.3	44.2	79.68	68.41	45.45
50	💬	silma-ai/SILMA-9B-Instruct-v1.0	57.65	33.99	62.16	51.4	52.48	82.83	80.39	40.32
51	🔶	VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct	57.58	73.79	46.66	42.64	56.89	64.26	70.26	48.59
52	🔶	huihui-ai/Qwen2.5-7B-Instruct-abliterated	57.01	63.56	43.28	34.45	63.01	81.29	76.66	36.83
53	🟢	Qwen/Qwen1.5-32B	56.2	66.43	48.81	34.82	52.99	78.11	66.97	45.3
54	💬	google/gemma-2-27b-it	55.51	72.22	37.07	24.39	33.25	80.48	79.9	61.23
55	💬	meta-llama/Llama-3.1-8B-Instruct	55.41	70.91	53.58	50.28	39.72	75.57	49.89	47.94
56	🟢	Qwen/Qwen2.5-14B	54.26	69.32	46.37	37.43	30.38	70.46	74.03	51.84
57	💬	Qwen/Qwen2.5-3B-Instruct	54.22	61.1	48.21	43.02	47	72.53	71.73	35.93
58	🟢	inceptionai/jais-family-30b-8k	53.63	54.34	51.53	45.81	29.82	70.66	80.47	42.8
59	💬	FreedomIntelligence/AceGPT-13B-chat	52.55	59.18	49.84	40.97	33.08	65.7	79.75	39.31
60	🟢	Qwen/Qwen1.5-14B	52.5	65.72	49.74	35.38	51.38	64.35	62.91	38.03
61	💬	silma-ai/SILMA-Kashif-2B-Instruct-v1.0	52.42	59.73	45.61	33.15	38.84	73.35	80.48	35.79
62	🟢	inceptionai/jais-family-30b-16k	52.4	57.63	50.32	46.93	26.31	62.02	80.62	42.96
63	💬	inceptionai/jais-family-13b-chat	52.13	66.47	53.31	41.53	53.01	75.03	28.53	47.03
64	🟢	inceptionai/jais-adapted-70b	51.94	54.82	51.97	43.58	34.96	74.97	55.28	48
65	🟢	meta-llama/Llama-3.1-8B	51.64	64.34	52.28	40.04	43.08	71.98	47.08	42.67
66	💬	inceptionai/jais-adapted-7b-chat	51.05	63.38	49.9	41.71	34.79	66.02	63.6	37.97
67	🟢	upstage/SOLAR-10.7B-v1.0	49.48	59.36	38.86	31.47	37.94	65.51	76.14	37.07
68	💬	Qwen/Qwen2-1.5B-Instruct	49.16	53.11	49.19	35.2	45.49	68.93	54.79	37.38
69	💬	FreedomIntelligence/AceGPT-7B-chat	49.07	49.51	47.29	35.38	38.15	63.61	75	34.54
70	🔶	yellowtown/7B-v0.2	47.34	48.55	46.34	35.75	36.63		77	39.8
71	🟢	Qwen/Qwen1.5-7B	47.22	52.28	43.93	32.59	40.16	67.21	59.94	34.44
72	🟩	FreedomIntelligence/AceGPT-13B	47.21	48.23	41.38	36.87	35.37	56.51	79.96	32.12
73	💬	Qwen/Qwen2.5-1.5B-Instruct	47.17	48.41	43.51	31.84	38.2	70.76	61.57	35.91
74	💬	google/gemma-2-9b-it	46.64	47.92	36.28	27.93	31.7	77.15	80.47	25.01
75	🟩	AIDC-AI/Marco-LLM-AR	46.54	54.94	43.45	37.62	39.95	68.56	33.8	47.45
76	🟩	AIDC-AI/Marco-LLM-AR-V2	45.07	57	43.72	35.57	27.73	62.58	51.13	37.73
77	🟩	01-ai/Yi-1.5-9B	44.87	51.21	37.48	27.56	35.6	58.1	72.73	31.44
78	🟩	INSAIT-Institute/BgGPT-7B-Instruct-v0.2	42.57	60.18	40	30.73	38.34	46.7	48.81	33.22
79	🟢	inceptionai/jais-adapted-13b	42.53	40.62	36.97	34.26	29.04	61.18	62.53	33.12
80	🟩	speakleash/Bielik-11B-v2	42.12	48.05	32.65	30.17	32.48	55.37	68.13	28.01
81	🟢	Qwen/Qwen2.5-7B	41.97	31.72	37.36	37.99	27.11	53.66	62.68	43.3
82	💬	cognitivecomputations/Dolphin3.0-R1-Mistral-24B	41.77	54.74	36.6	29.8	31.11	54.24	56.1	29.8
83	💬	tiiuae/Falcon3-10B-Base	41.13	44.08	37.64	29.8	33.37	58.01	56.79	28.21
84	🟢	Qwen/Qwen2.5-3B	40.82	47.59	37.43	31.66	32.09	43.81	61.9	31.23
85	💬	Syed-Hasan-8503/Phi-3-mini-4K-instruct-cpo-simpo	40.11	54.79	36.78	24.77	35.33	55.81	42.28	31
86	🟩	01-ai/Yi-1.5-9B-32K	39.57	49.05	36.67	28.31	37.91	56.56	38.11	30.39
87	🤝	Sakalti/Saka-1.5B	39.07	51.37	39.95	31.28	31.46	47.54	38.45	33.46
88	🟢	Qwen/Qwen1.5-4B	38.83	42.41	38.15	24.58	31.83	57.23	47.87	29.77
89	🟢	inceptionai/jais-family-13b	38.61	42.87	33.53	24.02	23.95	34.75	80.16	31.01
90	🟩	01-ai/Yi-1.5-34B-32K	38.46	47.66	36.66	25.88	29.94	52.3	44.63	32.18
91	🟩	AIDC-AI/Marco-LLM-AR-V3	38.34	53.19	34.08	29.24	31.79	39.56	48.9	31.61
92	🟩	FreedomIntelligence/AceGPT-7B	36.78	36.41	35.44	23.65	27.14	49.36	56.27	29.21
93	💬	tiiuae/Falcon3-7B-Base	36.48	37.89	31.81	24.77	24.87	49.89	60.23	25.88
94	🟢	google/gemma-2-27b	35.58	31.3	29.76	23.65	29.4	31.18	80.46	23.33
95	💬	Qwen/Qwen2-0.5B-Instruct	35.55	40.61	36.51	28.49	28.22	46.86	38.55	29.64
96	💬	google/gemma-2-2b-it	34.73	34.13	30.09	23.65	20.08	31.18	80.57	23.44
97	💬	Qwen/Qwen2.5-0.5B-Instruct	34.23	40.44	30.5	26.07	24.76	47.29	42.61	27.91
98	🔶	mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1	31.51	33.5	26.99	26.26	24.76	32.58	52.51	23.94
99	🟢	inceptionai/jais-adapted-7b	30.61	32.92	27.33	26.44	24.84	33.91	41.43	27.4
100	🟢	Qwen/Qwen1.5-1.8B	29.46	32.73	26.68	23.84	26.02	31.48	41.89	23.56
101	🔶	mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1	28.4	32.71	28.45	24.21	24.08	32.58	33.47	23.33
102	🟢	Qwen/Qwen2.5-0.5B	26.6	32.42	29.93	24.39	19.94	31.18	25.02	23.35
103	🟢	Qwen/Qwen2.5-1.5B	23.68	30.86	29.98	22.53	23.13	30.18	3.46	25.65

Submit Your Model for Evaluation 🌴

The Open Arabic LLM Leaderboard aims to help you evaluate and compare the performance of Arabic Large Language Models.

When you submit a model on this page, it is automatically evaluated on a set of arabic native benchmarks (find here) with one additional human-translated version of MMLU.

The GPU used for evaluation is operated with the support of Technology Innovation Institute (TII).

More details about the benchmarks and the evaluation process is provided on the “About” section below.

Find the first version of the leaderboard hosted as Legacy in this Space.

Model Name

Revision Commit

Model Type

Weight Type

Precision

Base Model (if adapter or delta weights)

Evaluate using chat-template?

Yes No

Evaluation Status

model	base_model	revision	precision	weight_type	status	submitted_time	model_type	likes	params	license	private	job_id	job_start_time	chat_template
Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2		060db6499f32faf8b98477b0a26969ef7d8b9987	bfloat16	Original	FINISHED	2025-03-04T09:59:59.907551Z	🔶 : fine-tuned on domain-specific datasets	3693	34.389	cc-by-nc-sa-4.0	false		2025-01-21T07:40:09.877337	false

model	revision	precision	weight_type	status	submitted_time	model_type	likes	params	license	private	job_start_time	chat_template
01-ai/Yi-1.5-34B-32K	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟩 : continuously pretrained	13	34.389	apache-2.0	false	2025-01-21T07:40:09.877337	false
01-ai/Yi-1.5-9B-32K	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🟩 : continuously pretrained	7	8.829	apache-2.0	false	2025-02-08T11:10:21.161772	false
01-ai/Yi-1.5-9B	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🟩 : continuously pretrained	24	8.829	apache-2.0	false	2025-02-08T08:29:36.805940	false
AIDC-AI/Marco-LLM-AR-V2	main	bfloat16	Original	FINISHED	2025-03-04T09:59:59.907551Z	🟩 : continuously pretrained	1	7.616	apache-2.0	false	2025-03-04T10:18:02.845586	true
AIDC-AI/Marco-LLM-AR-V3	main	bfloat16	Original	FINISHED	2025-03-04T19:15:00.114106Z	🟩 : continuously pretrained	0	7.616	apache-2.0	false	2025-03-04T19:19:53.973663	true
AIDC-AI/Marco-LLM-AR	main	bfloat16	Original	FINISHED	2025-02-11T06:35:54.938982Z	🟩 : continuously pretrained	0	7.616	apache-2.0	false	2025-02-12T05:20:03.501821	true
ALLaM-AI/ALLaM-7B-Instruct-preview	main	bfloat16	Original	FINISHED	2025-02-18T18:01:56.806782Z	💬 : chat models (RLHF, DPO, IFT, ...)	5	7	apache-2.0	false	2025-02-19T09:45:10.993265	true
AXCXEPT/EZO-Qwen2.5-32B-Instruct	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🔶 : fine-tuned on domain-specific datasets	2	32.764	apache-2.0	false	2025-02-08T08:30:19.518006	true
CohereForAI/aya-23-35B	main	float16	Original	FINISHED	2025-01-29T15:57:52.890641Z	💬 : chat models (RLHF, DPO, IFT, ...)	268	34.981	cc-by-nc-4.0	false	2025-02-08T19:27:01.105080	true
CohereForAI/aya-expanse-32b	main	float16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	202	32.3	CC-BY-NC-4.0	false	2025-02-08T08:38:20.150902	true
Cran-May/T.E-8.1	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	2	7.616	cc-by-nc-sa-4.0	false	2025-02-08T10:30:21.401321	true
Daemontatox/Cogito-R1	main	bfloat16	Original	FINISHED	2025-02-11T20:46:56.174519Z	💬 : chat models (RLHF, DPO, IFT, ...)	1	32.764	apache-2.0	false	2025-02-11T20:48:32.217184	true
FreedomIntelligence/AceGPT-13B-chat	main	float16	Original	FINISHED	2025-01-20T17:11:55Z	💬 : chat models (RLHF, DPO, IFT, ...)	25	13	apache-2.0	false	2025-02-08T13:18:22.602821	false
FreedomIntelligence/AceGPT-13B	main	float16	Original	FINISHED	2025-01-19T07:28:17Z	🟩 : continuously pretrained	8	13	apache-2.0	false	2025-02-08T10:22:21.514187	false
FreedomIntelligence/AceGPT-7B-chat	main	float16	Original	FINISHED	2025-01-20T17:11:55Z	💬 : chat models (RLHF, DPO, IFT, ...)	8	7	apache-2.0	false	2025-02-08T13:26:22.687068	false
FreedomIntelligence/AceGPT-7B	main	float16	Original	FINISHED	2025-01-20T17:11:55Z	🟩 : continuously pretrained	3	7	apache-2.0	false	2025-02-08T13:10:22.229891	false
FreedomIntelligence/AceGPT-v2-32B-Chat	main	float16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	3	32.513	apache-2.0	false	2025-02-08T08:46:19.920445	true
FreedomIntelligence/AceGPT-v2-32B	main	float16	Original	FINISHED	2025-01-30T06:27:43.852438Z	🟢 : pretrained	1	32.513	apache-2.0	false	2025-02-08T19:43:00.764839	true
FreedomIntelligence/AceGPT-v2-70B-Chat	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	70.554	apache-2.0	false	2025-02-06T07:50:32.889557	false
FreedomIntelligence/AceGPT-v2-70B	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	🟩 : continuously pretrained	1	70.554	apache-2.0	false	2025-02-06T07:45:35.631469	false
FreedomIntelligence/AceGPT-v2-8B-Chat	main	float16	Original	FINISHED	2025-01-20T17:11:55Z	💬 : chat models (RLHF, DPO, IFT, ...)	2	8.03	apache-2.0	false	2025-02-08T19:19:00.154919	false
INSAIT-Institute/BgGPT-7B-Instruct-v0.2	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟩 : continuously pretrained	21	7.291	apache-2.0	false	2025-02-08T06:22:15.130408	true
Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🔶 : fine-tuned on domain-specific datasets	1	7.616	apache-2.0	false	2025-02-08T06:32:15.877524	true
MaziyarPanahi/calme-2.1-qwen2.5-72b	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	1	72.7	other	false	2025-02-06T06:15:31.290181	true
MaziyarPanahi/calme-2.2-qwen2.5-72b	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	1	72.7	other	false	2025-01-21T07:40:39.881897	true
Navid-AI/Yehia-7B-preview	main	bfloat16	Original	FINISHED	2025-03-03T11:06:48.245215Z	💬 : chat models (RLHF, DPO, IFT, ...)	4	7.001		false	2025-03-03T15:20:20.030168	true
Orion-zhen/Qwen2.5-7B-Instruct-Uncensored	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	3	7.616	gpl-3.0	false	2025-02-08T08:22:16.007188	true
Qwen/Qwen1.5-1.8B	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	35	1.837	other	false	2025-02-08T10:54:21.072378	true
Qwen/Qwen1.5-14B	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🟢 : pretrained	32	14.167	other	false	2025-02-08T09:10:20.446684	true
Qwen/Qwen1.5-32B	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🟢 : pretrained	71	32.512	other	false	2025-02-08T08:54:20.154034	true
Qwen/Qwen1.5-4B	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟢 : pretrained	29	3.95	other	false	2025-02-08T07:52:15.475167	true
Qwen/Qwen1.5-7B	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟢 : pretrained	35	7.721	other	false	2025-02-08T08:12:15.753515	true
Qwen/Qwen2-0.5B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T14:43:05Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	0.49	other	false	2025-02-08T06:19:28.177264	true
Qwen/Qwen2-1.5B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	1.54	other	false	2025-02-08T08:02:15.368025	true
Qwen/Qwen2-72B	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	0	72.7	other	false	2025-01-21T07:41:00.318347	true
Qwen/Qwen2-7B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	7.62	other	false	2025-02-08T07:02:14.997658	true
Qwen/Qwen2.5-0.5B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T14:43:05Z	💬 : chat models (RLHF, DPO, IFT, ...)	12	0.494	apache-2.0	false	2025-02-08T06:21:47.357291	true
Qwen/Qwen2.5-0.5B	060db6499f32faf8b98477b0a26969ef7d8b9987	bfloat16	Original	FINISHED	2025-01-17T14:43:05Z	🟢 : pretrained	61	0.494	apache-2.0	false	2025-02-08T06:19:48.502455	true
Qwen/Qwen2.5-1.5B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	16	1.544	apache-2.0	false	2025-02-08T06:42:14.926675	true
Qwen/Qwen2.5-1.5B	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟢 : pretrained	8	1.544	apache-2.0	false	2025-02-08T07:12:15.230903	true
Qwen/Qwen2.5-14B-Instruct	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	13	14.77	apache-2.0	false	2025-02-08T11:18:22.068157	true
Qwen/Qwen2.5-14B	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	5	14.77	apache-2.0	false	2025-02-08T11:42:22.847597	true
Qwen/Qwen2.5-32B-Instruct	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	7	32.764	apache-2.0	false	2025-02-08T09:02:20.345973	true
Qwen/Qwen2.5-32B	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	4	32.764	apache-2.0	false	2025-01-19T07:29:37.106248	true
Qwen/Qwen2.5-3B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	18	3.086	other	false	2025-02-08T06:52:15.204714	true
Qwen/Qwen2.5-3B	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟢 : pretrained	5	3.086	other	false	2025-02-08T07:22:15.401441	true
Qwen/Qwen2.5-72B-Instruct	main	bfloat16	Original	FINISHED	2025-01-31T12:15:49.899735Z	💬 : chat models (RLHF, DPO, IFT, ...)	701	72.706	other	false	2025-02-08T19:51:01.141367	true
Qwen/Qwen2.5-72B	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	7	72.706	other	false	2025-01-20T07:14:54.034141	true
Qwen/Qwen2.5-7B-Instruct	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	💬 : chat models (RLHF, DPO, IFT, ...)	20	7.616	apache-2.0	false	2025-02-08T07:42:15.444769	true
Qwen/Qwen2.5-7B	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🟢 : pretrained	6	7.616	apache-2.0	false	2025-02-08T07:32:15.370596	true
Sakalti/Saka-1.5B	main	float16	Original	FINISHED	2025-02-11T09:31:26.084185Z	🤝 : base merges and merges	1	1.777		false	2025-02-11T10:47:27.139547	false
Sakalti/Saka-14B	main	float16	Original	FINISHED	2025-02-11T09:31:54.948549Z	🤝 : base merges and merges	5	14.766		false	2025-02-12T05:21:41.344042	false
Sakalti/SakaMoe-3x14B-Instruct	main	float16	Original	FINISHED	2025-02-19T10:28:44.992462Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	45.343	apache-2.0	false	2025-02-19T11:00:37.975586	false
Sakalti/Ultiima-72B	main	float16	Original	FINISHED	2025-02-11T09:32:32.001771Z	🤝 : base merges and merges	1	72.706	other	false	2025-02-11T11:47:30.706241	false
SeaLLMs/SeaLLM-7B-v2.5	main	float16	Original	FINISHED	2025-01-22T13:33:37Z	🔶 : fine-tuned on domain-specific datasets	44	8.538	other	false	2025-02-06T08:25:34.187570	true
SeaLLMs/SeaLLMs-v3-7B-Chat	main	bfloat16	Original	FINISHED	2025-03-05T06:06:48.377744Z	💬 : chat models (RLHF, DPO, IFT, ...)	52	7.616	other	false	2025-03-05T06:20:22.364493	true
Syed-Hasan-8503/Phi-3-mini-4K-instruct-cpo-simpo	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	1	3.821	apache-2.0	false	2025-02-08T11:58:21.193972	true
TarjamaN/Pronoia-14b-community	main	bfloat16	Original	FINISHED	2025-02-10T18:01:56.806782Z	🔶 : fine-tuned on domain-specific datasets	0	14	apache-2.0	false	2025-02-11T09:44:43.352229	false
VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🔶 : fine-tuned on domain-specific datasets	13	12.248	apache-2.0	false	2025-02-08T11:50:21.673103	true
airev-ai/emirati-14b-v2	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🔶 : fine-tuned on domain-specific datasets	0	14.77	apache-2.0	false	2025-02-09T07:32:28.240060	true
arcee-ai/Arcee-Spark	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	78	7.616	apache-2.0	false	2025-02-08T12:22:22.278691	true
cognitivecomputations/Dolphin3.0-R1-Mistral-24B	main	bfloat16	Original	FINISHED	2025-02-11T22:06:35.591253Z	💬 : chat models (RLHF, DPO, IFT, ...)	91	23.572		false	2025-02-11T22:18:43.247824	true
freewheelin/free-evo-qwen72b-v0.8-re	main	float16	Original	FINISHED	2025-01-19T07:28:17Z	🔶 : fine-tuned on domain-specific datasets	3	72.288	mit	false	2025-02-06T06:20:41.352289	false
google/gemma-2-27b-it	main	bfloat16	Original	FINISHED	2025-02-01T05:04:02.122717Z	💬 : chat models (RLHF, DPO, IFT, ...)	509	27.227	gemma	false	2025-02-01T05:04:43.884909	true
google/gemma-2-27b	main	float16	Original	FINISHED	2025-01-30T09:20:03.598382Z	🟢 : pretrained	193	27.227	gemma	false	2025-01-30T09:23:21.646352	false
google/gemma-2-2b-it	main	bfloat16	Original	FINISHED	2025-02-19T14:03:23.500812Z	💬 : chat models (RLHF, DPO, IFT, ...)	961	2.614	gemma	false	2025-02-19T14:30:53.668405	true
google/gemma-2-9b-it	main	bfloat16	Original	FINISHED	2025-01-29T15:55:59.067426Z	💬 : chat models (RLHF, DPO, IFT, ...)	639	9.242	gemma	false	2025-02-09T07:33:17.513544	true
huihui-ai/Qwen2.5-32B-Instruct-abliterated	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🔶 : fine-tuned on domain-specific datasets	3	32.764	apache-2.0	false	2025-02-08T09:26:20.139673	true
huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🔶 : fine-tuned on domain-specific datasets	7	7.616	apache-2.0	false	2025-02-08T08:28:59.535671	true
huihui-ai/Qwen2.5-7B-Instruct-abliterated	main	bfloat16	Original	FINISHED	2025-01-17T21:58:33Z	🔶 : fine-tuned on domain-specific datasets	0	7.616	apache-2.0	false	2025-02-08T08:29:14.425261	true
inceptionai/jais-adapted-13b-chat	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	💬 : chat models (RLHF, DPO, IFT, ...)	3	13.344	apache-2.0	false	2025-02-06T07:55:33.840204	true
inceptionai/jais-adapted-13b	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	🟢 : pretrained	4	13.344	apache-2.0	false	2025-02-06T08:20:33.375364	false
inceptionai/jais-adapted-70b-chat	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	💬 : chat models (RLHF, DPO, IFT, ...)	6	69.501	apache-2.0	false	2025-02-06T08:10:39.815075	true
inceptionai/jais-adapted-70b	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	🟢 : pretrained	8	69.501	apache-2.0	false	2025-02-06T08:05:33.250540	false
inceptionai/jais-adapted-7b-chat	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	💬 : chat models (RLHF, DPO, IFT, ...)	3	7.001	apache-2.0	false	2025-02-06T08:00:33.749859	true
inceptionai/jais-adapted-7b	main	float16	Original	FINISHED	2025-01-22T12:22:56Z	🟢 : pretrained	5	7.001	apache-2.0	false	2025-02-06T08:15:34.315914	false
inceptionai/jais-family-13b-chat	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	💬 : chat models (RLHF, DPO, IFT, ...)	4	13	apache-2.0	false	2025-02-06T07:35:32.981629	true
inceptionai/jais-family-13b	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	🟢 : pretrained	4	13	apache-2.0	false	2025-02-06T07:25:32.458725	false
inceptionai/jais-family-30b-16k-chat	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	💬 : chat models (RLHF, DPO, IFT, ...)	4	30	apache-2.0	false	2025-02-06T11:53:58.086928	true
inceptionai/jais-family-30b-16k	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	🟢 : pretrained	7	30	apache-2.0	false	2025-02-06T11:54:24.081900	false
inceptionai/jais-family-30b-8k-chat	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	💬 : chat models (RLHF, DPO, IFT, ...)	4	30	apache-2.0	false	2025-02-06T07:20:32.329369	true
inceptionai/jais-family-30b-8k	main	float16	Original	FINISHED	2025-01-21T05:22:20Z	🟢 : pretrained	6	30	apache-2.0	false	2025-02-06T12:30:16.837744	false
maldv/Awqward2.5-32B-Instruct	main	bfloat16	Original	FINISHED	2025-02-16T13:58:37.505999Z	🔶 : fine-tuned on domain-specific datasets	2	32.764	apache-2.0	false	2025-02-16T14:57:15.527270	true
maldv/Qwentile2.5-32B-Instruct	892662a70cc13ffb88809f5b90db080a3d81ffad	bfloat16	Original	FINISHED	2025-02-11T01:04:27.495862Z	🤝 : base merges and merges	31	32.764	apache-2.0	false	2025-02-11T09:47:22.846202	true
meta-llama/Llama-3.1-8B-Instruct	main	bfloat16	Original	FINISHED	2025-03-04T20:19:21.429375Z	💬 : chat models (RLHF, DPO, IFT, ...)	3693	8.03	llama3.1	false	2025-03-04T20:19:50.291565	false
meta-llama/Llama-3.1-8B	main	bfloat16	Original	FINISHED	2025-03-05T18:42:38.644316Z	🟢 : pretrained	1464	8.03	llama3.1	false	2025-03-05T18:51:03.150383	false
meta-llama/Llama-3.3-70B-Instruct	main	bfloat16	Original	FINISHED	2025-01-29T16:03:20.622053Z	💬 : chat models (RLHF, DPO, IFT, ...)	1791	70.554	llama3.3	false	2025-02-08T19:35:00.995484	true
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1	main	bfloat16	Original	FINISHED	2025-02-16T13:50:14.352880Z	🔶 : fine-tuned on domain-specific datasets	8	8.03	mit	false	2025-02-16T13:57:14.711888	true
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1	main	bfloat16	Original	FINISHED	2025-02-16T13:53:37.834456Z	🔶 : fine-tuned on domain-specific datasets	15	7.616	mit	false	2025-02-16T14:27:14.153900	true
recoilme/recoilme-gemma-2-9B-v0.2	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🔶 : fine-tuned on domain-specific datasets	0	10.159	cc-by-nc-4.0	false	2025-02-08T09:42:21.044400	true
recoilme/recoilme-gemma-2-9B-v0.4	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	🔶 : fine-tuned on domain-specific datasets	0	10.159	cc-by-nc-4.0	false	2025-02-08T09:34:21.199935	true
rombodawg/Rombos-LLM-V2.5-Qwen-72b	main	bfloat16	Original	FINISHED	2025-02-12T11:34:52.981127Z	💬 : chat models (RLHF, DPO, IFT, ...)	35	72.706	other	false	2025-02-14T05:41:55.873866	false
rombodawg/Rombos-LLM-V2.6-Qwen-14b	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🔶 : fine-tuned on domain-specific datasets	17	14.77	apache-2.0	false	2025-02-08T12:30:21.991946	true
silma-ai/SILMA-9B-Instruct-v1.0	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	9.242	gemma	false	2025-02-08T09:50:21.448289	true
silma-ai/SILMA-Kashif-2B-Instruct-v1.0	main	bfloat16	Original	FINISHED	2025-02-12T13:30:18.234483Z	💬 : chat models (RLHF, DPO, IFT, ...)	13	2.614	gemma	false	2025-02-12T13:50:19.980202	true
speakleash/Bielik-11B-v2	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	🟩 : continuously pretrained	34	11.169	apache-2.0	false	2025-02-09T07:32:43.195383	false
tanliboy/lambda-qwen2.5-14b-dpo-test	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	2	14.77	apache-2.0	false	2025-02-08T12:54:21.935778	true
tanliboy/lambda-qwen2.5-32b-dpo-test	main	bfloat16	Original	FINISHED	2025-01-19T07:28:17Z	💬 : chat models (RLHF, DPO, IFT, ...)	1	32.764	apache-2.0	false	2025-02-06T06:40:32.398695	true
tiiuae/Falcon3-10B-Base	main	bfloat16	Original	FINISHED	2025-02-12T11:08:16.453425Z	💬 : chat models (RLHF, DPO, IFT, ...)	33	10.306	other	false	2025-02-12T17:45:11.108494	false
tiiuae/Falcon3-7B-Base	main	bfloat16	Original	FINISHED	2025-02-12T11:06:18.513886Z	💬 : chat models (RLHF, DPO, IFT, ...)	24	7.456	other	false	2025-02-12T11:20:01.605414	false
upstage/SOLAR-10.7B-v1.0	main	float16	Original	FINISHED	2025-01-19T07:28:17Z	🟢 : pretrained	233	10.732	apache-2.0	false	2025-02-08T13:02:21.896392	false
v000000/Qwen2.5-14B-Gutenberg-1e-Delta	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	2	14.77	apache-2.0	false	2025-02-08T09:58:20.517925	true
v000000/Qwen2.5-Lumen-14B	main	bfloat16	Original	FINISHED	2025-01-18T11:14:25Z	💬 : chat models (RLHF, DPO, IFT, ...)	2	14.77	apache-2.0	false	2025-02-08T10:06:20.537013	true
yellowtown/7B-v0.2	3b4cfeea5eaad38d37dd6016fff949fc271189ee	bfloat16	Original	FINISHED	2025-02-14T08:56:37.440691Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	7.616	apache-2.0	false	2025-02-14T09:24:48.249354	false
yellowtown/7B-v0.2	be5fac4dda0fbf83403ef35d5009266f88669491	bfloat16	Original	FINISHED	2025-01-23T12:14:45Z	🔶 : fine-tuned on domain-specific datasets	0	7.616	apache-2.0	false	2025-02-06T08:30:33.581302	true

model	base_model	revision	precision	weight_type	status	submitted_time	model_type	likes	params	license	private	job_id	job_start_time	chat_template
microsoft/Phi-4-multimodal-instruct		main	bfloat16	Original	FAILED	2025-02-19T10:29:30.198367Z	💬 : chat models (RLHF, DPO, IFT, ...)	242	107.814	other	false		2025-02-19T11:30:40.535277	false

model	revision	precision	weight_type	status	submitted_time	model_type	likes	params	license	private	job_start_time	chat_template
Sakalti/ultiima-108B	main	float16	Original	FAILED	2025-02-19T10:29:30.198367Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	107.814	other	false	2025-02-19T11:30:40.535277	false
Sakalti/ultiima-125B	main	float16	Original	FAILED	2025-02-19T10:28:09.333042Z	💬 : chat models (RLHF, DPO, IFT, ...)	0	125.367	other	false	2025-02-19T10:30:36.208911	false
microsoft/Phi-4-multimodal-instruct	main	bfloat16	Original	FAILED	2025-02-27T11:20:15.578684Z	💬 : chat models (RLHF, DPO, IFT, ...)	242	5.574	mit	false	2025-02-27T11:40:16.785764	true

About

While outstanding LLM models are being released competitively, most of them are centered on English and are familiar with the English cultural sphere. We operate the Open Arabic LLM Leaderboard (OALL), to evaluate models that reflect the characteristics of the Arabic language, culture and heritage. Through this, we hope that users can conveniently use the leaderboard, participate, and contribute to the advancement of research in the Arab region 🔥.

Icons & Model types

🟢 : pretrained

🟩 : continuously pretrained

💬 : chat models (RLHF, DPO, IFT, ...)

🔶 : fine-tuned on domain-specific datasets

🤝 : base merges and moerges

Notes:

We reserve the right to correct any incorrect tags or icons after manual verification to ensure the accuracy and reliability of the leaderboard. This helps maintain the integrity and trustworthiness of the platform.
Some models may be flagged as “Subjects of Caution” by the community. These models might have used the evaluation set for training, attempted to manipulate rankings, or raised ethical concerns. Models deemed as such may face restricted visibility or removal from the leaderboard. Users are advised to exercise discretion when interpreting rankings.
The leaderboard automatically hides models that were submitted, evaluated, and subsequently made private or gated post-evaluation. This platform is designed for “open” models that benefit the wider community. If you intend to restrict your model’s accessibility after using the leaderboard’s resources or exploit the platform solely for personal gains, please refrain from submitting. Violators may face bans on their usernames and/or organization IDs from future submissions.
The leaderboard no longer accepts models in float32 precision except under special circumstances. If you are the developer of a float32 model and believe it deserves inclusion, please reach out to us.
To ensure fair and equitable access to leaderboard resources, all usernames and organization IDs are limited to 5 submissions per week. This policy minimizes spamming, encourages thoughtful participation, and allows everyone in the community to benefit from the platform.

By adhering to these guidelines, we aim to foster a fair, collaborative, and transparent environment for evaluating and advancing open models for the arabic/arabic-interested communities.

How it works

📈 We evaluate models using LightEval, a unified and straightforward framework from the HuggingFace Eval Team to test and assess causal language models on a large number of different evaluation tasks.

To ensure a fair and unbiased assessment of the models' true capabilities, all evaluations are conducted in zero-shot settings 0-shots. This approach eliminates any potential advantage from task-specific fine-tuning, providing a clear indication of how well the models can generalize to new tasks.

Also, given the nature of the tasks, which include multiple-choice questions, the leaderboard primarily uses normalized log likelihood accuracy loglikelihood_acc_norm for all tasks.

Please, consider reaching out to us through the discussions tab if you are working on benchmarks for Arabic LLMs and willing to see them on this leaderboard as well. Your benchmark might change the whole game for Arabic models !

Details and Logs

Detailed numerical results in the results OALL dataset: https://huggingface.co/datasets/OALL/v2_results
Community queries and running status in the requests OALL dataset: https://huggingface.co/datasets/OALL/requests_v2

More resources

For evaluations of chat models using 3C3H on generative tasks benchmarks, please refer to the AraGen-Leaderboard.

If you still have questions, you can check our FAQ here!