Ehab Saleh | techkahwa.net Model released: July 10, 2025 | Published: July 24, 2025 The numbers first Metric Result What it measures Source Artificial Analysis Intelligence Index 22 on the index scale at time of measurement Composite general intelligence Artificial Analysis Context window 256K tokens Text processed in a single pass Artificial Analysis Price $3 … Read more
Ehab Saleh | techkahwa.net Model released: April 28, 2025 | Published: May 12, 2025 The numbers first Metric Result What it measures Source HELM Arabic, best open-weights model Qwen3 235B, mean 0.786 Seven native Arabic benchmarks Stanford CRFM and Arabic.AI, December 2025 HELM Arabic, open models in the top ten Four, including Qwen3 235B and … Read more
Ehab Saleh | techkahwa.net Model released: April 5, 2025 | Published: April 19, 2025 The numbers first Metric Result What it measures Source HELM Arabic Llama 4 Maverick among the top ten open-weights models Seven native Arabic benchmarks Stanford CRFM and Arabic.AI, December 2025 OALL leaderboard, chat models Llama3.3-70B-Instruct in first place Native Arabic benchmarks … Read more
Baseline releases: October 2024 and March 25, 2025 | Published: April 8, 2025 Ehab Saleh | techkahwa.net The numbers first What changed Before After Source OALL leaderboard Version one, partly built on machine-translated benchmarks Version two dropped the translations for native benchmarks: ArabicMMLU, MadinahQA, AraTrust, ALRAGE OALL v2 Arabic speech measurement No multidialectal shared task … Read more
Ehab Saleh | techkahwa.net Model released: January 20, 2025 | Published: February 3, 2025 The numbers first Metric Result What it measures Source XReasoning, thinking-language match rate 46.3% on AIME and 42.3% on GPQA for the largest R1-distilled model Does the model think in the language it was asked to? arXiv 2505.22888 XReasoning, after forcing … Read more
Ehab Saleh | techkahwa.net Paper released: July 22, 2024 | Published: August 12, 2024 The numbers first Metric Result What it measures Source Total Arabic curated 540 billion tokens The size of the Arabic corpus ALLaM paper, arXiv:2407.15390 Of which natural Arabic 270 billion Half the total Same paper, quoted verbatim Of which machine-translated Arabic … Read more
Ehab Saleh | techkahwa.net Model released: July 23, 2024 | Published: August 6, 2024 The numbers first Metric Result What it measures Source Officially supported languages Eight: English, German, French, Italian, Portuguese, Hindi, Spanish, Thai Meta’s declared commitment Llama 3.1 model card Arabic among them No Whether your language is on the list Same card … Read more
Ehab Saleh | techkahwa.net Model released: June 7, 2024 | Published: June 21, 2024 The numbers first Metric Result What it measures Source Declared languages 27 beyond English and Chinese The model’s scope Qwen2 blog, June 7, 2024 The “Middle East” group Arabic, Persian, Hebrew, Turkish An explicit named regional classification Same source The technical … Read more
Ehab Saleh | techkahwa.net Model released: May 23, 2024 | Published: June 6, 2024 The numbers first Metric Result What it measures Source Number of languages 23 The model’s scope Aya 23 technical report Arabic’s position on the list First Alphabetical in English, but named explicitly Same report The languages Arabic, Chinese, Czech, Dutch, English, … Read more
Ehab Saleh | techkahwa.net Leaderboard launched: May 14, 2024 | Published: June 4, 2024 The numbers first Metric Result What it measures Source Leaderboard launch date May 14, 2024 Hugging Face with the Technology Innovation Institute Launch blog The original AlGhafa benchmark Roughly a dozen datasets, mostly native Arabic The Arabic foundation Almazrouei et al., … Read more