1sec.ai

Tag

#arabic-llm

Every item tagged arabic-llm, newest first.

4 items

๐Ÿ“š 3LM: A Benchmark for Arabic LLMs in STEM and Code

The 3LM benchmark evaluates Arabic LLMs in STEM and coding tasks, providing a dataset and metrics for assessing performance. It aims to improve Arabic language support in LLMs. You can use 3LM to compare models and identify areas for improvement. The benchmark is open-source and available on the Hugging Face platform.

Key takeaways
  • 3LM benchmark assesses Arabic LLMs in STEM and coding.
  • Open-source dataset and metrics for evaluating performance.
  • Available on Hugging Face platform.
modelsMay 21

Falcon-Arabic: A Breakthrough in Arabic Language Models

The TII UAE team released Falcon-Arabic, a 1.5B parameter model that achieves state-of-the-art performance on Arabic language tasks. Falcon-Arabic outperforms existing models like CAMeLBERT and AraBERT on several benchmarks. You can access and fine-tune Falcon-Arabic through the Hugging Face platform.

Key takeaways
  • Falcon-Arabic sets new state-of-the-art on Arabic language benchmarks.
  • 1.5B parameter model outperforms CAMeLBERT and AraBERT.
  • Available on Hugging Face for access and fine-tuning.
modelsFeb 10

The Open Arabic LLM Leaderboard 2

The Open Arabic LLM Leaderboard 2 has been released on Hugging Face, providing updated rankings of Arabic-language models. The leaderboard evaluates models on tasks like sentiment analysis and question-answering. You can use this leaderboard to compare and select suitable models for your Arabic-language NLP projects. The leaderboard aims to support the development of more capable Arabic-language models.

Key takeaways
  • Leaderboard evaluates models on Arabic-language tasks.
  • Supports development of more capable Arabic-language models.
  • Available on Hugging Face platform.
researchMay 14

Introducing the Open Arabic LLM Leaderboard

The Open Arabic LLM Leaderboard evaluates Arabic language models on tasks like sentiment analysis and question-answering. It provides a benchmark for Arabic NLP progress. You can use it to compare models and track improvements. The leaderboard is open-source and hosted on the Hugging Face platform.

Key takeaways
  • Evaluates models on Arabic language tasks.
  • Benchmarks progress in Arabic NLP.
  • Open-source and hosted on Hugging Face.