Open LLM Leaderboard
The open-source large model ranking list launched by Hugging Face.
CMMLU is a comprehensive evaluation benchmark specifically designed to evaluate the knowledge and reasoning abilities of LLMs within the context of Chinese language and culture. CMMLU covers a wide range of subjects, comprising 67 topics that span from elementary to advanced professional levels. It includes subjects that require computational expertise, such as physics and mathematics, as well as disciplines within humanities and social sciences. Many of these tasks are not easily translatable from other languages due to their specific contextual nuances and wording. Furthermore, numerous tasks within CMMLU have answers that are specific to China and may not be universally applicable or considered correct in other regions or languages.
Similar Sites
Chatbot Arena
Chatbot Arena is an open platform for crowdsourced AI benchmarking.
FlagEval
The FlagEval (Tiancheng) large model evaluation platform launched by the Beijing Academy of Artificial Intelligence (BAAI).
OpenCompass
The large model open evaluation system launched by Shanghai AI Laboratory
C-Eval
A comprehensive Chinese basic model evaluation suite.
PubMedQA
Biomedical Research Q&A Dataset and Model Score Ranking List
MMBench
An all-round multimodal large model capability evaluation system.
MMLU
Massive Multitask Language Understanding Benchmark.
No comments yet...