Score

• Argilla Notus 7B v1 on ARC: Score Breakdown
• Argilla Notus 7B v1 on BBH (BIG-Bench Hard): Score Breakdown
• Argilla Notus 7B v1 on GPQA: Score Breakdown
• Argilla Notus 7B v1 on GSM8K (Grade School Math 8K): Score Breakdown
• Argilla Notus 7B v1 on HumanEval: Score Breakdown
• Argilla Notus 7B v1 on IFEval: Score Breakdown
• Argilla Notus 7B v1 on MATH: Score Breakdown
• Argilla Notus 7B v1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Argilla Notus 7B v1 on MUSR: Score Breakdown
• Argilla Notus 7B v1 on WinoGrande: Score Breakdown
• Baichuan2 13B Chat on ARC: Score Breakdown
• Baichuan2 13B Chat on BBH (BIG-Bench Hard): Score Breakdown
• Baichuan2 13B Chat on GPQA: Score Breakdown
• Baichuan2 13B Chat on GSM8K (Grade School Math 8K): Score Breakdown
• Baichuan2 13B Chat on HumanEval: Score Breakdown
• Baichuan2 13B Chat on IFEval: Score Breakdown
• Baichuan2 13B Chat on MATH: Score Breakdown
• Baichuan2 13B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Baichuan2 13B Chat on MUSR: Score Breakdown
• Baichuan2 13B Chat on WinoGrande: Score Breakdown
• Baichuan2 7B Chat on ARC: Score Breakdown
• Baichuan2 7B Chat on BBH (BIG-Bench Hard): Score Breakdown
• Baichuan2 7B Chat on GPQA: Score Breakdown
• Baichuan2 7B Chat on GSM8K (Grade School Math 8K): Score Breakdown
• Baichuan2 7B Chat on HumanEval: Score Breakdown
• Baichuan2 7B Chat on IFEval: Score Breakdown
• Baichuan2 7B Chat on MATH: Score Breakdown
• Baichuan2 7B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Baichuan2 7B Chat on MUSR: Score Breakdown
• Baichuan2 7B Chat on WinoGrande: Score Breakdown
• Capybara 1.5B on ARC: Score Breakdown
• Capybara 1.5B on BBH (BIG-Bench Hard): Score Breakdown
• Capybara 1.5B on GPQA: Score Breakdown
• Capybara 1.5B on GSM8K (Grade School Math 8K): Score Breakdown
• Capybara 1.5B on HumanEval: Score Breakdown
• Capybara 1.5B on IFEval: Score Breakdown
• Capybara 1.5B on MATH: Score Breakdown
• Capybara 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Capybara 1.5B on MUSR: Score Breakdown
• Capybara 1.5B on WinoGrande: Score Breakdown
• Chat Bison on ARC: Score Breakdown
• Chat Bison on BBH (BIG-Bench Hard): Score Breakdown
• Chat Bison on GPQA: Score Breakdown
• Chat Bison on GSM8K (Grade School Math 8K): Score Breakdown
• Chat Bison on HumanEval: Score Breakdown
• Chat Bison on IFEval: Score Breakdown
• Chat Bison on MATH: Score Breakdown
• Chat Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Chat Bison on MUSR: Score Breakdown
• Chat Bison on WinoGrande: Score Breakdown
• ChatGLM3 6B on ARC: Score Breakdown
• ChatGLM3 6B on BBH (BIG-Bench Hard): Score Breakdown
• ChatGLM3 6B on GPQA: Score Breakdown
• ChatGLM3 6B on GSM8K (Grade School Math 8K): Score Breakdown
• ChatGLM3 6B on HumanEval: Score Breakdown
• ChatGLM3 6B on IFEval: Score Breakdown
• ChatGLM3 6B on MATH: Score Breakdown
• ChatGLM3 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• ChatGLM3 6B on MUSR: Score Breakdown
• ChatGLM3 6B on WinoGrande: Score Breakdown
• Claude 2 on ARC: Score Breakdown
• Claude 2 on BBH (BIG-Bench Hard): Score Breakdown
• Claude 2 on GPQA: Score Breakdown
• Claude 2 on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 2 on HumanEval: Score Breakdown
• Claude 2 on IFEval: Score Breakdown
• Claude 2 on MATH: Score Breakdown
• Claude 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 2 on MUSR: Score Breakdown
• Claude 2 on WinoGrande: Score Breakdown
• Claude 2.1 on ARC: Score Breakdown
• Claude 2.1 on BBH (BIG-Bench Hard): Score Breakdown
• Claude 2.1 on GPQA: Score Breakdown
• Claude 2.1 on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 2.1 on HumanEval: Score Breakdown
• Claude 2.1 on IFEval: Score Breakdown
• Claude 2.1 on MATH: Score Breakdown
• Claude 2.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 2.1 on MUSR: Score Breakdown
• Claude 2.1 on WinoGrande: Score Breakdown
• Claude 3 Haiku (2024-03-07) on ARC: Score Breakdown
• Claude 3 Haiku (2024-03-07) on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Haiku (2024-03-07) on GPQA: Score Breakdown
• Claude 3 Haiku (2024-03-07) on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Haiku (2024-03-07) on HumanEval: Score Breakdown
• Claude 3 Haiku (2024-03-07) on IFEval: Score Breakdown
• Claude 3 Haiku (2024-03-07) on MATH: Score Breakdown
• Claude 3 Haiku (2024-03-07) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Haiku (2024-03-07) on MUSR: Score Breakdown
• Claude 3 Haiku (2024-03-07) on WinoGrande: Score Breakdown
• Claude 3 Haiku on ARC: Score Breakdown
• Claude 3 Haiku on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Haiku on GPQA: Score Breakdown
• Claude 3 Haiku on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Haiku on HumanEval: Score Breakdown
• Claude 3 Haiku on IFEval: Score Breakdown
• Claude 3 Haiku on MATH: Score Breakdown
• Claude 3 Haiku on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Haiku on MUSR: Score Breakdown
• Claude 3 Haiku on WinoGrande: Score Breakdown
• Claude 3 Opus (2024-02-29) on ARC: Score Breakdown
• Claude 3 Opus (2024-02-29) on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Opus (2024-02-29) on GPQA: Score Breakdown
• Claude 3 Opus (2024-02-29) on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Opus (2024-02-29) on HumanEval: Score Breakdown
• Claude 3 Opus (2024-02-29) on IFEval: Score Breakdown
• Claude 3 Opus (2024-02-29) on MATH: Score Breakdown
• Claude 3 Opus (2024-02-29) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Opus (2024-02-29) on MUSR: Score Breakdown
• Claude 3 Opus (2024-02-29) on WinoGrande: Score Breakdown
• Claude 3 Opus on ARC: Score Breakdown
• Claude 3 Opus on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Opus on GPQA: Score Breakdown
• Claude 3 Opus on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Opus on HumanEval: Score Breakdown
• Claude 3 Opus on IFEval: Score Breakdown
• Claude 3 Opus on MATH: Score Breakdown
• Claude 3 Opus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Opus on MUSR: Score Breakdown
• Claude 3 Opus on WinoGrande: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on ARC: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Sonnet (2024-02-29) on GPQA: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Sonnet (2024-02-29) on HumanEval: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on IFEval: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on MATH: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Sonnet (2024-02-29) on MUSR: Score Breakdown
• Claude 3 Sonnet (2024-02-29) on WinoGrande: Score Breakdown
• Claude 3 Sonnet on ARC: Score Breakdown
• Claude 3 Sonnet on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3 Sonnet on GPQA: Score Breakdown
• Claude 3 Sonnet on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3 Sonnet on HumanEval: Score Breakdown
• Claude 3 Sonnet on IFEval: Score Breakdown
• Claude 3 Sonnet on MATH: Score Breakdown
• Claude 3 Sonnet on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Sonnet on MUSR: Score Breakdown
• Claude 3 Sonnet on WinoGrande: Score Breakdown
• Claude 3.5 Haiku on ARC: Score Breakdown
• Claude 3.5 Haiku on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3.5 Haiku on GPQA: Score Breakdown
• Claude 3.5 Haiku on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3.5 Haiku on HumanEval: Score Breakdown
• Claude 3.5 Haiku on IFEval: Score Breakdown
• Claude 3.5 Haiku on MATH: Score Breakdown
• Claude 3.5 Haiku on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3.5 Haiku on MUSR: Score Breakdown
• Claude 3.5 Haiku on WinoGrande: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on ARC: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on GPQA: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on HumanEval: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on IFEval: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on MATH: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on MUSR: Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on WinoGrande: Score Breakdown
• Claude 3.5 Sonnet on BBH (BIG-Bench Hard): Score Breakdown
• Claude 3.5 Sonnet on GSM8K (Grade School Math 8K): Score Breakdown
• Claude 3.5 Sonnet on HumanEval: Score Breakdown
• Claude 3.5 Sonnet on MATH: Score Breakdown
• Claude 3.5 Sonnet on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude Instant 1 on ARC: Score Breakdown
• Claude Instant 1 on BBH (BIG-Bench Hard): Score Breakdown
• Claude Instant 1 on GPQA: Score Breakdown
• Claude Instant 1 on GSM8K (Grade School Math 8K): Score Breakdown
• Claude Instant 1 on HumanEval: Score Breakdown
• Claude Instant 1 on IFEval: Score Breakdown
• Claude Instant 1 on MATH: Score Breakdown
• Claude Instant 1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude Instant 1 on MUSR: Score Breakdown
• Claude Instant 1 on WinoGrande: Score Breakdown
• Code Bison on ARC: Score Breakdown
• Code Bison on BBH (BIG-Bench Hard): Score Breakdown
• Code Bison on GPQA: Score Breakdown
• Code Bison on GSM8K (Grade School Math 8K): Score Breakdown
• Code Bison on HumanEval: Score Breakdown
• Code Bison on IFEval: Score Breakdown
• Code Bison on MATH: Score Breakdown
• Code Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Bison on MUSR: Score Breakdown
• Code Bison on WinoGrande: Score Breakdown
• Code Llama 13B on ARC: Score Breakdown
• Code Llama 13B on BBH (BIG-Bench Hard): Score Breakdown
• Code Llama 13B on GPQA: Score Breakdown
• Code Llama 13B on GSM8K (Grade School Math 8K): Score Breakdown
• Code Llama 13B on HumanEval: Score Breakdown
• Code Llama 13B on IFEval: Score Breakdown
• Code Llama 13B on MATH: Score Breakdown
• Code Llama 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 13B on MUSR: Score Breakdown
• Code Llama 13B on WinoGrande: Score Breakdown
• Code Llama 34B on ARC: Score Breakdown
• Code Llama 34B on BBH (BIG-Bench Hard): Score Breakdown
• Code Llama 34B on GPQA: Score Breakdown
• Code Llama 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Code Llama 34B on HumanEval: Score Breakdown
• Code Llama 34B on IFEval: Score Breakdown
• Code Llama 34B on MATH: Score Breakdown
• Code Llama 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 34B on MUSR: Score Breakdown
• Code Llama 34B on WinoGrande: Score Breakdown
• Code Llama 70B on ARC: Score Breakdown
• Code Llama 70B on BBH (BIG-Bench Hard): Score Breakdown
• Code Llama 70B on GPQA: Score Breakdown
• Code Llama 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Code Llama 70B on HumanEval: Score Breakdown
• Code Llama 70B on IFEval: Score Breakdown
• Code Llama 70B on MATH: Score Breakdown
• Code Llama 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 70B on MUSR: Score Breakdown
• Code Llama 70B on WinoGrande: Score Breakdown
• Code Llama 7B on ARC: Score Breakdown
• Code Llama 7B on BBH (BIG-Bench Hard): Score Breakdown
• Code Llama 7B on GPQA: Score Breakdown
• Code Llama 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Code Llama 7B on HumanEval: Score Breakdown
• Code Llama 7B on IFEval: Score Breakdown
• Code Llama 7B on MATH: Score Breakdown
• Code Llama 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 7B on MUSR: Score Breakdown
• Code Llama 7B on WinoGrande: Score Breakdown
• Codestral Mamba on ARC: Score Breakdown
• Codestral Mamba on BBH (BIG-Bench Hard): Score Breakdown
• Codestral Mamba on GPQA: Score Breakdown
• Codestral Mamba on GSM8K (Grade School Math 8K): Score Breakdown
• Codestral Mamba on HumanEval: Score Breakdown
• Codestral Mamba on IFEval: Score Breakdown
• Codestral Mamba on MATH: Score Breakdown
• Codestral Mamba on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Codestral Mamba on MUSR: Score Breakdown
• Codestral Mamba on WinoGrande: Score Breakdown
• Codestral on ARC: Score Breakdown
• Codestral on BBH (BIG-Bench Hard): Score Breakdown
• Codestral on GPQA: Score Breakdown
• Codestral on GSM8K (Grade School Math 8K): Score Breakdown
• Codestral on HumanEval: Score Breakdown
• Codestral on IFEval: Score Breakdown
• Codestral on MATH: Score Breakdown
• Codestral on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Codestral on MUSR: Score Breakdown
• Codestral on WinoGrande: Score Breakdown
• Command Light on ARC: Score Breakdown
• Command Light on BBH (BIG-Bench Hard): Score Breakdown
• Command Light on GPQA: Score Breakdown
• Command Light on GSM8K (Grade School Math 8K): Score Breakdown
• Command Light on HumanEval: Score Breakdown
• Command Light on IFEval: Score Breakdown
• Command Light on MATH: Score Breakdown
• Command Light on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command Light on MUSR: Score Breakdown
• Command Light on WinoGrande: Score Breakdown
• Command Nightly on ARC: Score Breakdown
• Command Nightly on BBH (BIG-Bench Hard): Score Breakdown
• Command Nightly on GPQA: Score Breakdown
• Command Nightly on GSM8K (Grade School Math 8K): Score Breakdown
• Command Nightly on HumanEval: Score Breakdown
• Command Nightly on IFEval: Score Breakdown
• Command Nightly on MATH: Score Breakdown
• Command Nightly on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command Nightly on MUSR: Score Breakdown
• Command Nightly on WinoGrande: Score Breakdown
• Command R (08-2024) on ARC: Score Breakdown
• Command R (08-2024) on BBH (BIG-Bench Hard): Score Breakdown
• Command R (08-2024) on GPQA: Score Breakdown
• Command R (08-2024) on GSM8K (Grade School Math 8K): Score Breakdown
• Command R (08-2024) on HumanEval: Score Breakdown
• Command R (08-2024) on IFEval: Score Breakdown
• Command R (08-2024) on MATH: Score Breakdown
• Command R (08-2024) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R (08-2024) on MUSR: Score Breakdown
• Command R (08-2024) on WinoGrande: Score Breakdown
• Command R on ARC: Score Breakdown
• Command R on BBH (BIG-Bench Hard): Score Breakdown
• Command R on GPQA: Score Breakdown
• Command R on GSM8K (Grade School Math 8K): Score Breakdown
• Command R on HumanEval: Score Breakdown
• Command R on IFEval: Score Breakdown
• Command R on MATH: Score Breakdown
• Command R on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R on MUSR: Score Breakdown
• Command R on WinoGrande: Score Breakdown
• Command R+ (08-2024) on ARC: Score Breakdown
• Command R+ (08-2024) on BBH (BIG-Bench Hard): Score Breakdown
• Command R+ (08-2024) on GPQA: Score Breakdown
• Command R+ (08-2024) on GSM8K (Grade School Math 8K): Score Breakdown
• Command R+ (08-2024) on HumanEval: Score Breakdown
• Command R+ (08-2024) on IFEval: Score Breakdown
• Command R+ (08-2024) on MATH: Score Breakdown
• Command R+ (08-2024) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R+ (08-2024) on MUSR: Score Breakdown
• Command R+ (08-2024) on WinoGrande: Score Breakdown
• Command R+ on BBH (BIG-Bench Hard): Score Breakdown
• Command R+ on GSM8K (Grade School Math 8K): Score Breakdown
• Command R+ on HumanEval: Score Breakdown
• Command R+ on MATH: Score Breakdown
• Command R+ on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R7B on ARC: Score Breakdown
• Command R7B on BBH (BIG-Bench Hard): Score Breakdown
• Command R7B on GPQA: Score Breakdown
• Command R7B on GSM8K (Grade School Math 8K): Score Breakdown
• Command R7B on HumanEval: Score Breakdown
• Command R7B on IFEval: Score Breakdown
• Command R7B on MATH: Score Breakdown
• Command R7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R7B on MUSR: Score Breakdown
• Command R7B on WinoGrande: Score Breakdown
• DBRX Base on ARC: Score Breakdown
• DBRX Base on BBH (BIG-Bench Hard): Score Breakdown
• DBRX Base on GPQA: Score Breakdown
• DBRX Base on GSM8K (Grade School Math 8K): Score Breakdown
• DBRX Base on HumanEval: Score Breakdown
• DBRX Base on IFEval: Score Breakdown
• DBRX Base on MATH: Score Breakdown
• DBRX Base on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DBRX Base on MUSR: Score Breakdown
• DBRX Base on WinoGrande: Score Breakdown
• DBRX Instruct on ARC: Score Breakdown
• DBRX Instruct on BBH (BIG-Bench Hard): Score Breakdown
• DBRX Instruct on GPQA: Score Breakdown
• DBRX Instruct on GSM8K (Grade School Math 8K): Score Breakdown
• DBRX Instruct on HumanEval: Score Breakdown
• DBRX Instruct on IFEval: Score Breakdown
• DBRX Instruct on MATH: Score Breakdown
• DBRX Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DBRX Instruct on MUSR: Score Breakdown
• DBRX Instruct on WinoGrande: Score Breakdown
• DeepSeek Coder 33B on ARC: Score Breakdown
• DeepSeek Coder 33B on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek Coder 33B on GPQA: Score Breakdown
• DeepSeek Coder 33B on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek Coder 33B on HumanEval: Score Breakdown
• DeepSeek Coder 33B on IFEval: Score Breakdown
• DeepSeek Coder 33B on MATH: Score Breakdown
• DeepSeek Coder 33B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder 33B on MUSR: Score Breakdown
• DeepSeek Coder 33B on WinoGrande: Score Breakdown
• DeepSeek Coder 7B on ARC: Score Breakdown
• DeepSeek Coder 7B on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek Coder 7B on GPQA: Score Breakdown
• DeepSeek Coder 7B on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek Coder 7B on HumanEval: Score Breakdown
• DeepSeek Coder 7B on IFEval: Score Breakdown
• DeepSeek Coder 7B on MATH: Score Breakdown
• DeepSeek Coder 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder 7B on MUSR: Score Breakdown
• DeepSeek Coder 7B on WinoGrande: Score Breakdown
• DeepSeek Coder V2 on ARC: Score Breakdown
• DeepSeek Coder V2 on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek Coder V2 on GPQA: Score Breakdown
• DeepSeek Coder V2 on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek Coder V2 on HumanEval: Score Breakdown
• DeepSeek Coder V2 on IFEval: Score Breakdown
• DeepSeek Coder V2 on MATH: Score Breakdown
• DeepSeek Coder V2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder V2 on MUSR: Score Breakdown
• DeepSeek Coder V2 on WinoGrande: Score Breakdown
• DeepSeek LLM 67B on ARC: Score Breakdown
• DeepSeek LLM 67B on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek LLM 67B on GPQA: Score Breakdown
• DeepSeek LLM 67B on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek LLM 67B on HumanEval: Score Breakdown
• DeepSeek LLM 67B on IFEval: Score Breakdown
• DeepSeek LLM 67B on MATH: Score Breakdown
• DeepSeek LLM 67B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek LLM 67B on MUSR: Score Breakdown
• DeepSeek LLM 67B on WinoGrande: Score Breakdown
• DeepSeek Math 7B on ARC: Score Breakdown
• DeepSeek Math 7B on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek Math 7B on GPQA: Score Breakdown
• DeepSeek Math 7B on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek Math 7B on HumanEval: Score Breakdown
• DeepSeek Math 7B on IFEval: Score Breakdown
• DeepSeek Math 7B on MATH: Score Breakdown
• DeepSeek Math 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Math 7B on MUSR: Score Breakdown
• DeepSeek Math 7B on WinoGrande: Score Breakdown
• DeepSeek V2 Chat on ARC: Score Breakdown
• DeepSeek V2 Chat on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek V2 Chat on GPQA: Score Breakdown
• DeepSeek V2 Chat on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek V2 Chat on HumanEval: Score Breakdown
• DeepSeek V2 Chat on IFEval: Score Breakdown
• DeepSeek V2 Chat on MATH: Score Breakdown
• DeepSeek V2 Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek V2 Chat on MUSR: Score Breakdown
• DeepSeek V2 Chat on WinoGrande: Score Breakdown
• DeepSeek V2 on ARC: Score Breakdown
• DeepSeek V2 on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek V2 on GPQA: Score Breakdown
• DeepSeek V2 on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek V2 on HumanEval: Score Breakdown
• DeepSeek V2 on IFEval: Score Breakdown
• DeepSeek V2 on MATH: Score Breakdown
• DeepSeek V2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek V2 on MUSR: Score Breakdown
• DeepSeek V2 on WinoGrande: Score Breakdown
• DeepSeek V3 on BBH (BIG-Bench Hard): Score Breakdown
• DeepSeek V3 on GSM8K (Grade School Math 8K): Score Breakdown
• DeepSeek V3 on HumanEval: Score Breakdown
• DeepSeek V3 on MATH: Score Breakdown
• DeepSeek V3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Embed English v3 on ARC: Score Breakdown
• Embed English v3 on BBH (BIG-Bench Hard): Score Breakdown
• Embed English v3 on GPQA: Score Breakdown
• Embed English v3 on GSM8K (Grade School Math 8K): Score Breakdown
• Embed English v3 on HumanEval: Score Breakdown
• Embed English v3 on IFEval: Score Breakdown
• Embed English v3 on MATH: Score Breakdown
• Embed English v3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Embed English v3 on MUSR: Score Breakdown
• Embed English v3 on WinoGrande: Score Breakdown
• Falcon 180B on ARC: Score Breakdown
• Falcon 180B on BBH (BIG-Bench Hard): Score Breakdown
• Falcon 180B on GPQA: Score Breakdown
• Falcon 180B on GSM8K (Grade School Math 8K): Score Breakdown
• Falcon 180B on HumanEval: Score Breakdown
• Falcon 180B on IFEval: Score Breakdown
• Falcon 180B on MATH: Score Breakdown
• Falcon 180B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Falcon 180B on MUSR: Score Breakdown
• Falcon 180B on WinoGrande: Score Breakdown
• Falcon 40B on ARC: Score Breakdown
• Falcon 40B on BBH (BIG-Bench Hard): Score Breakdown
• Falcon 40B on GPQA: Score Breakdown
• Falcon 40B on GSM8K (Grade School Math 8K): Score Breakdown
• Falcon 40B on HumanEval: Score Breakdown
• Falcon 40B on IFEval: Score Breakdown
• Falcon 40B on MATH: Score Breakdown
• Falcon 40B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Falcon 40B on MUSR: Score Breakdown
• Falcon 40B on WinoGrande: Score Breakdown
• Flan-T5 XL on ARC: Score Breakdown
• Flan-T5 XL on BBH (BIG-Bench Hard): Score Breakdown
• Flan-T5 XL on GPQA: Score Breakdown
• Flan-T5 XL on GSM8K (Grade School Math 8K): Score Breakdown
• Flan-T5 XL on HumanEval: Score Breakdown
• Flan-T5 XL on IFEval: Score Breakdown
• Flan-T5 XL on MATH: Score Breakdown
• Flan-T5 XL on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-T5 XL on MUSR: Score Breakdown
• Flan-T5 XL on WinoGrande: Score Breakdown
• Flan-T5 XXL on ARC: Score Breakdown
• Flan-T5 XXL on BBH (BIG-Bench Hard): Score Breakdown
• Flan-T5 XXL on GPQA: Score Breakdown
• Flan-T5 XXL on GSM8K (Grade School Math 8K): Score Breakdown
• Flan-T5 XXL on HumanEval: Score Breakdown
• Flan-T5 XXL on IFEval: Score Breakdown
• Flan-T5 XXL on MATH: Score Breakdown
• Flan-T5 XXL on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-T5 XXL on MUSR: Score Breakdown
• Flan-T5 XXL on WinoGrande: Score Breakdown
• Flan-UL2 on ARC: Score Breakdown
• Flan-UL2 on BBH (BIG-Bench Hard): Score Breakdown
• Flan-UL2 on GPQA: Score Breakdown
• Flan-UL2 on GSM8K (Grade School Math 8K): Score Breakdown
• Flan-UL2 on HumanEval: Score Breakdown
• Flan-UL2 on IFEval: Score Breakdown
• Flan-UL2 on MATH: Score Breakdown
• Flan-UL2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-UL2 on MUSR: Score Breakdown
• Flan-UL2 on WinoGrande: Score Breakdown
• Gemini 1.0 Flash on ARC: Score Breakdown
• Gemini 1.0 Flash on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.0 Flash on GPQA: Score Breakdown
• Gemini 1.0 Flash on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.0 Flash on HumanEval: Score Breakdown
• Gemini 1.0 Flash on IFEval: Score Breakdown
• Gemini 1.0 Flash on MATH: Score Breakdown
• Gemini 1.0 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Flash on MUSR: Score Breakdown
• Gemini 1.0 Flash on WinoGrande: Score Breakdown
• Gemini 1.0 Pro on ARC: Score Breakdown
• Gemini 1.0 Pro on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.0 Pro on GPQA: Score Breakdown
• Gemini 1.0 Pro on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.0 Pro on HumanEval: Score Breakdown
• Gemini 1.0 Pro on IFEval: Score Breakdown
• Gemini 1.0 Pro on MATH: Score Breakdown
• Gemini 1.0 Pro on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Pro on MUSR: Score Breakdown
• Gemini 1.0 Pro on WinoGrande: Score Breakdown
• Gemini 1.0 Ultra on ARC: Score Breakdown
• Gemini 1.0 Ultra on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.0 Ultra on GPQA: Score Breakdown
• Gemini 1.0 Ultra on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.0 Ultra on HumanEval: Score Breakdown
• Gemini 1.0 Ultra on IFEval: Score Breakdown
• Gemini 1.0 Ultra on MATH: Score Breakdown
• Gemini 1.0 Ultra on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Ultra on MUSR: Score Breakdown
• Gemini 1.0 Ultra on WinoGrande: Score Breakdown
• Gemini 1.5 Flash 002 on ARC: Score Breakdown
• Gemini 1.5 Flash 002 on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Flash 002 on GPQA: Score Breakdown
• Gemini 1.5 Flash 002 on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Flash 002 on HumanEval: Score Breakdown
• Gemini 1.5 Flash 002 on IFEval: Score Breakdown
• Gemini 1.5 Flash 002 on MATH: Score Breakdown
• Gemini 1.5 Flash 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash 002 on MUSR: Score Breakdown
• Gemini 1.5 Flash 002 on WinoGrande: Score Breakdown
• Gemini 1.5 Flash on ARC: Score Breakdown
• Gemini 1.5 Flash on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Flash on GPQA: Score Breakdown
• Gemini 1.5 Flash on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Flash on HumanEval: Score Breakdown
• Gemini 1.5 Flash on IFEval: Score Breakdown
• Gemini 1.5 Flash on MATH: Score Breakdown
• Gemini 1.5 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash on MUSR: Score Breakdown
• Gemini 1.5 Flash on WinoGrande: Score Breakdown
• Gemini 1.5 Flash-8B 002 on ARC: Score Breakdown
• Gemini 1.5 Flash-8B 002 on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Flash-8B 002 on GPQA: Score Breakdown
• Gemini 1.5 Flash-8B 002 on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Flash-8B 002 on HumanEval: Score Breakdown
• Gemini 1.5 Flash-8B 002 on IFEval: Score Breakdown
• Gemini 1.5 Flash-8B 002 on MATH: Score Breakdown
• Gemini 1.5 Flash-8B 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash-8B 002 on MUSR: Score Breakdown
• Gemini 1.5 Flash-8B 002 on WinoGrande: Score Breakdown
• Gemini 1.5 Flash-8B on ARC: Score Breakdown
• Gemini 1.5 Flash-8B on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Flash-8B on GPQA: Score Breakdown
• Gemini 1.5 Flash-8B on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Flash-8B on HumanEval: Score Breakdown
• Gemini 1.5 Flash-8B on IFEval: Score Breakdown
• Gemini 1.5 Flash-8B on MATH: Score Breakdown
• Gemini 1.5 Flash-8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash-8B on MUSR: Score Breakdown
• Gemini 1.5 Flash-8B on WinoGrande: Score Breakdown
• Gemini 1.5 Pro 002 on ARC: Score Breakdown
• Gemini 1.5 Pro 002 on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Pro 002 on GPQA: Score Breakdown
• Gemini 1.5 Pro 002 on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Pro 002 on HumanEval: Score Breakdown
• Gemini 1.5 Pro 002 on IFEval: Score Breakdown
• Gemini 1.5 Pro 002 on MATH: Score Breakdown
• Gemini 1.5 Pro 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Pro 002 on MUSR: Score Breakdown
• Gemini 1.5 Pro 002 on WinoGrande: Score Breakdown
• Gemini 1.5 Pro on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 1.5 Pro on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 1.5 Pro on HumanEval: Score Breakdown
• Gemini 1.5 Pro on MATH: Score Breakdown
• Gemini 1.5 Pro on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 2.0 Flash on ARC: Score Breakdown
• Gemini 2.0 Flash on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 2.0 Flash on GPQA: Score Breakdown
• Gemini 2.0 Flash on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 2.0 Flash on HumanEval: Score Breakdown
• Gemini 2.0 Flash on IFEval: Score Breakdown
• Gemini 2.0 Flash on MATH: Score Breakdown
• Gemini 2.0 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 2.0 Flash on MUSR: Score Breakdown
• Gemini 2.0 Flash on WinoGrande: Score Breakdown
• Gemini 2.0 Flash Thinking on ARC: Score Breakdown
• Gemini 2.0 Flash Thinking on BBH (BIG-Bench Hard): Score Breakdown
• Gemini 2.0 Flash Thinking on GPQA: Score Breakdown
• Gemini 2.0 Flash Thinking on GSM8K (Grade School Math 8K): Score Breakdown
• Gemini 2.0 Flash Thinking on HumanEval: Score Breakdown
• Gemini 2.0 Flash Thinking on IFEval: Score Breakdown
• Gemini 2.0 Flash Thinking on MATH: Score Breakdown
• Gemini 2.0 Flash Thinking on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 2.0 Flash Thinking on MUSR: Score Breakdown
• Gemini 2.0 Flash Thinking on WinoGrande: Score Breakdown
• Gemma 2 27B on ARC: Score Breakdown
• Gemma 2 27B on BBH (BIG-Bench Hard): Score Breakdown
• Gemma 2 27B on GPQA: Score Breakdown
• Gemma 2 27B on GSM8K (Grade School Math 8K): Score Breakdown
• Gemma 2 27B on HumanEval: Score Breakdown
• Gemma 2 27B on IFEval: Score Breakdown
• Gemma 2 27B on MATH: Score Breakdown
• Gemma 2 27B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2 27B on MUSR: Score Breakdown
• Gemma 2 27B on WinoGrande: Score Breakdown
• Gemma 2 9B on ARC: Score Breakdown
• Gemma 2 9B on BBH (BIG-Bench Hard): Score Breakdown
• Gemma 2 9B on GPQA: Score Breakdown
• Gemma 2 9B on GSM8K (Grade School Math 8K): Score Breakdown
• Gemma 2 9B on HumanEval: Score Breakdown
• Gemma 2 9B on IFEval: Score Breakdown
• Gemma 2 9B on MATH: Score Breakdown
• Gemma 2 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2 9B on MUSR: Score Breakdown
• Gemma 2 9B on WinoGrande: Score Breakdown
• Gemma 2B on ARC: Score Breakdown
• Gemma 2B on BBH (BIG-Bench Hard): Score Breakdown
• Gemma 2B on GPQA: Score Breakdown
• Gemma 2B on GSM8K (Grade School Math 8K): Score Breakdown
• Gemma 2B on HumanEval: Score Breakdown
• Gemma 2B on IFEval: Score Breakdown
• Gemma 2B on MATH: Score Breakdown
• Gemma 2B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2B on MUSR: Score Breakdown
• Gemma 2B on WinoGrande: Score Breakdown
• Gemma 7B on ARC: Score Breakdown
• Gemma 7B on BBH (BIG-Bench Hard): Score Breakdown
• Gemma 7B on GPQA: Score Breakdown
• Gemma 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Gemma 7B on HumanEval: Score Breakdown
• Gemma 7B on IFEval: Score Breakdown
• Gemma 7B on MATH: Score Breakdown
• Gemma 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 7B on MUSR: Score Breakdown
• Gemma 7B on WinoGrande: Score Breakdown
• GLM-4 9B Chat on ARC: Score Breakdown
• GLM-4 9B Chat on BBH (BIG-Bench Hard): Score Breakdown
• GLM-4 9B Chat on GPQA: Score Breakdown
• GLM-4 9B Chat on GSM8K (Grade School Math 8K): Score Breakdown
• GLM-4 9B Chat on HumanEval: Score Breakdown
• GLM-4 9B Chat on IFEval: Score Breakdown
• GLM-4 9B Chat on MATH: Score Breakdown
• GLM-4 9B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 9B Chat on MUSR: Score Breakdown
• GLM-4 9B Chat on WinoGrande: Score Breakdown
• GLM-4 Air on ARC: Score Breakdown
• GLM-4 Air on BBH (BIG-Bench Hard): Score Breakdown
• GLM-4 Air on GPQA: Score Breakdown
• GLM-4 Air on GSM8K (Grade School Math 8K): Score Breakdown
• GLM-4 Air on HumanEval: Score Breakdown
• GLM-4 Air on IFEval: Score Breakdown
• GLM-4 Air on MATH: Score Breakdown
• GLM-4 Air on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Air on MUSR: Score Breakdown
• GLM-4 Air on WinoGrande: Score Breakdown
• GLM-4 Flash on ARC: Score Breakdown
• GLM-4 Flash on BBH (BIG-Bench Hard): Score Breakdown
• GLM-4 Flash on GPQA: Score Breakdown
• GLM-4 Flash on GSM8K (Grade School Math 8K): Score Breakdown
• GLM-4 Flash on HumanEval: Score Breakdown
• GLM-4 Flash on IFEval: Score Breakdown
• GLM-4 Flash on MATH: Score Breakdown
• GLM-4 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Flash on MUSR: Score Breakdown
• GLM-4 Flash on WinoGrande: Score Breakdown
• GLM-4 Plus on ARC: Score Breakdown
• GLM-4 Plus on BBH (BIG-Bench Hard): Score Breakdown
• GLM-4 Plus on GPQA: Score Breakdown
• GLM-4 Plus on GSM8K (Grade School Math 8K): Score Breakdown
• GLM-4 Plus on HumanEval: Score Breakdown
• GLM-4 Plus on IFEval: Score Breakdown
• GLM-4 Plus on MATH: Score Breakdown
• GLM-4 Plus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Plus on MUSR: Score Breakdown
• GLM-4 Plus on WinoGrande: Score Breakdown
• GLM-4V 9B on ARC: Score Breakdown
• GLM-4V 9B on BBH (BIG-Bench Hard): Score Breakdown
• GLM-4V 9B on GPQA: Score Breakdown
• GLM-4V 9B on GSM8K (Grade School Math 8K): Score Breakdown
• GLM-4V 9B on HumanEval: Score Breakdown
• GLM-4V 9B on IFEval: Score Breakdown
• GLM-4V 9B on MATH: Score Breakdown
• GLM-4V 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4V 9B on MUSR: Score Breakdown
• GLM-4V 9B on WinoGrande: Score Breakdown
• GPT-3.5 on ARC: Score Breakdown
• GPT-3.5 on BBH (BIG-Bench Hard): Score Breakdown
• GPT-3.5 on GPQA: Score Breakdown
• GPT-3.5 on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-3.5 on HumanEval: Score Breakdown
• GPT-3.5 on IFEval: Score Breakdown
• GPT-3.5 on MATH: Score Breakdown
• GPT-3.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 on MUSR: Score Breakdown
• GPT-3.5 on WinoGrande: Score Breakdown
• GPT-3.5 Turbo 16K on ARC: Score Breakdown
• GPT-3.5 Turbo 16K on BBH (BIG-Bench Hard): Score Breakdown
• GPT-3.5 Turbo 16K on GPQA: Score Breakdown
• GPT-3.5 Turbo 16K on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-3.5 Turbo 16K on HumanEval: Score Breakdown
• GPT-3.5 Turbo 16K on IFEval: Score Breakdown
• GPT-3.5 Turbo 16K on MATH: Score Breakdown
• GPT-3.5 Turbo 16K on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 Turbo 16K on MUSR: Score Breakdown
• GPT-3.5 Turbo 16K on WinoGrande: Score Breakdown
• GPT-3.5 Turbo on ARC: Score Breakdown
• GPT-3.5 Turbo on BBH (BIG-Bench Hard): Score Breakdown
• GPT-3.5 Turbo on GPQA: Score Breakdown
• GPT-3.5 Turbo on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-3.5 Turbo on HumanEval: Score Breakdown
• GPT-3.5 Turbo on IFEval: Score Breakdown
• GPT-3.5 Turbo on MATH: Score Breakdown
• GPT-3.5 Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 Turbo on MUSR: Score Breakdown
• GPT-3.5 Turbo on WinoGrande: Score Breakdown
• GPT-4 0125 Preview on ARC: Score Breakdown
• GPT-4 0125 Preview on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 0125 Preview on GPQA: Score Breakdown
• GPT-4 0125 Preview on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 0125 Preview on HumanEval: Score Breakdown
• GPT-4 0125 Preview on IFEval: Score Breakdown
• GPT-4 0125 Preview on MATH: Score Breakdown
• GPT-4 0125 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 0125 Preview on MUSR: Score Breakdown
• GPT-4 0125 Preview on WinoGrande: Score Breakdown
• GPT-4 1106 Preview on ARC: Score Breakdown
• GPT-4 1106 Preview on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 1106 Preview on GPQA: Score Breakdown
• GPT-4 1106 Preview on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 1106 Preview on HumanEval: Score Breakdown
• GPT-4 1106 Preview on IFEval: Score Breakdown
• GPT-4 1106 Preview on MATH: Score Breakdown
• GPT-4 1106 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 1106 Preview on MUSR: Score Breakdown
• GPT-4 1106 Preview on WinoGrande: Score Breakdown
• GPT-4 32K on ARC: Score Breakdown
• GPT-4 32K on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 32K on GPQA: Score Breakdown
• GPT-4 32K on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 32K on HumanEval: Score Breakdown
• GPT-4 32K on IFEval: Score Breakdown
• GPT-4 32K on MATH: Score Breakdown
• GPT-4 32K on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 32K on MUSR: Score Breakdown
• GPT-4 32K on WinoGrande: Score Breakdown
• GPT-4 on ARC: Score Breakdown
• GPT-4 on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 on GPQA: Score Breakdown
• GPT-4 on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 on HumanEval: Score Breakdown
• GPT-4 on IFEval: Score Breakdown
• GPT-4 on MATH: Score Breakdown
• GPT-4 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 on MUSR: Score Breakdown
• GPT-4 on WinoGrande: Score Breakdown
• GPT-4 Turbo on ARC: Score Breakdown
• GPT-4 Turbo on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 Turbo on GPQA: Score Breakdown
• GPT-4 Turbo on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 Turbo on HumanEval: Score Breakdown
• GPT-4 Turbo on IFEval: Score Breakdown
• GPT-4 Turbo on MATH: Score Breakdown
• GPT-4 Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Turbo on MUSR: Score Breakdown
• GPT-4 Turbo on WinoGrande: Score Breakdown
• GPT-4 Vision on ARC: Score Breakdown
• GPT-4 Vision on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 Vision on GPQA: Score Breakdown
• GPT-4 Vision on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 Vision on HumanEval: Score Breakdown
• GPT-4 Vision on IFEval: Score Breakdown
• GPT-4 Vision on MATH: Score Breakdown
• GPT-4 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Vision on MUSR: Score Breakdown
• GPT-4 Vision on WinoGrande: Score Breakdown
• GPT-4 Vision Preview on ARC: Score Breakdown
• GPT-4 Vision Preview on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4 Vision Preview on GPQA: Score Breakdown
• GPT-4 Vision Preview on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4 Vision Preview on HumanEval: Score Breakdown
• GPT-4 Vision Preview on IFEval: Score Breakdown
• GPT-4 Vision Preview on MATH: Score Breakdown
• GPT-4 Vision Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Vision Preview on MUSR: Score Breakdown
• GPT-4 Vision Preview on WinoGrande: Score Breakdown
• GPT-4o (2024-05-13) on ARC: Score Breakdown
• GPT-4o (2024-05-13) on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4o (2024-05-13) on GPQA: Score Breakdown
• GPT-4o (2024-05-13) on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4o (2024-05-13) on HumanEval: Score Breakdown
• GPT-4o (2024-05-13) on IFEval: Score Breakdown
• GPT-4o (2024-05-13) on MATH: Score Breakdown
• GPT-4o (2024-05-13) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o (2024-05-13) on MUSR: Score Breakdown
• GPT-4o (2024-05-13) on WinoGrande: Score Breakdown
• GPT-4o (2024-08-06) on ARC: Score Breakdown
• GPT-4o (2024-08-06) on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4o (2024-08-06) on GPQA: Score Breakdown
• GPT-4o (2024-08-06) on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4o (2024-08-06) on HumanEval: Score Breakdown
• GPT-4o (2024-08-06) on IFEval: Score Breakdown
• GPT-4o (2024-08-06) on MATH: Score Breakdown
• GPT-4o (2024-08-06) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o (2024-08-06) on MUSR: Score Breakdown
• GPT-4o (2024-08-06) on WinoGrande: Score Breakdown
• GPT-4o mini on ARC: Score Breakdown
• GPT-4o mini on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4o mini on GPQA: Score Breakdown
• GPT-4o mini on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4o mini on HumanEval: Score Breakdown
• GPT-4o mini on IFEval: Score Breakdown
• GPT-4o mini on MATH: Score Breakdown
• GPT-4o mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o mini on MUSR: Score Breakdown
• GPT-4o mini on WinoGrande: Score Breakdown
• GPT-4o on BBH (BIG-Bench Hard): Score Breakdown
• GPT-4o on GSM8K (Grade School Math 8K): Score Breakdown
• GPT-4o on HumanEval: Score Breakdown
• GPT-4o on MATH: Score Breakdown
• GPT-4o on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok Beta on ARC: Score Breakdown
• Grok Beta on BBH (BIG-Bench Hard): Score Breakdown
• Grok Beta on GPQA: Score Breakdown
• Grok Beta on GSM8K (Grade School Math 8K): Score Breakdown
• Grok Beta on HumanEval: Score Breakdown
• Grok Beta on IFEval: Score Breakdown
• Grok Beta on MATH: Score Breakdown
• Grok Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok Beta on MUSR: Score Breakdown
• Grok Beta on WinoGrande: Score Breakdown
• Grok Vision Beta on ARC: Score Breakdown
• Grok Vision Beta on BBH (BIG-Bench Hard): Score Breakdown
• Grok Vision Beta on GPQA: Score Breakdown
• Grok Vision Beta on GSM8K (Grade School Math 8K): Score Breakdown
• Grok Vision Beta on HumanEval: Score Breakdown
• Grok Vision Beta on IFEval: Score Breakdown
• Grok Vision Beta on MATH: Score Breakdown
• Grok Vision Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok Vision Beta on MUSR: Score Breakdown
• Grok Vision Beta on WinoGrande: Score Breakdown
• Grok-2 Mini on ARC: Score Breakdown
• Grok-2 Mini on BBH (BIG-Bench Hard): Score Breakdown
• Grok-2 Mini on GPQA: Score Breakdown
• Grok-2 Mini on GSM8K (Grade School Math 8K): Score Breakdown
• Grok-2 Mini on HumanEval: Score Breakdown
• Grok-2 Mini on IFEval: Score Breakdown
• Grok-2 Mini on MATH: Score Breakdown
• Grok-2 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 Mini on MUSR: Score Breakdown
• Grok-2 Mini on WinoGrande: Score Breakdown
• Grok-2 on BBH (BIG-Bench Hard): Score Breakdown
• Grok-2 on GSM8K (Grade School Math 8K): Score Breakdown
• Grok-2 on HumanEval: Score Breakdown
• Grok-2 on MATH: Score Breakdown
• Grok-2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 Vision on ARC: Score Breakdown
• Grok-2 Vision on BBH (BIG-Bench Hard): Score Breakdown
• Grok-2 Vision on GPQA: Score Breakdown
• Grok-2 Vision on GSM8K (Grade School Math 8K): Score Breakdown
• Grok-2 Vision on HumanEval: Score Breakdown
• Grok-2 Vision on IFEval: Score Breakdown
• Grok-2 Vision on MATH: Score Breakdown
• Grok-2 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 Vision on MUSR: Score Breakdown
• Grok-2 Vision on WinoGrande: Score Breakdown
• Hermes 3 Llama 3.1 405B on ARC: Score Breakdown
• Hermes 3 Llama 3.1 405B on BBH (BIG-Bench Hard): Score Breakdown
• Hermes 3 Llama 3.1 405B on GPQA: Score Breakdown
• Hermes 3 Llama 3.1 405B on GSM8K (Grade School Math 8K): Score Breakdown
• Hermes 3 Llama 3.1 405B on HumanEval: Score Breakdown
• Hermes 3 Llama 3.1 405B on IFEval: Score Breakdown
• Hermes 3 Llama 3.1 405B on MATH: Score Breakdown
• Hermes 3 Llama 3.1 405B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 405B on MUSR: Score Breakdown
• Hermes 3 Llama 3.1 405B on WinoGrande: Score Breakdown
• Hermes 3 Llama 3.1 70B on ARC: Score Breakdown
• Hermes 3 Llama 3.1 70B on BBH (BIG-Bench Hard): Score Breakdown
• Hermes 3 Llama 3.1 70B on GPQA: Score Breakdown
• Hermes 3 Llama 3.1 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Hermes 3 Llama 3.1 70B on HumanEval: Score Breakdown
• Hermes 3 Llama 3.1 70B on IFEval: Score Breakdown
• Hermes 3 Llama 3.1 70B on MATH: Score Breakdown
• Hermes 3 Llama 3.1 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 70B on MUSR: Score Breakdown
• Hermes 3 Llama 3.1 70B on WinoGrande: Score Breakdown
• Hermes 3 Llama 3.1 8B on ARC: Score Breakdown
• Hermes 3 Llama 3.1 8B on BBH (BIG-Bench Hard): Score Breakdown
• Hermes 3 Llama 3.1 8B on GPQA: Score Breakdown
• Hermes 3 Llama 3.1 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Hermes 3 Llama 3.1 8B on HumanEval: Score Breakdown
• Hermes 3 Llama 3.1 8B on IFEval: Score Breakdown
• Hermes 3 Llama 3.1 8B on MATH: Score Breakdown
• Hermes 3 Llama 3.1 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 8B on MUSR: Score Breakdown
• Hermes 3 Llama 3.1 8B on WinoGrande: Score Breakdown
• Jamba 1.5 Large on ARC: Score Breakdown
• Jamba 1.5 Large on BBH (BIG-Bench Hard): Score Breakdown
• Jamba 1.5 Large on GPQA: Score Breakdown
• Jamba 1.5 Large on GSM8K (Grade School Math 8K): Score Breakdown
• Jamba 1.5 Large on HumanEval: Score Breakdown
• Jamba 1.5 Large on IFEval: Score Breakdown
• Jamba 1.5 Large on MATH: Score Breakdown
• Jamba 1.5 Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 Large on MUSR: Score Breakdown
• Jamba 1.5 Large on WinoGrande: Score Breakdown
• Jamba 1.5 Mini on ARC: Score Breakdown
• Jamba 1.5 Mini on BBH (BIG-Bench Hard): Score Breakdown
• Jamba 1.5 Mini on GPQA: Score Breakdown
• Jamba 1.5 Mini on GSM8K (Grade School Math 8K): Score Breakdown
• Jamba 1.5 Mini on HumanEval: Score Breakdown
• Jamba 1.5 Mini on IFEval: Score Breakdown
• Jamba 1.5 Mini on MATH: Score Breakdown
• Jamba 1.5 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 Mini on MUSR: Score Breakdown
• Jamba 1.5 Mini on WinoGrande: Score Breakdown
• Jamba 1.5 on ARC: Score Breakdown
• Jamba 1.5 on BBH (BIG-Bench Hard): Score Breakdown
• Jamba 1.5 on GPQA: Score Breakdown
• Jamba 1.5 on GSM8K (Grade School Math 8K): Score Breakdown
• Jamba 1.5 on HumanEval: Score Breakdown
• Jamba 1.5 on IFEval: Score Breakdown
• Jamba 1.5 on MATH: Score Breakdown
• Jamba 1.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 on MUSR: Score Breakdown
• Jamba 1.5 on WinoGrande: Score Breakdown
• Jamba Instruct on ARC: Score Breakdown
• Jamba Instruct on BBH (BIG-Bench Hard): Score Breakdown
• Jamba Instruct on GPQA: Score Breakdown
• Jamba Instruct on GSM8K (Grade School Math 8K): Score Breakdown
• Jamba Instruct on HumanEval: Score Breakdown
• Jamba Instruct on IFEval: Score Breakdown
• Jamba Instruct on MATH: Score Breakdown
• Jamba Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba Instruct on MUSR: Score Breakdown
• Jamba Instruct on WinoGrande: Score Breakdown
• Jurassic-2 Mid on ARC: Score Breakdown
• Jurassic-2 Mid on BBH (BIG-Bench Hard): Score Breakdown
• Jurassic-2 Mid on GPQA: Score Breakdown
• Jurassic-2 Mid on GSM8K (Grade School Math 8K): Score Breakdown
• Jurassic-2 Mid on HumanEval: Score Breakdown
• Jurassic-2 Mid on IFEval: Score Breakdown
• Jurassic-2 Mid on MATH: Score Breakdown
• Jurassic-2 Mid on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jurassic-2 Mid on MUSR: Score Breakdown
• Jurassic-2 Mid on WinoGrande: Score Breakdown
• Jurassic-2 Ultra on ARC: Score Breakdown
• Jurassic-2 Ultra on BBH (BIG-Bench Hard): Score Breakdown
• Jurassic-2 Ultra on GPQA: Score Breakdown
• Jurassic-2 Ultra on GSM8K (Grade School Math 8K): Score Breakdown
• Jurassic-2 Ultra on HumanEval: Score Breakdown
• Jurassic-2 Ultra on IFEval: Score Breakdown
• Jurassic-2 Ultra on MATH: Score Breakdown
• Jurassic-2 Ultra on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jurassic-2 Ultra on MUSR: Score Breakdown
• Jurassic-2 Ultra on WinoGrande: Score Breakdown
• Llama 2 13B on ARC: Score Breakdown
• Llama 2 13B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 2 13B on GPQA: Score Breakdown
• Llama 2 13B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 2 13B on HumanEval: Score Breakdown
• Llama 2 13B on IFEval: Score Breakdown
• Llama 2 13B on MATH: Score Breakdown
• Llama 2 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 13B on MUSR: Score Breakdown
• Llama 2 13B on WinoGrande: Score Breakdown
• Llama 2 70B on ARC: Score Breakdown
• Llama 2 70B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 2 70B on GPQA: Score Breakdown
• Llama 2 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 2 70B on HumanEval: Score Breakdown
• Llama 2 70B on IFEval: Score Breakdown
• Llama 2 70B on MATH: Score Breakdown
• Llama 2 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 70B on MUSR: Score Breakdown
• Llama 2 70B on WinoGrande: Score Breakdown
• Llama 2 7B on ARC: Score Breakdown
• Llama 2 7B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 2 7B on GPQA: Score Breakdown
• Llama 2 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 2 7B on HumanEval: Score Breakdown
• Llama 2 7B on IFEval: Score Breakdown
• Llama 2 7B on MATH: Score Breakdown
• Llama 2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 7B on MUSR: Score Breakdown
• Llama 2 7B on WinoGrande: Score Breakdown
• Llama 3 70B on ARC: Score Breakdown
• Llama 3 70B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3 70B on GPQA: Score Breakdown
• Llama 3 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3 70B on HumanEval: Score Breakdown
• Llama 3 70B on IFEval: Score Breakdown
• Llama 3 70B on MATH: Score Breakdown
• Llama 3 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3 70B on MUSR: Score Breakdown
• Llama 3 70B on WinoGrande: Score Breakdown
• Llama 3 8B on ARC: Score Breakdown
• Llama 3 8B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3 8B on GPQA: Score Breakdown
• Llama 3 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3 8B on HumanEval: Score Breakdown
• Llama 3 8B on IFEval: Score Breakdown
• Llama 3 8B on MATH: Score Breakdown
• Llama 3 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3 8B on MUSR: Score Breakdown
• Llama 3 8B on WinoGrande: Score Breakdown
• Llama 3.1 405B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.1 405B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.1 405B on HumanEval: Score Breakdown
• Llama 3.1 405B on MATH: Score Breakdown
• Llama 3.1 405B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 70B on ARC: Score Breakdown
• Llama 3.1 70B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.1 70B on GPQA: Score Breakdown
• Llama 3.1 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.1 70B on HumanEval: Score Breakdown
• Llama 3.1 70B on IFEval: Score Breakdown
• Llama 3.1 70B on MATH: Score Breakdown
• Llama 3.1 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 70B on MUSR: Score Breakdown
• Llama 3.1 70B on WinoGrande: Score Breakdown
• Llama 3.1 8B on ARC: Score Breakdown
• Llama 3.1 8B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.1 8B on GPQA: Score Breakdown
• Llama 3.1 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.1 8B on HumanEval: Score Breakdown
• Llama 3.1 8B on IFEval: Score Breakdown
• Llama 3.1 8B on MATH: Score Breakdown
• Llama 3.1 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 8B on MUSR: Score Breakdown
• Llama 3.1 8B on WinoGrande: Score Breakdown
• Llama 3.1 Nemotron 70B on ARC: Score Breakdown
• Llama 3.1 Nemotron 70B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.1 Nemotron 70B on GPQA: Score Breakdown
• Llama 3.1 Nemotron 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.1 Nemotron 70B on HumanEval: Score Breakdown
• Llama 3.1 Nemotron 70B on IFEval: Score Breakdown
• Llama 3.1 Nemotron 70B on MATH: Score Breakdown
• Llama 3.1 Nemotron 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 Nemotron 70B on MUSR: Score Breakdown
• Llama 3.1 Nemotron 70B on WinoGrande: Score Breakdown
• Llama 3.2 11B Vision on ARC: Score Breakdown
• Llama 3.2 11B Vision on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.2 11B Vision on GPQA: Score Breakdown
• Llama 3.2 11B Vision on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.2 11B Vision on HumanEval: Score Breakdown
• Llama 3.2 11B Vision on IFEval: Score Breakdown
• Llama 3.2 11B Vision on MATH: Score Breakdown
• Llama 3.2 11B Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 11B Vision on MUSR: Score Breakdown
• Llama 3.2 11B Vision on WinoGrande: Score Breakdown
• Llama 3.2 1B on ARC: Score Breakdown
• Llama 3.2 1B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.2 1B on GPQA: Score Breakdown
• Llama 3.2 1B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.2 1B on HumanEval: Score Breakdown
• Llama 3.2 1B on IFEval: Score Breakdown
• Llama 3.2 1B on MATH: Score Breakdown
• Llama 3.2 1B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 1B on MUSR: Score Breakdown
• Llama 3.2 1B on WinoGrande: Score Breakdown
• Llama 3.2 3B on ARC: Score Breakdown
• Llama 3.2 3B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.2 3B on GPQA: Score Breakdown
• Llama 3.2 3B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.2 3B on HumanEval: Score Breakdown
• Llama 3.2 3B on IFEval: Score Breakdown
• Llama 3.2 3B on MATH: Score Breakdown
• Llama 3.2 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 3B on MUSR: Score Breakdown
• Llama 3.2 3B on WinoGrande: Score Breakdown
• Llama 3.2 90B Vision on ARC: Score Breakdown
• Llama 3.2 90B Vision on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.2 90B Vision on GPQA: Score Breakdown
• Llama 3.2 90B Vision on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.2 90B Vision on HumanEval: Score Breakdown
• Llama 3.2 90B Vision on IFEval: Score Breakdown
• Llama 3.2 90B Vision on MATH: Score Breakdown
• Llama 3.2 90B Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 90B Vision on MUSR: Score Breakdown
• Llama 3.2 90B Vision on WinoGrande: Score Breakdown
• Llama 3.3 70B on ARC: Score Breakdown
• Llama 3.3 70B on BBH (BIG-Bench Hard): Score Breakdown
• Llama 3.3 70B on GPQA: Score Breakdown
• Llama 3.3 70B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama 3.3 70B on HumanEval: Score Breakdown
• Llama 3.3 70B on IFEval: Score Breakdown
• Llama 3.3 70B on MATH: Score Breakdown
• Llama 3.3 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.3 70B on MUSR: Score Breakdown
• Llama 3.3 70B on WinoGrande: Score Breakdown
• Llama Guard 2 8B on ARC: Score Breakdown
• Llama Guard 2 8B on BBH (BIG-Bench Hard): Score Breakdown
• Llama Guard 2 8B on GPQA: Score Breakdown
• Llama Guard 2 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama Guard 2 8B on HumanEval: Score Breakdown
• Llama Guard 2 8B on IFEval: Score Breakdown
• Llama Guard 2 8B on MATH: Score Breakdown
• Llama Guard 2 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama Guard 2 8B on MUSR: Score Breakdown
• Llama Guard 2 8B on WinoGrande: Score Breakdown
• Llama Guard 3 8B on ARC: Score Breakdown
• Llama Guard 3 8B on BBH (BIG-Bench Hard): Score Breakdown
• Llama Guard 3 8B on GPQA: Score Breakdown
• Llama Guard 3 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Llama Guard 3 8B on HumanEval: Score Breakdown
• Llama Guard 3 8B on IFEval: Score Breakdown
• Llama Guard 3 8B on MATH: Score Breakdown
• Llama Guard 3 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama Guard 3 8B on MUSR: Score Breakdown
• Llama Guard 3 8B on WinoGrande: Score Breakdown
• Llemma 7B on ARC: Score Breakdown
• Llemma 7B on BBH (BIG-Bench Hard): Score Breakdown
• Llemma 7B on GPQA: Score Breakdown
• Llemma 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Llemma 7B on HumanEval: Score Breakdown
• Llemma 7B on IFEval: Score Breakdown
• Llemma 7B on MATH: Score Breakdown
• Llemma 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llemma 7B on MUSR: Score Breakdown
• Llemma 7B on WinoGrande: Score Breakdown
• Mathstral 7B on ARC: Score Breakdown
• Mathstral 7B on BBH (BIG-Bench Hard): Score Breakdown
• Mathstral 7B on GPQA: Score Breakdown
• Mathstral 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Mathstral 7B on HumanEval: Score Breakdown
• Mathstral 7B on IFEval: Score Breakdown
• Mathstral 7B on MATH: Score Breakdown
• Mathstral 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mathstral 7B on MUSR: Score Breakdown
• Mathstral 7B on WinoGrande: Score Breakdown
• Microsoft WizardCoder Python 34B on ARC: Score Breakdown
• Microsoft WizardCoder Python 34B on BBH (BIG-Bench Hard): Score Breakdown
• Microsoft WizardCoder Python 34B on GPQA: Score Breakdown
• Microsoft WizardCoder Python 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Microsoft WizardCoder Python 34B on HumanEval: Score Breakdown
• Microsoft WizardCoder Python 34B on IFEval: Score Breakdown
• Microsoft WizardCoder Python 34B on MATH: Score Breakdown
• Microsoft WizardCoder Python 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardCoder Python 34B on MUSR: Score Breakdown
• Microsoft WizardCoder Python 34B on WinoGrande: Score Breakdown
• Microsoft WizardLM 2 7B on ARC: Score Breakdown
• Microsoft WizardLM 2 7B on BBH (BIG-Bench Hard): Score Breakdown
• Microsoft WizardLM 2 7B on GPQA: Score Breakdown
• Microsoft WizardLM 2 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Microsoft WizardLM 2 7B on HumanEval: Score Breakdown
• Microsoft WizardLM 2 7B on IFEval: Score Breakdown
• Microsoft WizardLM 2 7B on MATH: Score Breakdown
• Microsoft WizardLM 2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardLM 2 7B on MUSR: Score Breakdown
• Microsoft WizardLM 2 7B on WinoGrande: Score Breakdown
• Microsoft WizardLM 2 8x22B on ARC: Score Breakdown
• Microsoft WizardLM 2 8x22B on BBH (BIG-Bench Hard): Score Breakdown
• Microsoft WizardLM 2 8x22B on GPQA: Score Breakdown
• Microsoft WizardLM 2 8x22B on GSM8K (Grade School Math 8K): Score Breakdown
• Microsoft WizardLM 2 8x22B on HumanEval: Score Breakdown
• Microsoft WizardLM 2 8x22B on IFEval: Score Breakdown
• Microsoft WizardLM 2 8x22B on MATH: Score Breakdown
• Microsoft WizardLM 2 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardLM 2 8x22B on MUSR: Score Breakdown
• Microsoft WizardLM 2 8x22B on WinoGrande: Score Breakdown
• Microsoft WizardMath 7B v1 on ARC: Score Breakdown
• Microsoft WizardMath 7B v1 on BBH (BIG-Bench Hard): Score Breakdown
• Microsoft WizardMath 7B v1 on GPQA: Score Breakdown
• Microsoft WizardMath 7B v1 on GSM8K (Grade School Math 8K): Score Breakdown
• Microsoft WizardMath 7B v1 on HumanEval: Score Breakdown
• Microsoft WizardMath 7B v1 on IFEval: Score Breakdown
• Microsoft WizardMath 7B v1 on MATH: Score Breakdown
• Microsoft WizardMath 7B v1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardMath 7B v1 on MUSR: Score Breakdown
• Microsoft WizardMath 7B v1 on WinoGrande: Score Breakdown
• Ministral 3B on ARC: Score Breakdown
• Ministral 3B on BBH (BIG-Bench Hard): Score Breakdown
• Ministral 3B on GPQA: Score Breakdown
• Ministral 3B on GSM8K (Grade School Math 8K): Score Breakdown
• Ministral 3B on HumanEval: Score Breakdown
• Ministral 3B on IFEval: Score Breakdown
• Ministral 3B on MATH: Score Breakdown
• Ministral 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Ministral 3B on MUSR: Score Breakdown
• Ministral 3B on WinoGrande: Score Breakdown
• Ministral 8B on ARC: Score Breakdown
• Ministral 8B on BBH (BIG-Bench Hard): Score Breakdown
• Ministral 8B on GPQA: Score Breakdown
• Ministral 8B on GSM8K (Grade School Math 8K): Score Breakdown
• Ministral 8B on HumanEval: Score Breakdown
• Ministral 8B on IFEval: Score Breakdown
• Ministral 8B on MATH: Score Breakdown
• Ministral 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Ministral 8B on MUSR: Score Breakdown
• Ministral 8B on WinoGrande: Score Breakdown
• Mistral 7B v0.1 on ARC: Score Breakdown
• Mistral 7B v0.1 on BBH (BIG-Bench Hard): Score Breakdown
• Mistral 7B v0.1 on GPQA: Score Breakdown
• Mistral 7B v0.1 on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral 7B v0.1 on HumanEval: Score Breakdown
• Mistral 7B v0.1 on IFEval: Score Breakdown
• Mistral 7B v0.1 on MATH: Score Breakdown
• Mistral 7B v0.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.1 on MUSR: Score Breakdown
• Mistral 7B v0.1 on WinoGrande: Score Breakdown
• Mistral 7B v0.2 on ARC: Score Breakdown
• Mistral 7B v0.2 on BBH (BIG-Bench Hard): Score Breakdown
• Mistral 7B v0.2 on GPQA: Score Breakdown
• Mistral 7B v0.2 on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral 7B v0.2 on HumanEval: Score Breakdown
• Mistral 7B v0.2 on IFEval: Score Breakdown
• Mistral 7B v0.2 on MATH: Score Breakdown
• Mistral 7B v0.2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.2 on MUSR: Score Breakdown
• Mistral 7B v0.2 on WinoGrande: Score Breakdown
• Mistral 7B v0.3 on ARC: Score Breakdown
• Mistral 7B v0.3 on BBH (BIG-Bench Hard): Score Breakdown
• Mistral 7B v0.3 on GPQA: Score Breakdown
• Mistral 7B v0.3 on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral 7B v0.3 on HumanEval: Score Breakdown
• Mistral 7B v0.3 on IFEval: Score Breakdown
• Mistral 7B v0.3 on MATH: Score Breakdown
• Mistral 7B v0.3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.3 on MUSR: Score Breakdown
• Mistral 7B v0.3 on WinoGrande: Score Breakdown
• Mistral Large 2 on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Large 2 on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Large 2 on HumanEval: Score Breakdown
• Mistral Large 2 on MATH: Score Breakdown
• Mistral Large 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Large on ARC: Score Breakdown
• Mistral Large on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Large on GPQA: Score Breakdown
• Mistral Large on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Large on HumanEval: Score Breakdown
• Mistral Large on IFEval: Score Breakdown
• Mistral Large on MATH: Score Breakdown
• Mistral Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Large on MUSR: Score Breakdown
• Mistral Large on WinoGrande: Score Breakdown
• Mistral Medium on ARC: Score Breakdown
• Mistral Medium on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Medium on GPQA: Score Breakdown
• Mistral Medium on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Medium on HumanEval: Score Breakdown
• Mistral Medium on IFEval: Score Breakdown
• Mistral Medium on MATH: Score Breakdown
• Mistral Medium on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Medium on MUSR: Score Breakdown
• Mistral Medium on WinoGrande: Score Breakdown
• Mistral Nemo on ARC: Score Breakdown
• Mistral Nemo on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Nemo on GPQA: Score Breakdown
• Mistral Nemo on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Nemo on HumanEval: Score Breakdown
• Mistral Nemo on IFEval: Score Breakdown
• Mistral Nemo on MATH: Score Breakdown
• Mistral Nemo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Nemo on MUSR: Score Breakdown
• Mistral Nemo on WinoGrande: Score Breakdown
• Mistral Small 3 on ARC: Score Breakdown
• Mistral Small 3 on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Small 3 on GPQA: Score Breakdown
• Mistral Small 3 on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Small 3 on HumanEval: Score Breakdown
• Mistral Small 3 on IFEval: Score Breakdown
• Mistral Small 3 on MATH: Score Breakdown
• Mistral Small 3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Small 3 on MUSR: Score Breakdown
• Mistral Small 3 on WinoGrande: Score Breakdown
• Mistral Small on ARC: Score Breakdown
• Mistral Small on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Small on GPQA: Score Breakdown
• Mistral Small on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Small on HumanEval: Score Breakdown
• Mistral Small on IFEval: Score Breakdown
• Mistral Small on MATH: Score Breakdown
• Mistral Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Small on MUSR: Score Breakdown
• Mistral Small on WinoGrande: Score Breakdown
• Mistral Tiny on ARC: Score Breakdown
• Mistral Tiny on BBH (BIG-Bench Hard): Score Breakdown
• Mistral Tiny on GPQA: Score Breakdown
• Mistral Tiny on GSM8K (Grade School Math 8K): Score Breakdown
• Mistral Tiny on HumanEval: Score Breakdown
• Mistral Tiny on IFEval: Score Breakdown
• Mistral Tiny on MATH: Score Breakdown
• Mistral Tiny on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Tiny on MUSR: Score Breakdown
• Mistral Tiny on WinoGrande: Score Breakdown
• Mixtral 8x22B on BBH (BIG-Bench Hard): Score Breakdown
• Mixtral 8x22B on GSM8K (Grade School Math 8K): Score Breakdown
• Mixtral 8x22B on HumanEval: Score Breakdown
• Mixtral 8x22B on MATH: Score Breakdown
• Mixtral 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mixtral 8x7B on ARC: Score Breakdown
• Mixtral 8x7B on BBH (BIG-Bench Hard): Score Breakdown
• Mixtral 8x7B on GPQA: Score Breakdown
• Mixtral 8x7B on GSM8K (Grade School Math 8K): Score Breakdown
• Mixtral 8x7B on HumanEval: Score Breakdown
• Mixtral 8x7B on IFEval: Score Breakdown
• Mixtral 8x7B on MATH: Score Breakdown
• Mixtral 8x7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mixtral 8x7B on MUSR: Score Breakdown
• Mixtral 8x7B on WinoGrande: Score Breakdown
• MPT 30B on ARC: Score Breakdown
• MPT 30B on BBH (BIG-Bench Hard): Score Breakdown
• MPT 30B on GPQA: Score Breakdown
• MPT 30B on GSM8K (Grade School Math 8K): Score Breakdown
• MPT 30B on HumanEval: Score Breakdown
• MPT 30B on IFEval: Score Breakdown
• MPT 30B on MATH: Score Breakdown
• MPT 30B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• MPT 30B on MUSR: Score Breakdown
• MPT 30B on WinoGrande: Score Breakdown
• MPT 7B on ARC: Score Breakdown
• MPT 7B on BBH (BIG-Bench Hard): Score Breakdown
• MPT 7B on GPQA: Score Breakdown
• MPT 7B on GSM8K (Grade School Math 8K): Score Breakdown
• MPT 7B on HumanEval: Score Breakdown
• MPT 7B on IFEval: Score Breakdown
• MPT 7B on MATH: Score Breakdown
• MPT 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• MPT 7B on MUSR: Score Breakdown
• MPT 7B on WinoGrande: Score Breakdown
• Nous Capybara 34B on ARC: Score Breakdown
• Nous Capybara 34B on BBH (BIG-Bench Hard): Score Breakdown
• Nous Capybara 34B on GPQA: Score Breakdown
• Nous Capybara 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Nous Capybara 34B on HumanEval: Score Breakdown
• Nous Capybara 34B on IFEval: Score Breakdown
• Nous Capybara 34B on MATH: Score Breakdown
• Nous Capybara 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Capybara 34B on MUSR: Score Breakdown
• Nous Capybara 34B on WinoGrande: Score Breakdown
• Nous Capybara 7B on ARC: Score Breakdown
• Nous Capybara 7B on BBH (BIG-Bench Hard): Score Breakdown
• Nous Capybara 7B on GPQA: Score Breakdown
• Nous Capybara 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Nous Capybara 7B on HumanEval: Score Breakdown
• Nous Capybara 7B on IFEval: Score Breakdown
• Nous Capybara 7B on MATH: Score Breakdown
• Nous Capybara 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Capybara 7B on MUSR: Score Breakdown
• Nous Capybara 7B on WinoGrande: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on ARC: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on BBH (BIG-Bench Hard): Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on GPQA: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on GSM8K (Grade School Math 8K): Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on HumanEval: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on IFEval: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on MATH: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on MUSR: Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on WinoGrande: Score Breakdown
• Nous Hermes 2 Solar 10.7B on ARC: Score Breakdown
• Nous Hermes 2 Solar 10.7B on BBH (BIG-Bench Hard): Score Breakdown
• Nous Hermes 2 Solar 10.7B on GPQA: Score Breakdown
• Nous Hermes 2 Solar 10.7B on GSM8K (Grade School Math 8K): Score Breakdown
• Nous Hermes 2 Solar 10.7B on HumanEval: Score Breakdown
• Nous Hermes 2 Solar 10.7B on IFEval: Score Breakdown
• Nous Hermes 2 Solar 10.7B on MATH: Score Breakdown
• Nous Hermes 2 Solar 10.7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Solar 10.7B on MUSR: Score Breakdown
• Nous Hermes 2 Solar 10.7B on WinoGrande: Score Breakdown
• Nous Hermes 2 Yi 34B on ARC: Score Breakdown
• Nous Hermes 2 Yi 34B on BBH (BIG-Bench Hard): Score Breakdown
• Nous Hermes 2 Yi 34B on GPQA: Score Breakdown
• Nous Hermes 2 Yi 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Nous Hermes 2 Yi 34B on HumanEval: Score Breakdown
• Nous Hermes 2 Yi 34B on IFEval: Score Breakdown
• Nous Hermes 2 Yi 34B on MATH: Score Breakdown
• Nous Hermes 2 Yi 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Yi 34B on MUSR: Score Breakdown
• Nous Hermes 2 Yi 34B on WinoGrande: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on ARC: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on BBH (BIG-Bench Hard): Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on GPQA: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on GSM8K (Grade School Math 8K): Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on HumanEval: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on IFEval: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on MATH: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on MUSR: Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on WinoGrande: Score Breakdown
• o1 mini on ARC: Score Breakdown
• o1 mini on BBH (BIG-Bench Hard): Score Breakdown
• o1 mini on GPQA: Score Breakdown
• o1 mini on GSM8K (Grade School Math 8K): Score Breakdown
• o1 mini on HumanEval: Score Breakdown
• o1 mini on IFEval: Score Breakdown
• o1 mini on MATH: Score Breakdown
• o1 mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 mini on MUSR: Score Breakdown
• o1 mini on WinoGrande: Score Breakdown
• o1 on ARC: Score Breakdown
• o1 on BBH (BIG-Bench Hard): Score Breakdown
• o1 on GPQA: Score Breakdown
• o1 on GSM8K (Grade School Math 8K): Score Breakdown
• o1 on HumanEval: Score Breakdown
• o1 on IFEval: Score Breakdown
• o1 on MATH: Score Breakdown
• o1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 on MUSR: Score Breakdown
• o1 on WinoGrande: Score Breakdown
• o1 Preview on ARC: Score Breakdown
• o1 Preview on BBH (BIG-Bench Hard): Score Breakdown
• o1 Preview on GPQA: Score Breakdown
• o1 Preview on GSM8K (Grade School Math 8K): Score Breakdown
• o1 Preview on HumanEval: Score Breakdown
• o1 Preview on IFEval: Score Breakdown
• o1 Preview on MATH: Score Breakdown
• o1 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 Preview on MUSR: Score Breakdown
• o1 Preview on WinoGrande: Score Breakdown
• OLMo 1.7 7B on ARC: Score Breakdown
• OLMo 1.7 7B on BBH (BIG-Bench Hard): Score Breakdown
• OLMo 1.7 7B on GPQA: Score Breakdown
• OLMo 1.7 7B on GSM8K (Grade School Math 8K): Score Breakdown
• OLMo 1.7 7B on HumanEval: Score Breakdown
• OLMo 1.7 7B on IFEval: Score Breakdown
• OLMo 1.7 7B on MATH: Score Breakdown
• OLMo 1.7 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 1.7 7B on MUSR: Score Breakdown
• OLMo 1.7 7B on WinoGrande: Score Breakdown
• OLMo 2 1124 7B on ARC: Score Breakdown
• OLMo 2 1124 7B on BBH (BIG-Bench Hard): Score Breakdown
• OLMo 2 1124 7B on GPQA: Score Breakdown
• OLMo 2 1124 7B on GSM8K (Grade School Math 8K): Score Breakdown
• OLMo 2 1124 7B on HumanEval: Score Breakdown
• OLMo 2 1124 7B on IFEval: Score Breakdown
• OLMo 2 1124 7B on MATH: Score Breakdown
• OLMo 2 1124 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 2 1124 7B on MUSR: Score Breakdown
• OLMo 2 1124 7B on WinoGrande: Score Breakdown
• OLMo 7B Instruct on ARC: Score Breakdown
• OLMo 7B Instruct on BBH (BIG-Bench Hard): Score Breakdown
• OLMo 7B Instruct on GPQA: Score Breakdown
• OLMo 7B Instruct on GSM8K (Grade School Math 8K): Score Breakdown
• OLMo 7B Instruct on HumanEval: Score Breakdown
• OLMo 7B Instruct on IFEval: Score Breakdown
• OLMo 7B Instruct on MATH: Score Breakdown
• OLMo 7B Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B Instruct on MUSR: Score Breakdown
• OLMo 7B Instruct on WinoGrande: Score Breakdown
• OLMo 7B on ARC: Score Breakdown
• OLMo 7B on BBH (BIG-Bench Hard): Score Breakdown
• OLMo 7B on GPQA: Score Breakdown
• OLMo 7B on GSM8K (Grade School Math 8K): Score Breakdown
• OLMo 7B on HumanEval: Score Breakdown
• OLMo 7B on IFEval: Score Breakdown
• OLMo 7B on MATH: Score Breakdown
• OLMo 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B on MUSR: Score Breakdown
• OLMo 7B on WinoGrande: Score Breakdown
• OLMo 7B SFT on ARC: Score Breakdown
• OLMo 7B SFT on BBH (BIG-Bench Hard): Score Breakdown
• OLMo 7B SFT on GPQA: Score Breakdown
• OLMo 7B SFT on GSM8K (Grade School Math 8K): Score Breakdown
• OLMo 7B SFT on HumanEval: Score Breakdown
• OLMo 7B SFT on IFEval: Score Breakdown
• OLMo 7B SFT on MATH: Score Breakdown
• OLMo 7B SFT on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B SFT on MUSR: Score Breakdown
• OLMo 7B SFT on WinoGrande: Score Breakdown
• Open-Platypus on ARC: Score Breakdown
• Open-Platypus on BBH (BIG-Bench Hard): Score Breakdown
• Open-Platypus on GPQA: Score Breakdown
• Open-Platypus on GSM8K (Grade School Math 8K): Score Breakdown
• Open-Platypus on HumanEval: Score Breakdown
• Open-Platypus on IFEval: Score Breakdown
• Open-Platypus on MATH: Score Breakdown
• Open-Platypus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Open-Platypus on MUSR: Score Breakdown
• Open-Platypus on WinoGrande: Score Breakdown
• OpenChat 3.5 1210 on ARC: Score Breakdown
• OpenChat 3.5 1210 on BBH (BIG-Bench Hard): Score Breakdown
• OpenChat 3.5 1210 on GPQA: Score Breakdown
• OpenChat 3.5 1210 on GSM8K (Grade School Math 8K): Score Breakdown
• OpenChat 3.5 1210 on HumanEval: Score Breakdown
• OpenChat 3.5 1210 on IFEval: Score Breakdown
• OpenChat 3.5 1210 on MATH: Score Breakdown
• OpenChat 3.5 1210 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OpenChat 3.5 1210 on MUSR: Score Breakdown
• OpenChat 3.5 1210 on WinoGrande: Score Breakdown
• OpenChat 3.6 8B on ARC: Score Breakdown
• OpenChat 3.6 8B on BBH (BIG-Bench Hard): Score Breakdown
• OpenChat 3.6 8B on GPQA: Score Breakdown
• OpenChat 3.6 8B on GSM8K (Grade School Math 8K): Score Breakdown
• OpenChat 3.6 8B on HumanEval: Score Breakdown
• OpenChat 3.6 8B on IFEval: Score Breakdown
• OpenChat 3.6 8B on MATH: Score Breakdown
• OpenChat 3.6 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OpenChat 3.6 8B on MUSR: Score Breakdown
• OpenChat 3.6 8B on WinoGrande: Score Breakdown
• Orca 2 13B on ARC: Score Breakdown
• Orca 2 13B on BBH (BIG-Bench Hard): Score Breakdown
• Orca 2 13B on GPQA: Score Breakdown
• Orca 2 13B on GSM8K (Grade School Math 8K): Score Breakdown
• Orca 2 13B on HumanEval: Score Breakdown
• Orca 2 13B on IFEval: Score Breakdown
• Orca 2 13B on MATH: Score Breakdown
• Orca 2 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Orca 2 13B on MUSR: Score Breakdown
• Orca 2 13B on WinoGrande: Score Breakdown
• PaLM 2 on ARC: Score Breakdown
• PaLM 2 on BBH (BIG-Bench Hard): Score Breakdown
• PaLM 2 on GPQA: Score Breakdown
• PaLM 2 on GSM8K (Grade School Math 8K): Score Breakdown
• PaLM 2 on HumanEval: Score Breakdown
• PaLM 2 on IFEval: Score Breakdown
• PaLM 2 on MATH: Score Breakdown
• PaLM 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• PaLM 2 on MUSR: Score Breakdown
• PaLM 2 on WinoGrande: Score Breakdown
• Phi-1 on ARC: Score Breakdown
• Phi-1 on BBH (BIG-Bench Hard): Score Breakdown
• Phi-1 on GPQA: Score Breakdown
• Phi-1 on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-1 on HumanEval: Score Breakdown
• Phi-1 on IFEval: Score Breakdown
• Phi-1 on MATH: Score Breakdown
• Phi-1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-1 on MUSR: Score Breakdown
• Phi-1 on WinoGrande: Score Breakdown
• Phi-1.5 on ARC: Score Breakdown
• Phi-1.5 on BBH (BIG-Bench Hard): Score Breakdown
• Phi-1.5 on GPQA: Score Breakdown
• Phi-1.5 on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-1.5 on HumanEval: Score Breakdown
• Phi-1.5 on IFEval: Score Breakdown
• Phi-1.5 on MATH: Score Breakdown
• Phi-1.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-1.5 on MUSR: Score Breakdown
• Phi-1.5 on WinoGrande: Score Breakdown
• Phi-2 on ARC: Score Breakdown
• Phi-2 on BBH (BIG-Bench Hard): Score Breakdown
• Phi-2 on GPQA: Score Breakdown
• Phi-2 on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-2 on HumanEval: Score Breakdown
• Phi-2 on IFEval: Score Breakdown
• Phi-2 on MATH: Score Breakdown
• Phi-2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-2 on MUSR: Score Breakdown
• Phi-2 on WinoGrande: Score Breakdown
• Phi-3 Medium on ARC: Score Breakdown
• Phi-3 Medium on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3 Medium on GPQA: Score Breakdown
• Phi-3 Medium on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3 Medium on HumanEval: Score Breakdown
• Phi-3 Medium on IFEval: Score Breakdown
• Phi-3 Medium on MATH: Score Breakdown
• Phi-3 Medium on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Medium on MUSR: Score Breakdown
• Phi-3 Medium on WinoGrande: Score Breakdown
• Phi-3 Mini on ARC: Score Breakdown
• Phi-3 Mini on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3 Mini on GPQA: Score Breakdown
• Phi-3 Mini on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3 Mini on HumanEval: Score Breakdown
• Phi-3 Mini on IFEval: Score Breakdown
• Phi-3 Mini on MATH: Score Breakdown
• Phi-3 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Mini on MUSR: Score Breakdown
• Phi-3 Mini on WinoGrande: Score Breakdown
• Phi-3 Small on ARC: Score Breakdown
• Phi-3 Small on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3 Small on GPQA: Score Breakdown
• Phi-3 Small on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3 Small on HumanEval: Score Breakdown
• Phi-3 Small on IFEval: Score Breakdown
• Phi-3 Small on MATH: Score Breakdown
• Phi-3 Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Small on MUSR: Score Breakdown
• Phi-3 Small on WinoGrande: Score Breakdown
• Phi-3 Vision on ARC: Score Breakdown
• Phi-3 Vision on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3 Vision on GPQA: Score Breakdown
• Phi-3 Vision on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3 Vision on HumanEval: Score Breakdown
• Phi-3 Vision on IFEval: Score Breakdown
• Phi-3 Vision on MATH: Score Breakdown
• Phi-3 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Vision on MUSR: Score Breakdown
• Phi-3 Vision on WinoGrande: Score Breakdown
• Phi-3.5 Mini on ARC: Score Breakdown
• Phi-3.5 Mini on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3.5 Mini on GPQA: Score Breakdown
• Phi-3.5 Mini on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3.5 Mini on HumanEval: Score Breakdown
• Phi-3.5 Mini on IFEval: Score Breakdown
• Phi-3.5 Mini on MATH: Score Breakdown
• Phi-3.5 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3.5 Mini on MUSR: Score Breakdown
• Phi-3.5 Mini on WinoGrande: Score Breakdown
• Phi-3.5 MoE on ARC: Score Breakdown
• Phi-3.5 MoE on BBH (BIG-Bench Hard): Score Breakdown
• Phi-3.5 MoE on GPQA: Score Breakdown
• Phi-3.5 MoE on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-3.5 MoE on HumanEval: Score Breakdown
• Phi-3.5 MoE on IFEval: Score Breakdown
• Phi-3.5 MoE on MATH: Score Breakdown
• Phi-3.5 MoE on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3.5 MoE on MUSR: Score Breakdown
• Phi-3.5 MoE on WinoGrande: Score Breakdown
• Phi-4 on ARC: Score Breakdown
• Phi-4 on BBH (BIG-Bench Hard): Score Breakdown
• Phi-4 on GPQA: Score Breakdown
• Phi-4 on GSM8K (Grade School Math 8K): Score Breakdown
• Phi-4 on HumanEval: Score Breakdown
• Phi-4 on IFEval: Score Breakdown
• Phi-4 on MATH: Score Breakdown
• Phi-4 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-4 on MUSR: Score Breakdown
• Phi-4 on WinoGrande: Score Breakdown
• Qwen1.5 110B on ARC: Score Breakdown
• Qwen1.5 110B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen1.5 110B on GPQA: Score Breakdown
• Qwen1.5 110B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen1.5 110B on HumanEval: Score Breakdown
• Qwen1.5 110B on IFEval: Score Breakdown
• Qwen1.5 110B on MATH: Score Breakdown
• Qwen1.5 110B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 110B on MUSR: Score Breakdown
• Qwen1.5 110B on WinoGrande: Score Breakdown
• Qwen1.5 14B on ARC: Score Breakdown
• Qwen1.5 14B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen1.5 14B on GPQA: Score Breakdown
• Qwen1.5 14B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen1.5 14B on HumanEval: Score Breakdown
• Qwen1.5 14B on IFEval: Score Breakdown
• Qwen1.5 14B on MATH: Score Breakdown
• Qwen1.5 14B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 14B on MUSR: Score Breakdown
• Qwen1.5 14B on WinoGrande: Score Breakdown
• Qwen1.5 32B on ARC: Score Breakdown
• Qwen1.5 32B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen1.5 32B on GPQA: Score Breakdown
• Qwen1.5 32B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen1.5 32B on HumanEval: Score Breakdown
• Qwen1.5 32B on IFEval: Score Breakdown
• Qwen1.5 32B on MATH: Score Breakdown
• Qwen1.5 32B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 32B on MUSR: Score Breakdown
• Qwen1.5 32B on WinoGrande: Score Breakdown
• Qwen1.5 72B on ARC: Score Breakdown
• Qwen1.5 72B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen1.5 72B on GPQA: Score Breakdown
• Qwen1.5 72B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen1.5 72B on HumanEval: Score Breakdown
• Qwen1.5 72B on IFEval: Score Breakdown
• Qwen1.5 72B on MATH: Score Breakdown
• Qwen1.5 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 72B on MUSR: Score Breakdown
• Qwen1.5 72B on WinoGrande: Score Breakdown
• Qwen2 1.5B on ARC: Score Breakdown
• Qwen2 1.5B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2 1.5B on GPQA: Score Breakdown
• Qwen2 1.5B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2 1.5B on HumanEval: Score Breakdown
• Qwen2 1.5B on IFEval: Score Breakdown
• Qwen2 1.5B on MATH: Score Breakdown
• Qwen2 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 1.5B on MUSR: Score Breakdown
• Qwen2 1.5B on WinoGrande: Score Breakdown
• Qwen2 57B on ARC: Score Breakdown
• Qwen2 57B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2 57B on GPQA: Score Breakdown
• Qwen2 57B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2 57B on HumanEval: Score Breakdown
• Qwen2 57B on IFEval: Score Breakdown
• Qwen2 57B on MATH: Score Breakdown
• Qwen2 57B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 57B on MUSR: Score Breakdown
• Qwen2 57B on WinoGrande: Score Breakdown
• Qwen2 72B on ARC: Score Breakdown
• Qwen2 72B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2 72B on GPQA: Score Breakdown
• Qwen2 72B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2 72B on HumanEval: Score Breakdown
• Qwen2 72B on IFEval: Score Breakdown
• Qwen2 72B on MATH: Score Breakdown
• Qwen2 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 72B on MUSR: Score Breakdown
• Qwen2 72B on WinoGrande: Score Breakdown
• Qwen2 7B on ARC: Score Breakdown
• Qwen2 7B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2 7B on GPQA: Score Breakdown
• Qwen2 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2 7B on HumanEval: Score Breakdown
• Qwen2 7B on IFEval: Score Breakdown
• Qwen2 7B on MATH: Score Breakdown
• Qwen2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 7B on MUSR: Score Breakdown
• Qwen2 7B on WinoGrande: Score Breakdown
• Qwen2.5 0.5B on ARC: Score Breakdown
• Qwen2.5 0.5B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 0.5B on GPQA: Score Breakdown
• Qwen2.5 0.5B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 0.5B on HumanEval: Score Breakdown
• Qwen2.5 0.5B on IFEval: Score Breakdown
• Qwen2.5 0.5B on MATH: Score Breakdown
• Qwen2.5 0.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 0.5B on MUSR: Score Breakdown
• Qwen2.5 0.5B on WinoGrande: Score Breakdown
• Qwen2.5 1.5B on ARC: Score Breakdown
• Qwen2.5 1.5B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 1.5B on GPQA: Score Breakdown
• Qwen2.5 1.5B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 1.5B on HumanEval: Score Breakdown
• Qwen2.5 1.5B on IFEval: Score Breakdown
• Qwen2.5 1.5B on MATH: Score Breakdown
• Qwen2.5 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 1.5B on MUSR: Score Breakdown
• Qwen2.5 1.5B on WinoGrande: Score Breakdown
• Qwen2.5 14B on ARC: Score Breakdown
• Qwen2.5 14B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 14B on GPQA: Score Breakdown
• Qwen2.5 14B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 14B on HumanEval: Score Breakdown
• Qwen2.5 14B on IFEval: Score Breakdown
• Qwen2.5 14B on MATH: Score Breakdown
• Qwen2.5 14B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 14B on MUSR: Score Breakdown
• Qwen2.5 14B on WinoGrande: Score Breakdown
• Qwen2.5 32B on ARC: Score Breakdown
• Qwen2.5 32B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 32B on GPQA: Score Breakdown
• Qwen2.5 32B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 32B on HumanEval: Score Breakdown
• Qwen2.5 32B on IFEval: Score Breakdown
• Qwen2.5 32B on MATH: Score Breakdown
• Qwen2.5 32B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 32B on MUSR: Score Breakdown
• Qwen2.5 32B on WinoGrande: Score Breakdown
• Qwen2.5 3B on ARC: Score Breakdown
• Qwen2.5 3B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 3B on GPQA: Score Breakdown
• Qwen2.5 3B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 3B on HumanEval: Score Breakdown
• Qwen2.5 3B on IFEval: Score Breakdown
• Qwen2.5 3B on MATH: Score Breakdown
• Qwen2.5 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 3B on MUSR: Score Breakdown
• Qwen2.5 3B on WinoGrande: Score Breakdown
• Qwen2.5 72B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 72B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 72B on HumanEval: Score Breakdown
• Qwen2.5 72B on MATH: Score Breakdown
• Qwen2.5 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 7B on ARC: Score Breakdown
• Qwen2.5 7B on BBH (BIG-Bench Hard): Score Breakdown
• Qwen2.5 7B on GPQA: Score Breakdown
• Qwen2.5 7B on GSM8K (Grade School Math 8K): Score Breakdown
• Qwen2.5 7B on HumanEval: Score Breakdown
• Qwen2.5 7B on IFEval: Score Breakdown
• Qwen2.5 7B on MATH: Score Breakdown
• Qwen2.5 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 7B on MUSR: Score Breakdown
• Qwen2.5 7B on WinoGrande: Score Breakdown
• Sonar Huge on ARC: Score Breakdown
• Sonar Huge on BBH (BIG-Bench Hard): Score Breakdown
• Sonar Huge on GPQA: Score Breakdown
• Sonar Huge on GSM8K (Grade School Math 8K): Score Breakdown
• Sonar Huge on HumanEval: Score Breakdown
• Sonar Huge on IFEval: Score Breakdown
• Sonar Huge on MATH: Score Breakdown
• Sonar Huge on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Huge on MUSR: Score Breakdown
• Sonar Huge on WinoGrande: Score Breakdown
• Sonar Large on ARC: Score Breakdown
• Sonar Large on BBH (BIG-Bench Hard): Score Breakdown
• Sonar Large on GPQA: Score Breakdown
• Sonar Large on GSM8K (Grade School Math 8K): Score Breakdown
• Sonar Large on HumanEval: Score Breakdown
• Sonar Large on IFEval: Score Breakdown
• Sonar Large on MATH: Score Breakdown
• Sonar Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Large on MUSR: Score Breakdown
• Sonar Large on WinoGrande: Score Breakdown
• Sonar Reasoning on ARC: Score Breakdown
• Sonar Reasoning on BBH (BIG-Bench Hard): Score Breakdown
• Sonar Reasoning on GPQA: Score Breakdown
• Sonar Reasoning on GSM8K (Grade School Math 8K): Score Breakdown
• Sonar Reasoning on HumanEval: Score Breakdown
• Sonar Reasoning on IFEval: Score Breakdown
• Sonar Reasoning on MATH: Score Breakdown
• Sonar Reasoning on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Reasoning on MUSR: Score Breakdown
• Sonar Reasoning on WinoGrande: Score Breakdown
• Sonar Small on ARC: Score Breakdown
• Sonar Small on BBH (BIG-Bench Hard): Score Breakdown
• Sonar Small on GPQA: Score Breakdown
• Sonar Small on GSM8K (Grade School Math 8K): Score Breakdown
• Sonar Small on HumanEval: Score Breakdown
• Sonar Small on IFEval: Score Breakdown
• Sonar Small on MATH: Score Breakdown
• Sonar Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Small on MUSR: Score Breakdown
• Sonar Small on WinoGrande: Score Breakdown
• StableCode 3B on ARC: Score Breakdown
• StableCode 3B on BBH (BIG-Bench Hard): Score Breakdown
• StableCode 3B on GPQA: Score Breakdown
• StableCode 3B on GSM8K (Grade School Math 8K): Score Breakdown
• StableCode 3B on HumanEval: Score Breakdown
• StableCode 3B on IFEval: Score Breakdown
• StableCode 3B on MATH: Score Breakdown
• StableCode 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableCode 3B on MUSR: Score Breakdown
• StableCode 3B on WinoGrande: Score Breakdown
• StableLM 2 1.6B on ARC: Score Breakdown
• StableLM 2 1.6B on BBH (BIG-Bench Hard): Score Breakdown
• StableLM 2 1.6B on GPQA: Score Breakdown
• StableLM 2 1.6B on GSM8K (Grade School Math 8K): Score Breakdown
• StableLM 2 1.6B on HumanEval: Score Breakdown
• StableLM 2 1.6B on IFEval: Score Breakdown
• StableLM 2 1.6B on MATH: Score Breakdown
• StableLM 2 1.6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 2 1.6B on MUSR: Score Breakdown
• StableLM 2 1.6B on WinoGrande: Score Breakdown
• StableLM 2 12B on ARC: Score Breakdown
• StableLM 2 12B on BBH (BIG-Bench Hard): Score Breakdown
• StableLM 2 12B on GPQA: Score Breakdown
• StableLM 2 12B on GSM8K (Grade School Math 8K): Score Breakdown
• StableLM 2 12B on HumanEval: Score Breakdown
• StableLM 2 12B on IFEval: Score Breakdown
• StableLM 2 12B on MATH: Score Breakdown
• StableLM 2 12B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 2 12B on MUSR: Score Breakdown
• StableLM 2 12B on WinoGrande: Score Breakdown
• StableLM 3 4B on ARC: Score Breakdown
• StableLM 3 4B on BBH (BIG-Bench Hard): Score Breakdown
• StableLM 3 4B on GPQA: Score Breakdown
• StableLM 3 4B on GSM8K (Grade School Math 8K): Score Breakdown
• StableLM 3 4B on HumanEval: Score Breakdown
• StableLM 3 4B on IFEval: Score Breakdown
• StableLM 3 4B on MATH: Score Breakdown
• StableLM 3 4B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 3 4B on MUSR: Score Breakdown
• StableLM 3 4B on WinoGrande: Score Breakdown
• StableLM Zephyr 3B on ARC: Score Breakdown
• StableLM Zephyr 3B on BBH (BIG-Bench Hard): Score Breakdown
• StableLM Zephyr 3B on GPQA: Score Breakdown
• StableLM Zephyr 3B on GSM8K (Grade School Math 8K): Score Breakdown
• StableLM Zephyr 3B on HumanEval: Score Breakdown
• StableLM Zephyr 3B on IFEval: Score Breakdown
• StableLM Zephyr 3B on MATH: Score Breakdown
• StableLM Zephyr 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM Zephyr 3B on MUSR: Score Breakdown
• StableLM Zephyr 3B on WinoGrande: Score Breakdown
• StarChat2 15B v0.1 on ARC: Score Breakdown
• StarChat2 15B v0.1 on BBH (BIG-Bench Hard): Score Breakdown
• StarChat2 15B v0.1 on GPQA: Score Breakdown
• StarChat2 15B v0.1 on GSM8K (Grade School Math 8K): Score Breakdown
• StarChat2 15B v0.1 on HumanEval: Score Breakdown
• StarChat2 15B v0.1 on IFEval: Score Breakdown
• StarChat2 15B v0.1 on MATH: Score Breakdown
• StarChat2 15B v0.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarChat2 15B v0.1 on MUSR: Score Breakdown
• StarChat2 15B v0.1 on WinoGrande: Score Breakdown
• StarCoder2 15B on ARC: Score Breakdown
• StarCoder2 15B on BBH (BIG-Bench Hard): Score Breakdown
• StarCoder2 15B on GPQA: Score Breakdown
• StarCoder2 15B on GSM8K (Grade School Math 8K): Score Breakdown
• StarCoder2 15B on HumanEval: Score Breakdown
• StarCoder2 15B on IFEval: Score Breakdown
• StarCoder2 15B on MATH: Score Breakdown
• StarCoder2 15B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 15B on MUSR: Score Breakdown
• StarCoder2 15B on WinoGrande: Score Breakdown
• StarCoder2 3B on ARC: Score Breakdown
• StarCoder2 3B on BBH (BIG-Bench Hard): Score Breakdown
• StarCoder2 3B on GPQA: Score Breakdown
• StarCoder2 3B on GSM8K (Grade School Math 8K): Score Breakdown
• StarCoder2 3B on HumanEval: Score Breakdown
• StarCoder2 3B on IFEval: Score Breakdown
• StarCoder2 3B on MATH: Score Breakdown
• StarCoder2 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 3B on MUSR: Score Breakdown
• StarCoder2 3B on WinoGrande: Score Breakdown
• StarCoder2 7B on ARC: Score Breakdown
• StarCoder2 7B on BBH (BIG-Bench Hard): Score Breakdown
• StarCoder2 7B on GPQA: Score Breakdown
• StarCoder2 7B on GSM8K (Grade School Math 8K): Score Breakdown
• StarCoder2 7B on HumanEval: Score Breakdown
• StarCoder2 7B on IFEval: Score Breakdown
• StarCoder2 7B on MATH: Score Breakdown
• StarCoder2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 7B on MUSR: Score Breakdown
• StarCoder2 7B on WinoGrande: Score Breakdown
• Text Bison on ARC: Score Breakdown
• Text Bison on BBH (BIG-Bench Hard): Score Breakdown
• Text Bison on GPQA: Score Breakdown
• Text Bison on GSM8K (Grade School Math 8K): Score Breakdown
• Text Bison on HumanEval: Score Breakdown
• Text Bison on IFEval: Score Breakdown
• Text Bison on MATH: Score Breakdown
• Text Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Text Bison on MUSR: Score Breakdown
• Text Bison on WinoGrande: Score Breakdown
• TigerBot 70B Chat on ARC: Score Breakdown
• TigerBot 70B Chat on BBH (BIG-Bench Hard): Score Breakdown
• TigerBot 70B Chat on GPQA: Score Breakdown
• TigerBot 70B Chat on GSM8K (Grade School Math 8K): Score Breakdown
• TigerBot 70B Chat on HumanEval: Score Breakdown
• TigerBot 70B Chat on IFEval: Score Breakdown
• TigerBot 70B Chat on MATH: Score Breakdown
• TigerBot 70B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• TigerBot 70B Chat on MUSR: Score Breakdown
• TigerBot 70B Chat on WinoGrande: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on ARC: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on BBH (BIG-Bench Hard): Score Breakdown
• WizardLM Team WizardLM 2 8x22B on GPQA: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on GSM8K (Grade School Math 8K): Score Breakdown
• WizardLM Team WizardLM 2 8x22B on HumanEval: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on IFEval: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on MATH: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• WizardLM Team WizardLM 2 8x22B on MUSR: Score Breakdown
• WizardLM Team WizardLM 2 8x22B on WinoGrande: Score Breakdown
• Yi 1.5 34B on ARC: Score Breakdown
• Yi 1.5 34B on BBH (BIG-Bench Hard): Score Breakdown
• Yi 1.5 34B on GPQA: Score Breakdown
• Yi 1.5 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Yi 1.5 34B on HumanEval: Score Breakdown
• Yi 1.5 34B on IFEval: Score Breakdown
• Yi 1.5 34B on MATH: Score Breakdown
• Yi 1.5 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 34B on MUSR: Score Breakdown
• Yi 1.5 34B on WinoGrande: Score Breakdown
• Yi 1.5 6B on ARC: Score Breakdown
• Yi 1.5 6B on BBH (BIG-Bench Hard): Score Breakdown
• Yi 1.5 6B on GPQA: Score Breakdown
• Yi 1.5 6B on GSM8K (Grade School Math 8K): Score Breakdown
• Yi 1.5 6B on HumanEval: Score Breakdown
• Yi 1.5 6B on IFEval: Score Breakdown
• Yi 1.5 6B on MATH: Score Breakdown
• Yi 1.5 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 6B on MUSR: Score Breakdown
• Yi 1.5 6B on WinoGrande: Score Breakdown
• Yi 1.5 9B on ARC: Score Breakdown
• Yi 1.5 9B on BBH (BIG-Bench Hard): Score Breakdown
• Yi 1.5 9B on GPQA: Score Breakdown
• Yi 1.5 9B on GSM8K (Grade School Math 8K): Score Breakdown
• Yi 1.5 9B on HumanEval: Score Breakdown
• Yi 1.5 9B on IFEval: Score Breakdown
• Yi 1.5 9B on MATH: Score Breakdown
• Yi 1.5 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 9B on MUSR: Score Breakdown
• Yi 1.5 9B on WinoGrande: Score Breakdown
• Yi 34B on ARC: Score Breakdown
• Yi 34B on BBH (BIG-Bench Hard): Score Breakdown
• Yi 34B on GPQA: Score Breakdown
• Yi 34B on GSM8K (Grade School Math 8K): Score Breakdown
• Yi 34B on HumanEval: Score Breakdown
• Yi 34B on IFEval: Score Breakdown
• Yi 34B on MATH: Score Breakdown
• Yi 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 34B on MUSR: Score Breakdown
• Yi 34B on WinoGrande: Score Breakdown
• Yi 6B on ARC: Score Breakdown
• Yi 6B on BBH (BIG-Bench Hard): Score Breakdown
• Yi 6B on GPQA: Score Breakdown
• Yi 6B on GSM8K (Grade School Math 8K): Score Breakdown
• Yi 6B on HumanEval: Score Breakdown
• Yi 6B on IFEval: Score Breakdown
• Yi 6B on MATH: Score Breakdown
• Yi 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 6B on MUSR: Score Breakdown
• Yi 6B on WinoGrande: Score Breakdown
• Yi Large on ARC: Score Breakdown
• Yi Large on BBH (BIG-Bench Hard): Score Breakdown
• Yi Large on GPQA: Score Breakdown
• Yi Large on GSM8K (Grade School Math 8K): Score Breakdown
• Yi Large on HumanEval: Score Breakdown
• Yi Large on IFEval: Score Breakdown
• Yi Large on MATH: Score Breakdown
• Yi Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Large on MUSR: Score Breakdown
• Yi Large on WinoGrande: Score Breakdown
• Yi Large Turbo on ARC: Score Breakdown
• Yi Large Turbo on BBH (BIG-Bench Hard): Score Breakdown
• Yi Large Turbo on GPQA: Score Breakdown
• Yi Large Turbo on GSM8K (Grade School Math 8K): Score Breakdown
• Yi Large Turbo on HumanEval: Score Breakdown
• Yi Large Turbo on IFEval: Score Breakdown
• Yi Large Turbo on MATH: Score Breakdown
• Yi Large Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Large Turbo on MUSR: Score Breakdown
• Yi Large Turbo on WinoGrande: Score Breakdown
• Yi Vision on ARC: Score Breakdown
• Yi Vision on BBH (BIG-Bench Hard): Score Breakdown
• Yi Vision on GPQA: Score Breakdown
• Yi Vision on GSM8K (Grade School Math 8K): Score Breakdown
• Yi Vision on HumanEval: Score Breakdown
• Yi Vision on IFEval: Score Breakdown
• Yi Vision on MATH: Score Breakdown
• Yi Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Vision on MUSR: Score Breakdown
• Yi Vision on WinoGrande: Score Breakdown
• Zephyr 7B Alpha on ARC: Score Breakdown
• Zephyr 7B Alpha on BBH (BIG-Bench Hard): Score Breakdown
• Zephyr 7B Alpha on GPQA: Score Breakdown
• Zephyr 7B Alpha on GSM8K (Grade School Math 8K): Score Breakdown
• Zephyr 7B Alpha on HumanEval: Score Breakdown
• Zephyr 7B Alpha on IFEval: Score Breakdown
• Zephyr 7B Alpha on MATH: Score Breakdown
• Zephyr 7B Alpha on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr 7B Alpha on MUSR: Score Breakdown
• Zephyr 7B Alpha on WinoGrande: Score Breakdown
• Zephyr 7B Beta on ARC: Score Breakdown
• Zephyr 7B Beta on BBH (BIG-Bench Hard): Score Breakdown
• Zephyr 7B Beta on GPQA: Score Breakdown
• Zephyr 7B Beta on GSM8K (Grade School Math 8K): Score Breakdown
• Zephyr 7B Beta on HumanEval: Score Breakdown
• Zephyr 7B Beta on IFEval: Score Breakdown
• Zephyr 7B Beta on MATH: Score Breakdown
• Zephyr 7B Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr 7B Beta on MUSR: Score Breakdown
• Zephyr 7B Beta on WinoGrande: Score Breakdown
• Zephyr ORPO 141B Alpha on ARC: Score Breakdown
• Zephyr ORPO 141B Alpha on BBH (BIG-Bench Hard): Score Breakdown
• Zephyr ORPO 141B Alpha on GPQA: Score Breakdown
• Zephyr ORPO 141B Alpha on GSM8K (Grade School Math 8K): Score Breakdown
• Zephyr ORPO 141B Alpha on HumanEval: Score Breakdown
• Zephyr ORPO 141B Alpha on IFEval: Score Breakdown
• Zephyr ORPO 141B Alpha on MATH: Score Breakdown
• Zephyr ORPO 141B Alpha on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr ORPO 141B Alpha on MUSR: Score Breakdown
• Zephyr ORPO 141B Alpha on WinoGrande: Score Breakdown