Analysis III · Exercise research profile

Existence away from singular axes, integrating factor, and crossing t=0 (A3-25-P5-E3)

Source record, frozen scoring evidence, configuration-level measurements and retained responses for one benchmark exercise.

01

Observed panel summary

Exercise overview

Descriptive results across 21 model-mode configuration means. They do not establish general model superiority.

Published recordSource statement · frozen rubric · 23 retained responses · current judgmentsThe separate official reference solution is not reproduced.
Mean rubric score82.9Median 95.1 · n=16
Configuration spreadSD 21.832.1–100.0
Rank by lowest observed mean#7/60Overall · #5/33 within Analysis III
Mean latency141.2sEnd-to-end per response
Mean cost$0.087Snapshot estimate
Mean tokens10,699Analytical tokens per response

Configuration means

Observed score distribution

Median 95.1 / 100
AnthropicDeepSeekOpenAIGooglexAIMistral
  1. Claude Fable 5SD not available · single run
    100.0
  2. Claude Opus 5.5SD not available · single run
    100.0
  3. Claude Sonnet 5.5SD not available · single run
    100.0
  4. DeepSeek V4 FlashSD not available · single run
    100.0
  5. GPT-5.6 SolSD not available · single run
    100.0
  6. GPT-6 LunaSD not available · single run
    100.0
  7. GPT-6.1 SolSD not available · single run
    100.0
  8. DeepSeek V4 ProSD not available · single run
    97.9
  9. DeepSeek V4.1 FlashSD not available · single run
    96.8
  10. Gemini 3.1 Pro PreviewSD not available · single run
    96.8
  11. Gemini 3.5 FlashSD 4.5 · 3 retained runs
    95.1
  12. Grok 4.5SD not available · single run
    91.6
  13. Mistral Small 4SD not available · single run
    91.3
  14. Gemma 4 31B ITSD not available · single run
    82.6
  15. Grok 4.3SD not available · single run
    73.7
  16. DeepSeek V4 Flash (no thinking)SD not available · single run
    72.4
  17. OpenAI o3SD not available · single run
    69.5
  18. Mistral Medium 3.5SD not available · single run
    58.9
  19. Claude Sonnet 4.5SD not available · single run
    42.1
  20. OpenAI GPT-4.1SD not available · single run
    40.5
  21. Claude Haiku 4.5SD not available · single run
    32.1

Whiskers show mean ± one within-configuration response SD where three retained runs are available. Single-run cells have no within-configuration variability statistic.

02

Task before results

Source record and frozen rubric

Read the evaluated task before interpreting configuration outcomes. Original Italian records remain authoritative.

Evaluated source record

Exercise statement

A3-25-P5-E3 · Analysis III
The English version is a faithful editorial translation. The Italian source remains authoritative.

ESAME: Analisi 3 DATA: 20/08/2025 ESERCIZIO: 3

TESTO: 3. È data l’equazione differenziale m t ym−1y′= 1+( t−1)ym nella funzione scalare y(t) (ove m∈N). (a) Cosa si può affermare a priori su esistenza e unicità delle soluzioni? (b) Posto m = 2 determinare le soluzioni con dati iniziali y(−1) = 1 oppure y(1) = 1. (c) Posto m = 1 determinare le soluzioni coi dati iniziali precedenti. (d) Nei casi m = 2 e m = 1 esistono soluzioni definite anche per t = 0?

NOTE: (1)Può essere utile sapere che ∫√ 1 +u2du = 1 2(u √ 1 +u2 + log(u + √ 1 +u2)).

Source transcription errata1 recorded normalization · original preserved+

These notes document evident transcription or OCR artifacts. They do not overwrite the authoritative source record above.

As transcribedm t ym−1y′; (t−1)ym; m∈NEditorial normalizationm t y^(m−1)y′; (t−1)y^m; m∈ℕExponents and number-set styling were flattened.
Original source textExact Italian record · no editorial changes+
ESAME: Analisi 3
DATA: 20/08/2025
ESERCIZIO: 3

TESTO:
3. È data l’equazione differenziale m t ym−1y′= 1+( t−1)ym nella funzione scalare y(t) (ove m∈N).
(a) Cosa si può affermare a priori su esistenza e unicità delle soluzioni?
(b) Posto m = 2 determinare le soluzioni con dati iniziali y(−1) = 1 oppure y(1) = 1.
(c) Posto m = 1 determinare le soluzioni coi dati iniziali precedenti.
(d) Nei casi m = 2 e m = 1 esistono soluzioni definite anche per t = 0?

NOTE:
(1)Può essere utile sapere che
∫√
1 +u2du = 1
2(u
√
1 +u2 + log(u +
√
1 +u2)).
TopicExistence away from singular axes, integrating factor, and crossing t=0
Syllabus areaImplicit differential equations
Task typemixed
Atomic criteria27
Subproblem a · 23.2%

Conclusioni a priori.

6 atomic criteria · T1 · T2 · T4 · T5 · T6 · T7

Inspect scoring criteria +
  • Distingue forma normale e insiemi singolari.

    T1 · 8 pts · Criterion (a_T1_01)
  • Sceglie teoremi appropriati.

    T2 · 4 pts · Criterion (a_T2_01)
  • Dà conclusioni a priori.

    T4 · 2 pts · Criterion (a_T4_01)
  • Gestisce t0,y0 e parità.

    T5 · 4 pts · Criterion (a_T5_01)
  • Distingue esistenza/unicità.

    T6 · 2 pts · Criterion (a_T6_01)
  • Applica rigorosamente i teoremi.

    T7 · 2 pts · Criterion (a_T7_01)
Subproblem b · 27.4%

Soluzioni m=2.

7 atomic criteria · T1 · T2 · T3 · T4 · T5 · T6 · T7

Inspect scoring criteria +
  • Trova integrale primo m=2.

    T1 · 4 pts · Criterion (b_T1_01)
  • Sceglie fattore integrante/u=y².

    T2 · 4 pts · Criterion (b_T2_01)
  • Calcola costanti/formule.

    T3 · 7 pts · Criterion (b_T3_01)
  • Dà soluzioni/domìni.

    T4 · 5 pts · Criterion (b_T4_01)
  • Gestisce ramo/positività.

    T5 · 2 pts · Criterion (b_T5_01)
  • Verifica dati/domìni.

    T6 · 2 pts · Criterion (b_T6_01)
  • Usa integrale primo rigorosamente.

    T7 · 2 pts · Criterion (b_T7_01)
Subproblem c · 26.3%

Soluzioni m=1.

7 atomic criteria · T1 · T2 · T3 · T4 · T5 · T6 · T7

Inspect scoring criteria +
  • Formalizza ODE lineare.

    T1 · 4 pts · Criterion (c_T1_01)
  • Imposta fattore integrante.

    T2 · 4 pts · Criterion (c_T2_01)
  • Calcola costanti/formule.

    T3 · 7 pts · Criterion (c_T3_01)
  • Dà soluzioni/domìni.

    T4 · 4 pts · Criterion (c_T4_01)
  • Separa i semiasse.

    T5 · 2 pts · Criterion (c_T5_01)
  • Verifica i dati.

    T6 · 2 pts · Criterion (c_T6_01)
  • Applica teoria lineare.

    T7 · 2 pts · Criterion (c_T7_01)
Subproblem d · 23.2%

Soluzioni definite a t=0.

7 atomic criteria · T1 · T2 · T3 · T4 · T5 · T6 · T7

Inspect scoring criteria +
  • Identifica k=1.

    T1 · 4 pts · Criterion (d_T1_01)
  • Imposta prolungamenti/sviluppi.

    T2 · 3 pts · Criterion (d_T2_01)
  • Calcola limiti/regolarità.

    T3 · 6 pts · Criterion (d_T3_01)
  • Classifica tutti i rami.

    T4 · 4 pts · Criterion (d_T4_01)
  • Assegna valori a t=0.

    T5 · 2 pts · Criterion (d_T5_01)
  • Controlla equazione/C1.

    T6 · 2 pts · Criterion (d_T6_01)
  • Giustifica unicità classificazione.

    T7 · 1 pts · Criterion (d_T7_01)
Complete frozen rubricOriginal Italian record · exact JSON · SHA-256 97cad6a33863…+
{
  "rubric_version": "1.0",
  "judge_spec_version": "2.0",
  "item_id": "analisi_3_2025_quinto_appello_esercizio_3",
  "syllabus_macroarea": "Equazioni differenziali implicite",
  "topic": "Esistenza fuori dagli assi singolari, fattore integrante e attraversamento di t=0",
  "task_type": "mixed",
  "created_without_model_answers": true,
  "frozen": true,
  "reference_status": "verified",
  "reference_notes": "Gold: per t0≠0,y0≠0 esistenza/unicità locale e unicità globale nel quadrante; una soluzione non si annulla. A t=0: y(0)=1 per m dispari, y(0)=±1 per m pari. Integrale primo (ty^m+1)e^{-t}=k. m=2: dati (-1,1): y=1/√|t|, t<0; (1,1): y=√((2e^{t-1}-1)/t), t>1-log2. m=1: y=-1/t,t<0; y=(2e^{t-1}-1)/t,t>0. Attraversano t=0 solo k=1: m=2 due rami ±√((e^t-1)/t), m=1 un ramo (e^t-1)/t.",
  "subproblems": [
    {
      "id": "a",
      "weight": 0.23157894736842105,
      "request": "Conclusioni a priori.",
      "expected_results": [
        "forma normale fuori da t=0,y=0",
        "condizioni a t=0"
      ],
      "required_conditions": [
        "Distinguere m=1,m≥2."
      ],
      "accepted_equivalences": [
        "Forme equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodi rigorosi compatibili col gold."
      ]
    },
    {
      "id": "b",
      "weight": 0.2736842105263158,
      "request": "Soluzioni m=2.",
      "expected_results": [
        "integrale primo",
        "due formule/domìni"
      ],
      "required_conditions": [
        "Ramo positivo."
      ],
      "accepted_equivalences": [
        "Forme equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodi rigorosi compatibili col gold."
      ]
    },
    {
      "id": "c",
      "weight": 0.2631578947368421,
      "request": "Soluzioni m=1.",
      "expected_results": [
        "soluzione lineare",
        "due formule/domìni"
      ],
      "required_conditions": [
        "Separare semiasse."
      ],
      "accepted_equivalences": [
        "Forme equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodi rigorosi compatibili col gold."
      ]
    },
    {
      "id": "d",
      "weight": 0.23157894736842105,
      "request": "Soluzioni definite a t=0.",
      "expected_results": [
        "k=1",
        "due rami m=2,uno m=1"
      ],
      "required_conditions": [
        "Verificare C1."
      ],
      "accepted_equivalences": [
        "Forme equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodi rigorosi compatibili col gold."
      ]
    }
  ],
  "atomic_criteria": [
    {
      "criterion_id": "a_T1_01",
      "subproblem_id": "a",
      "primary_dimension": "T1",
      "max_points": 8,
      "description": "Distingue forma normale e insiemi singolari.",
      "full_credit_evidence": [
        "t=0,y=0 e caso m=1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "a_T2_01",
      "subproblem_id": "a",
      "primary_dimension": "T2",
      "max_points": 4,
      "description": "Sceglie teoremi appropriati.",
      "full_credit_evidence": [
        "Cauchy-Lipschitz/lineare."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "a_T4_01",
      "subproblem_id": "a",
      "primary_dimension": "T4",
      "max_points": 2,
      "description": "Dà conclusioni a priori.",
      "full_credit_evidence": [
        "Locale e condizioni a t=0."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "a_T5_01",
      "subproblem_id": "a",
      "primary_dimension": "T5",
      "max_points": 4,
      "description": "Gestisce t0,y0 e parità.",
      "full_credit_evidence": [
        "y(0)^m=1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "a_T6_01",
      "subproblem_id": "a",
      "primary_dimension": "T6",
      "max_points": 2,
      "description": "Distingue esistenza/unicità.",
      "full_credit_evidence": [
        "Nessuna globalità indebita."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "a_T7_01",
      "subproblem_id": "a",
      "primary_dimension": "T7",
      "max_points": 2,
      "description": "Applica rigorosamente i teoremi.",
      "full_credit_evidence": [
        "Ipotesi C1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T1_01",
      "subproblem_id": "b",
      "primary_dimension": "T1",
      "max_points": 4,
      "description": "Trova integrale primo m=2.",
      "full_credit_evidence": [
        "(ty²+1)e^-t=k."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T2_01",
      "subproblem_id": "b",
      "primary_dimension": "T2",
      "max_points": 4,
      "description": "Sceglie fattore integrante/u=y².",
      "full_credit_evidence": [
        "Metodo corretto."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T3_01",
      "subproblem_id": "b",
      "primary_dimension": "T3",
      "max_points": 7,
      "description": "Calcola costanti/formule.",
      "full_credit_evidence": [
        "k=0,2/e e radicandi."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T4_01",
      "subproblem_id": "b",
      "primary_dimension": "T4",
      "max_points": 5,
      "description": "Dà soluzioni/domìni.",
      "full_credit_evidence": [
        "t<0 e t>1-log2."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T5_01",
      "subproblem_id": "b",
      "primary_dimension": "T5",
      "max_points": 2,
      "description": "Gestisce ramo/positività.",
      "full_credit_evidence": [
        "Ramo positivo."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T6_01",
      "subproblem_id": "b",
      "primary_dimension": "T6",
      "max_points": 2,
      "description": "Verifica dati/domìni.",
      "full_credit_evidence": [
        "Valore iniziale 1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "b_T7_01",
      "subproblem_id": "b",
      "primary_dimension": "T7",
      "max_points": 2,
      "description": "Usa integrale primo rigorosamente.",
      "full_credit_evidence": [
        "Nessuna divisione illegittima."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T1_01",
      "subproblem_id": "c",
      "primary_dimension": "T1",
      "max_points": 4,
      "description": "Formalizza ODE lineare.",
      "full_credit_evidence": [
        "Forma su t≠0."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T2_01",
      "subproblem_id": "c",
      "primary_dimension": "T2",
      "max_points": 4,
      "description": "Imposta fattore integrante.",
      "full_credit_evidence": [
        "P=log|t|-t."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T3_01",
      "subproblem_id": "c",
      "primary_dimension": "T3",
      "max_points": 7,
      "description": "Calcola costanti/formule.",
      "full_credit_evidence": [
        "k=0,2/e."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T4_01",
      "subproblem_id": "c",
      "primary_dimension": "T4",
      "max_points": 4,
      "description": "Dà soluzioni/domìni.",
      "full_credit_evidence": [
        "(-∞,0),(0,∞)."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T5_01",
      "subproblem_id": "c",
      "primary_dimension": "T5",
      "max_points": 2,
      "description": "Separa i semiasse.",
      "full_credit_evidence": [
        "Nessun attraversamento implicito."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T6_01",
      "subproblem_id": "c",
      "primary_dimension": "T6",
      "max_points": 2,
      "description": "Verifica i dati.",
      "full_credit_evidence": [
        "Valore 1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "c_T7_01",
      "subproblem_id": "c",
      "primary_dimension": "T7",
      "max_points": 2,
      "description": "Applica teoria lineare.",
      "full_credit_evidence": [
        "Fattore integrante corretto."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T1_01",
      "subproblem_id": "d",
      "primary_dimension": "T1",
      "max_points": 4,
      "description": "Identifica k=1.",
      "full_credit_evidence": [
        "Condizione da t=0."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T2_01",
      "subproblem_id": "d",
      "primary_dimension": "T2",
      "max_points": 3,
      "description": "Imposta prolungamenti/sviluppi.",
      "full_credit_evidence": [
        "(e^t-1)/t."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T3_01",
      "subproblem_id": "d",
      "primary_dimension": "T3",
      "max_points": 6,
      "description": "Calcola limiti/regolarità.",
      "full_credit_evidence": [
        "±1 o 1 e C1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T4_01",
      "subproblem_id": "d",
      "primary_dimension": "T4",
      "max_points": 4,
      "description": "Classifica tutti i rami.",
      "full_credit_evidence": [
        "Due m=2,uno m=1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T5_01",
      "subproblem_id": "d",
      "primary_dimension": "T5",
      "max_points": 2,
      "description": "Assegna valori a t=0.",
      "full_credit_evidence": [
        "±1 e 1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T6_01",
      "subproblem_id": "d",
      "primary_dimension": "T6",
      "max_points": 2,
      "description": "Controlla equazione/C1.",
      "full_credit_evidence": [
        "Prolungamenti validi."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    },
    {
      "criterion_id": "d_T7_01",
      "subproblem_id": "d",
      "primary_dimension": "T7",
      "max_points": 1,
      "description": "Giustifica unicità classificazione.",
      "full_credit_evidence": [
        "Solo k=1."
      ],
      "partial_credit_rules": [
        {
          "credit_fraction": 0.75,
          "anchor": "Corretto salvo un difetto locale."
        },
        {
          "credit_fraction": 0.5,
          "anchor": "Copertura sostanziale ma incompleta."
        },
        {
          "credit_fraction": 0.25,
          "anchor": "Solo impostazione o elemento utile."
        }
      ],
      "zero_credit_conditions": [
        "Assente o incompatibile col gold."
      ],
      "accepted_equivalences": [
        "Forme matematicamente equivalenti."
      ],
      "accepted_alternative_methods": [
        "Metodo alternativo rigoroso compatibile col gold."
      ],
      "propagated_error_policy": "Penalizzare l'origine una sola volta."
    }
  ],
  "dimension_applicability": {
    "T1": "applicable",
    "T2": "applicable",
    "T3": "applicable",
    "T4": "applicable",
    "T5": "applicable",
    "T6": "applicable",
    "T7": "applicable",
    "T8": "not_applicable"
  },
  "dimension_applicability_notes": {
    "T8": "Non applicabile: nessuna verifica autonoma richiesta."
  },
  "dimension_point_budget": {
    "T1": 20,
    "T2": 15,
    "T3": 20,
    "T4": 15,
    "T5": 10,
    "T6": 8,
    "T7": 7,
    "T8": 0
  },
  "applicable_max_score": 95,
  "normalization_rule": "Normalizzare con 100*raw_score/95.",
  "not_applicable_dimensions": [
    "T8"
  ],
  "pertinent_checks": [
    "Derivare integrale primo.",
    "Positività radicandi.",
    "Dati iniziali.",
    "Sviluppi presso 0."
  ],
  "known_error_severity": [
    {
      "error": "Divisione indebita a t=0/y=0",
      "severity": "major"
    },
    {
      "error": "Dominio errato",
      "severity": "major"
    },
    {
      "error": "Ramo errato",
      "severity": "major"
    },
    {
      "error": "Classificazione a t=0 incompleta",
      "severity": "major"
    }
  ],
  "rubric_specific_caps": [],
  "human_review_triggers": [
    "Prolungamento alternativo C1 incerto.",
    "Ambiguità su unicità globale nei quadranti."
  ],
  "human_approval": {
    "approved": true,
    "reviewer": "benchmark_owner_via_codex_task",
    "date": "2026-07-18"
  }
}
03

Per-exercise ranking

Configurations

Choose one of four stable ranking views. Retry count remains available as a secondary table sort.

Rank configurations by

Score ranks high to low. Speed, cost and tokens rank low to high. Retry sorting remains available from the table header.

Results for all 21 model-mode configurations
ConfigurationSelected rankMean score / replicasLatencyCostTokens
Claude Fable 5Anthropic · official model page ↗#1by score100.0SD not available · single run77.2s$0.3658,0200.00
Claude Opus 5.5Anthropic · official model page ↗#1by score100.0SD not available · single run72.7s$0.1538,3460.00
Claude Sonnet 5.5Anthropic · official model page ↗#1by score100.0SD not available · single run44.1s$0.0626,9340.00
DeepSeek V4 FlashDeepSeek · official model page ↗#1by score100.0SD not available · single run212.8s$0.006924,8910.00
GPT-5.6 SolOpenAI · official model page ↗#1by score100.0SD not available · single run309.6s$0.52517,9740.00
GPT-6 LunaOpenAI · official model page ↗#1by score100.0SD not available · single run89.8s$0.005511,4660.00
GPT-6.1 SolOpenAI · official model page ↗#1by score100.0SD not available · single run138.1s$0.0808,4640.00
DeepSeek V4 ProDeepSeek · official model page ↗#8by score97.9SD not available · single run196.0s$0.01112,9410.00
DeepSeek V4.1 FlashDeepSeek · official model page ↗#9by score96.8SD not available · single run105.4s$0.02924,9770.00
Gemini 3.1 Pro PreviewGoogle · official model page ↗#9by score96.8SD not available · single run786.5s$0.11610,0991.00
Gemini 3.5 FlashGoogle · official model page ↗#11by score95.1SD 4.5 · 3 retained runs367.6s$0.14616,7430.00
Grok 4.5xAI · official model page ↗#12by score91.6SD not available · single run107.0s$0.0417,3350.00
Mistral Small 4Mistral · official model page ↗#13by score91.3SD not available · single run60.8s$0.007212,4790.00
Gemma 4 31B ITGoogle · official model page ↗#14by score82.6SD not available · single run48.8s$0.00002,2980.00
Grok 4.3xAI · official model page ↗#15by score73.7SD not available · single run50.0s$0.0156,2170.00
DeepSeek V4 Flash (no thinking)DeepSeek · official model page ↗#16by score72.4SD not available · single run67.2s$0.002710,0580.00
OpenAI o3OpenAI · official model page ↗#17by score69.5SD not available · single run39.3s$0.0496,5650.00
Mistral Medium 3.5Mistral · official model page ↗#18by score58.9SD not available · single run99.8s$0.13918,9890.00
Claude Sonnet 4.5Anthropic · official model page ↗#19by score42.1SD not available · single run35.3s$0.0342,8280.00
OpenAI GPT-4.1OpenAI · official model page ↗#20by score40.5SD not available · single run37.0s$0.0233,2940.00
Claude Haiku 4.5Anthropic · official model page ↗#21by score32.1SD not available · single run20.3s$0.0163,7530.00
#1 by score

Claude Fable 5

Anthropic
100.0mean score

SD not available · single run

Latency
77.2s
Cost
$0.365
Tokens
8,020
Retries
0.00
Official model page ↗
#1 by score

Claude Opus 5.5

Anthropic
100.0mean score

SD not available · single run

Latency
72.7s
Cost
$0.153
Tokens
8,346
Retries
0.00
Official model page ↗
#1 by score

Claude Sonnet 5.5

Anthropic
100.0mean score

SD not available · single run

Latency
44.1s
Cost
$0.062
Tokens
6,934
Retries
0.00
Official model page ↗
#1 by score

DeepSeek V4 Flash

DeepSeek
100.0mean score

SD not available · single run

Latency
212.8s
Cost
$0.0069
Tokens
24,891
Retries
0.00
Official model page ↗
#1 by score

GPT-5.6 Sol

OpenAI
100.0mean score

SD not available · single run

Latency
309.6s
Cost
$0.525
Tokens
17,974
Retries
0.00
Official model page ↗
#1 by score

GPT-6 Luna

OpenAI
100.0mean score

SD not available · single run

Latency
89.8s
Cost
$0.0055
Tokens
11,466
Retries
0.00
Official model page ↗
#1 by score

GPT-6.1 Sol

OpenAI
100.0mean score

SD not available · single run

Latency
138.1s
Cost
$0.080
Tokens
8,464
Retries
0.00
Official model page ↗
#8 by score

DeepSeek V4 Pro

DeepSeek
97.9mean score

SD not available · single run

Latency
196.0s
Cost
$0.011
Tokens
12,941
Retries
0.00
Official model page ↗
#9 by score

DeepSeek V4.1 Flash

DeepSeek
96.8mean score

SD not available · single run

Latency
105.4s
Cost
$0.029
Tokens
24,977
Retries
0.00
Official model page ↗
#9 by score

Gemini 3.1 Pro Preview

Google
96.8mean score

SD not available · single run

Latency
786.5s
Cost
$0.116
Tokens
10,099
Retries
1.00
Official model page ↗
#11 by score

Gemini 3.5 Flash

Google
95.1mean score

SD 4.5 · 3 retained runs

Latency
367.6s
Cost
$0.146
Tokens
16,743
Retries
0.00
Official model page ↗
#12 by score

Grok 4.5

xAI
91.6mean score

SD not available · single run

Latency
107.0s
Cost
$0.041
Tokens
7,335
Retries
0.00
Official model page ↗
#13 by score

Mistral Small 4

Mistral
91.3mean score

SD not available · single run

Latency
60.8s
Cost
$0.0072
Tokens
12,479
Retries
0.00
Official model page ↗
#14 by score

Gemma 4 31B IT

Google
82.6mean score

SD not available · single run

Latency
48.8s
Cost
$0.0000
Tokens
2,298
Retries
0.00
Official model page ↗
#15 by score

Grok 4.3

xAI
73.7mean score

SD not available · single run

Latency
50.0s
Cost
$0.015
Tokens
6,217
Retries
0.00
Official model page ↗
#16 by score

DeepSeek V4 Flash (no thinking)

DeepSeek
72.4mean score

SD not available · single run

Latency
67.2s
Cost
$0.0027
Tokens
10,058
Retries
0.00
Official model page ↗
#17 by score

OpenAI o3

OpenAI
69.5mean score

SD not available · single run

Latency
39.3s
Cost
$0.049
Tokens
6,565
Retries
0.00
Official model page ↗
#18 by score

Mistral Medium 3.5

Mistral
58.9mean score

SD not available · single run

Latency
99.8s
Cost
$0.139
Tokens
18,989
Retries
0.00
Official model page ↗
#19 by score

Claude Sonnet 4.5

Anthropic
42.1mean score

SD not available · single run

Latency
35.3s
Cost
$0.034
Tokens
2,828
Retries
0.00
Official model page ↗
#20 by score

OpenAI GPT-4.1

OpenAI
40.5mean score

SD not available · single run

Latency
37.0s
Cost
$0.023
Tokens
3,294
Retries
0.00
Official model page ↗
#21 by score

Claude Haiku 4.5

Anthropic
32.1mean score

SD not available · single run

Latency
20.3s
Cost
$0.016
Tokens
3,753
Retries
0.00
Official model page ↗
04

Criterion-level benchmark record

Scoring evidence

Dimension and criterion values are descriptive results for the 21 evaluated configuration means. N/A remains distinct from zero.

Attainment scale0%50%100%N/A = not applicable
T187.1%Understanding / modelling
T287.6%Method selection
T380.4%Development
T476.8%Final results
T575.6%Domains / assumptions
T687.3%Consistency
T786.7%Rigor
T8N/AIndependent verification
T1 through T8 attainment for each model-mode configuration
ConfigurationT120 ptsT215 ptsT320 ptsT415 ptsT510 ptsT68 ptsT77 ptsT80 pts
Claude Fable 5100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
Claude Opus 5.5100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
Claude Sonnet 5.5100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
DeepSeek V4 Flash100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
GPT-5.6 Sol100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
GPT-6 Luna100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
GPT-6.1 Sol100.0%100.0%100.0%100.0%100.0%100.0%100.0%N/A
DeepSeek V4 Pro100.0%100.0%100.0%93.3%90.0%100.0%100.0%N/A
DeepSeek V4.1 Flash100.0%100.0%85.0%100.0%100.0%100.0%100.0%N/A
Gemini 3.1 Pro Preview100.0%100.0%100.0%93.3%80.0%100.0%100.0%N/A
Gemini 3.5 Flash100.0%100.0%97.5%90.0%76.7%95.8%100.0%N/A
Grok 4.580.0%100.0%100.0%93.3%70.0%100.0%100.0%N/A
Mistral Small 4100.0%100.0%85.0%85.0%80.0%87.5%100.0%N/A
Gemma 4 31B IT100.0%86.7%92.5%63.3%60.0%68.8%85.7%N/A
Grok 4.380.0%80.0%70.0%66.7%60.0%75.0%85.7%N/A
DeepSeek V4 Flash (no thinking)80.0%85.0%70.0%60.0%50.0%75.0%85.7%N/A
OpenAI o360.0%80.0%77.5%60.0%60.0%75.0%78.6%N/A
Mistral Medium 3.565.0%43.3%67.5%60.0%45.0%87.5%35.7%N/A
Claude Sonnet 4.560.0%60.0%17.5%20.0%40.0%56.3%57.1%N/A
OpenAI GPT-4.165.0%60.0%17.5%13.3%35.0%50.0%50.0%N/A
Claude Haiku 4.540.0%45.0%8.8%13.3%40.0%62.5%42.9%N/A
05

Load on request

Retained responses and judgments

23 responses across 21 model-mode configurations. Long records load only when opened.

Interpretation boundary

Answers are reproduced as submitted. Each is paired with its authority-resolved judgment for this snapshot; this is not a general evaluation of the underlying model.

Compare two configurations All retained replicas

Select two configurations and load all their retained replicas.

Select two configurations and load all their retained replicas.

#1Claude Fable 5Anthropic · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1Claude Opus 5.5Anthropic · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1Claude Sonnet 5.5Anthropic · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1DeepSeek V4 FlashDeepSeek · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1GPT-5.6 SolOpenAI · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1GPT-6 LunaOpenAI · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#1GPT-6.1 SolOpenAI · 1 retained run · load on request100.0configuration mean+
Configuration recordOfficial model page ↗
#8DeepSeek V4 ProDeepSeek · 1 retained run · load on request97.9configuration mean+
Configuration recordOfficial model page ↗
#9DeepSeek V4.1 FlashDeepSeek · 1 retained run · load on request96.8configuration mean+
Configuration recordOfficial model page ↗
#9Gemini 3.1 Pro PreviewGoogle · 1 retained run · load on request96.8configuration mean+
Configuration recordOfficial model page ↗
#11Gemini 3.5 FlashGoogle · 3 retained runs · load on request95.1configuration mean+
Configuration recordOfficial model page ↗
#12Grok 4.5xAI · 1 retained run · load on request91.6configuration mean+
Configuration recordOfficial model page ↗
#13Mistral Small 4Mistral · 1 retained run · load on request91.3configuration mean+
Configuration recordOfficial model page ↗
#14Gemma 4 31B ITGoogle · 1 retained run · load on request82.6configuration mean+
Configuration recordOfficial model page ↗
#15Grok 4.3xAI · 1 retained run · load on request73.7configuration mean+
Configuration recordOfficial model page ↗
#16DeepSeek V4 Flash (no thinking)DeepSeek · 1 retained run · load on request72.4configuration mean+
Configuration recordOfficial model page ↗
#17OpenAI o3OpenAI · 1 retained run · load on request69.5configuration mean+
Configuration recordOfficial model page ↗
#18Mistral Medium 3.5Mistral · 1 retained run · load on request58.9configuration mean+
Configuration recordOfficial model page ↗
#19Claude Sonnet 4.5Anthropic · 1 retained run · load on request42.1configuration mean+
Configuration recordOfficial model page ↗
#20OpenAI GPT-4.1OpenAI · 1 retained run · load on request40.5configuration mean+
Configuration recordOfficial model page ↗
#21Claude Haiku 4.5Anthropic · 1 retained run · load on request32.1configuration mean+
Configuration recordOfficial model page ↗
06

Record context

About this benchmark record

The Atlas presents the exercise, rubric, results and retained responses in one interactive record.

Exercise IDA3-25-P5-E3
SubjectAnalysis III
Exam sitting2025 · Fifth sitting
Benchmark snapshot2026-10-15
Rubric version1.0
Retained responses23
How to use this page

Use the Atlas to inspect what was tested and how each configuration performed. Most configuration–exercise cells are single-run, so displayed values are descriptive rather than uncertainty estimates.