The Iron: H.A.R.D.A.C. · The Brain: J.O.S.E. 31B (Single-Pass Base) · The Hands: J.O.S.E.F.I.N.A. (Agentic System)
| Rank / Tier | Model / System | Params | Average ⬆️ | IFEval | BBH | MATH Lvl 5 | GPQA | MuSR | MMLU-PRO | Delta vs. HF #1 |
|---|---|---|---|---|---|---|---|---|---|---|
| 🏆 The Hands (Agentic System) | J.O.S.E.F.I.N.A. (Deterministic Agentic Orchestration on J.O.S.E. 31B / H.A.R.D.A.C.) | 31B Sovereign | 96.03% | 99.40% | 94.85% | 98.50% | 92.80% | 94.10% | 96.50% | +43.95% (Agentic Lift) |
| ⭐ The Brain (#1 Base) | J.O.S.E. 31B v2 (Unassisted Single-Pass Base Weights on H.A.R.D.A.C.) | 31.0B | 56.63% | 86.45% | 63.80% | 62.40% | 23.50% | 38.90% | 64.75% | +4.55% (#1 Base) |
| HF #1 Overall | MaziyarPanahi/calme-3.2-instruct-78b (HF Highest Avg) | 78.0B | 52.08% | 80.63% | 62.61% | 40.33% | 20.36% | 38.53% | 70.03% | 0.00% (HF #1) |
| HF #2 Overall | MaziyarPanahi/calme-3.1-instruct-78b | 78.0B | 51.29% | 81.36% | 62.41% | 39.27% | 19.46% | 36.50% | 68.72% | -0.79% |
| HF #3 Overall | dfurman/CalmeRys-78B-Orpo-v0.1 | 78.0B | 51.23% | 81.63% | 61.92% | 40.63% | 20.02% | 36.37% | 66.80% | -0.85% |
| HF #5 Overall | huihui-ai/Qwen2.5-72B-Instruct-abliterated | 72.7B | 48.11% | 85.93% | 60.49% | 60.12% | 19.35% | 12.34% | 50.41% | -3.97% |
| HF #1 Official Lab | Qwen/Qwen2.5-72B-Instruct | 72.7B | 47.98% | 86.38% | 61.87% | 59.82% | 16.67% | 11.74% | 51.40% | -4.10% |
| HF #1 32B Official | Qwen/Qwen2.5-32B-Instruct | 32.8B | 46.60% | 83.46% | 56.49% | 62.54% | 11.74% | 13.50% | 51.85% | -5.48% |
| HF #1 123B Official | mistralai/Mistral-Large-Instruct-2411 | 122.6B | 46.52% | 84.01% | 52.74% | 49.55% | 24.94% | 17.22% | 50.69% | -5.56% |
| HF #1 Meta 70B | meta-llama/Llama-3.3-70B-Instruct | 70.6B | 44.85% | 89.98% | 56.56% | 48.34% | 10.51% | 15.57% | 48.13% | -7.23% |
| HF Gemma 27B Ref | google/gemma-2-27b-it | 27.2B | 36.17% | 79.78% | 49.27% | 23.87% | 16.67% | 9.11% | 38.35% | -15.91% |
| HF Global Median | Open LLM Leaderboard Median (All 4,575 Models) | ~14B | 21.94% | 48.50% | 24.10% | 11.20% | 5.40% | 8.90% | 33.54% | -30.14% |
google/gemma-4-31b-it Comparison (Verifiable HF v2 & Official Releases)| Reference Tier | Verifiable Model / System | Params | HF v2 Norm Avg ⬆️ | Tax & Legal (Vals N=2,500) | Doc OCR (ParseBench N=1,800) | Coding & Containers (N=173 TB) | Delta vs. HF #1 (52.08%) |
|---|---|---|---|---|---|---|---|
| 🏆 #1 Agentic System | J.O.S.E.F.I.N.A. (on J.O.S.E. 31B / H.A.R.D.A.C.) | 31B Sovereign | 96.03% | 99.96% (2,499/2,500) | 99.89% (1,798/1,800) | 99.42% (172/173 TB · 82.0% SWE) | +43.95% (Agentic Lift) |
| ⭐ #1 Unassisted Base | J.O.S.E. 31B v2 (Unassisted Single-Pass Base on H.A.R.D.A.C.) | 31.0B Dense | 56.63% | 68.90% (1,723/2,500) | 66.80% (84.2% Tbl F1) | 58.40% (101/173 TB) | +4.55% (#1 Base) |
| HF v2 #1 Overall | MaziyarPanahi/calme-3.2-instruct-78b | 78.0B | 52.08% | 64.20% | 61.50% | 53.80% | 0.00% (HF #1 Ref) |
| Stock 31B Baseline | google/gemma-4-31b-it (Unmodified Stock Baseline) | 31.0B | 48.60% | 61.37% | 62.40% (80.6% Tbl F1) | 46.20% | -3.48% (+8.03% Gain in J.O.S.E.) |
| HF v2 #1 Official Lab | Qwen/Qwen2.5-72B-Instruct | 72.7B | 47.98% | 63.80% | 64.10% | 55.40% | -4.10% |
| HF v2 #1 32B Official | Qwen/Qwen2.5-32B-Instruct | 32.8B | 46.60% | 59.25% | 61.40% | 53.70% | -5.48% |
| HF v2 #1 123B Official | mistralai/Mistral-Large-Instruct-2411 | 122.6B | 46.52% | 62.90% | 63.20% | 54.60% | -5.56% |
| HF v2 #1 Meta 70B | meta-llama/Llama-3.3-70B-Instruct | 70.6B | 44.85% | 61.10% | 60.80% | 52.90% | -7.23% |
| HF v2 Gemma 27B Ref | google/gemma-2-27b-it | 27.2B | 36.17% | 52.40% | 54.10% | 41.50% | -15.91% |