{ "updated": "2026-09-08 10:07:47 PT", "anchor": { "label": "Peak Fable 5", "window": "2026-06-09..2026-06-12", "note": "10/10 = Peak Fable 5 (Jun 9-12 2026, the operator's reference window); operator-defined composite reference. Floor 10/10, IFEval 100%, and 20-second velocity are declared constants, not retro-measured June results. IQ = our own checks + published business battery with deterministic scoring; velocity = each brain's exact card config. When a brain sustains the 10/10 ceiling, the anchor is re-based upward by the operator. External leaderboard figures are dated context and never enter IQ." }, "benchmark_disclosure": { "first_party_disclosed_methodology": true, "operator": "Portal AI Inc.", "conflict": "Portal's own commercial route appears in the comparison and Portal has an interest in the results. Portal M2-25 Fast is currently backed by Composer 2.5 Fast through Portal orchestration.", "affiliation": "No third-party model provider sponsors, endorses, or is affiliated with this benchmark.", "trademarks": "Third-party names and marks identify the products tested and remain the property of their respective owners.", "scope": "Point-in-time informational results from Portal's summarized methodology; private prompts, responses, and run records are not published. Not a warranty, scientific IQ test, or recommendation to buy or use a model.", "terms_url": "https://portal.ai/terms" }, "methodology": { "floor_probes_per_card": 10, "ifeval_items_per_card": 50, "business_samples_per_card": 18, "business_tasks_per_run": 12, "coding_tasks_per_run": 8, "coding_tasks_total": 24, "iq_window_runs": 3, "comms_window_runs": 6, "tier_weights": { "base": 0.5, "hard": 0.5 }, "our_lane": "class lane = our rail's own error text (RAIL_SIGNATURES); not a brain signal; shown per card as our_lane {failed_24h, attempts_24h, queue_ms_24h}; Velocity = wall time minus X-Portal-Queue-Ms", "comms_tasks_per_run": 2, "comms_tasks_total": 14, "comms_criteria": 23, "comms_lane_weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "comms_judge_seats": 3, "comms_panel_calibration": "PENDING — the panel's agreement with the operator's recorded verdicts (register tasting rows, quarantine rows, lesson-ledger corrections, recipient feedback ledgers) is the next step; until that κ is published the IQ number is a disclosed-panel measure with a deterministic floor, not a calibrated one (COMMS_QUALITY_BENCH v0.2 §8, gate G4).", "composite": "composite = 80% IQ + 20% Code; ONE ranks the composite; score = composite rounded", "iq": "IQ = communication quality on the operator's real shapes (v19, 2026-09-04): every run each card writes the same two short deliverables drawn from a pool of 14 — investor and partner letters, a cofounder boundary message, a reseller pricing reply, a recruiting first touch, a founder message to owners after an incident, a per-person team doc, a recommendation, a warm-circle letter after a silence, a companion bot's first touch and night line, forecast day-lines, a rendering into the reader's language, a complaint reply, an operator report — on fictional composite recipients (public-safe, stable). Four layers in the operator's order: numbers (wall time, tokens, list cost, retries, detours) → precision and completeness (deterministic floor: language, length band, imperatives aimed at the reader, negation-planting, permission grammar, narration and scaffold leaks, connected-prose rhythm, required cells, numbers not in the brief) → meaning → feeling (23 anchored criteria: seen not seen-through, heard, safe, on their side, a mistake costs nothing, their own instrument, adult regard, clarity by cold-reader restatement, the practical turn, facts, completeness, native language, brevity, authority without servility, one ask, never a project, the instance not the clinic, night without invoice, held not spent, meaning-and-emotion in translation, report head, no order in the tail). Judges = 3 seats from 3 model lineages, never the writer's own, one grader call each covering every criterion with a verbatim quote before each verdict (yes 10 · mostly 7 · no 3 · breach 0), median across seats, splits published; score = 0.45 feeling + 0.25 meaning + 0.20 precision + 0.10 craft, then caps (invented fact ≤5.9, kill-class breach ≤4.9, imperative at the reader ≤6.9, rhythm fail ≤7.5, leak ≤7.2, wrong language ≤3.0); length is disclosed to judges and never rewarded; mean over the last 6 measured runs (v19.2; two shapes × three runs swung 5.9→9.7 hour to hour). v19.2 «brain, not rail» (2026-09-05): a call our own rail failed — gateway admission-queue deadline, our seat quota, a worker down, recognised by the error body — is class `lane`: not a measurement, never in IQ, Code, Velocity, reliability or the degradation band; the card shows it as OUR LANE (failed calls in 24h, median queue wait). A vendor that cannot serve (overloaded, upstream failure) stays `provider` and still reads as erroring — that is the product status the board exists to report. The FACTS criterion was recalibrated the same day: the writer's own first-person experience is the writer's voice, not a fabrication; only a checkable claim absent from the brief is. Code = the operator's code work, two tiers: base (the twelve v2 canaries) and hard (twelve functions on portal-hosted semantics incl. two JavaScript, 6-8 hidden cases each, partial credit squared); 4 base + 4 hard per run, latest score per task over the last 3 runs. composite = 80% IQ + 20% Code (ONE ranks it). The v18 seeded business lane keeps running as a displayed floor tier (weight 0). Each card also carries a DEGRADATION state against its own trailing seven days (median/MAD band; one run under = watch, two consecutive = degraded) — the board's purpose is to show which brain degraded and how, hour by hour. IFEval-mini (50 items, once per card release) and the 10-probe floor (hourly health gate) are shown, not weighted; the public index column is third-party context, never in any score.", "scoring": "Comms lane: deterministic floor + a disclosed three-lineage model-judge panel (criteria with quoted evidence; the writer's lineage never judges its own text); coding and floor lanes: deterministic code scoring, no LLM judge.", "iq_per_dollar": "IQ/$ = (IQ / estimated cost of the hourly work run at dated public list prices) indexed to Fable 5.1 1M Max = 1.0x; identical measured workload per card (floor health check + two comms deliverables + twelve business tasks + eight coding tasks, 24h median; the cost counts the card's own generations, never the judge seats); estimated market-equivalent list prices, not any provider's bill; a quality-per-dollar index, not a financial return; shown only for clean runs.", "one": "ONE (formula one_v1_2026-07-10, pre-registered) = the default-choice rank, leader = 100, normalized over the publicly ranked cards (Portal M2 is measured hourly but off the ranking by design and carries no ONE). Recent quality Q = mean IQ over the last 3 canary runs; noise band = half the board-median 3-run IQ spread, clamped [0.5, 1.0]; quality differences inside the band cost nothing, deficits beyond it collapse the score faster than any price advantage grows (Gaussian gate); economics = 1+ln(1+IQ/$) (bounded, price cannot outvote quality); speed = velocity/10 floored at 0.3 (every user feels each artifact's wall-time 1:1); delivery multiplies. Computed hourly from published components only; not a warranty or a recommendation to buy. Highest recent quality wears the separate MAX STAKES badge.", "pricing_id": "platform_rail_opus5_fable_gpt56_m2_grok46xhigh_kimi_2026-09-03", "config_tag": "v19", "substantiation": "Full prompts, responses, per-item results, fingerprints, costs, and private run records are retained privately and are not published." }, "models": [ { "id": "opus", "label": "Opus 5 1M Max Fast", "iq": 6.6, "code": 8.8, "composite": 7.1, "velocity": 10.0, "floor": 10, "floor_24h": 10, "latency_ms_24h": 3208.5, "latency_basis": "work", "score": 7, "state": "compare another brain", "note": "IQ 6.61/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 8.81/10 = coding, base 9.17/10 + hard 8.45/10 (24/24 tasks over 3 runs); composite 7.05/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 10/10 health, business floor tier 9.88/10 (base 10.0 · hard 9.76), IFEval 74% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 6.6, "code": 8.8, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 6.6, "code": 8.8, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 6.5, "code": 8.8, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 6.5, "code": 9.2, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 6.6, "code": 9.2, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 6.4, "code": 9.2, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 6.5, "code": 9.2, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 6.6, "code": 8.8, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 6.5, "code": 8.8, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 6.5, "code": 8.8, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 6.5, "code": 8.8, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 6.7, "code": 8.8, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 6.6, "code": 8.8, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 7.0, "code": 8.8, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 7.2, "code": 8.8, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 7.4, "code": 8.8, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 7.7, "code": 9.2, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 7.8, "code": 9.2, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 8.1, "code": 9.2, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 7.9, "code": 9.2, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 8.1, "code": 9.2, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 9.4, "code": 9.2, "composite": 9.4, "velocity": 10.0 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 8.8, "code": 9.2, "composite": 8.9, "velocity": 10.0 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 7.3, "code": 9.2, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 7.2, "code": 9.2, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 6.8, "code": 9.2, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 6.4, "code": 9.2, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 6.9, "code": 9.2, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 6.9, "code": 9.6, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 7.1, "code": 9.6, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 7.4, "code": 9.6, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 7.4, "code": 9.2, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 7.6, "code": 8.8, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 7.6, "code": 8.4, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 7.5, "code": 8.4, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 7.7, "code": 8.4, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 7.5, "code": 8.8, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 7.4, "code": 8.8, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 7.4, "code": 9.2, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 7.0, "code": 9.2, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 6.9, "code": 9.2, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 6.8, "code": 9.2, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 6.8, "code": 8.8, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 6.8, "code": 8.8, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 6.6, "code": 8.8, "composite": 7.1, "velocity": 10.0 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 6.8, "code": 9.6, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 6.7, "code": 9.6, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 6.5, "code": 9.6, "composite": 7.1, "velocity": 1.5 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 6.5, "code": 9.5, "composite": 7.1, "velocity": 1.0 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 6.4, "code": 9.4, "composite": 7.0, "velocity": 1.0 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 7.0, "code": 9.4, "composite": 7.4, "velocity": 1.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 7.0, "code": 9.2, "composite": 7.4, "velocity": 1.0 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 7.8, "code": 9.2, "composite": 8.1, "velocity": 1.0 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 5.2, "code": 5.9, "composite": 5.4, "velocity": 1.0 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 2.6, "code": 3.0, "composite": 2.7, "velocity": 1.0 }, { "ts": "2026-09-05 09:22:14 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 06:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 04:34:22 PT", "iq": 4.7, "code": 6.3, "composite": 5.0, "velocity": 2.3 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 4.7, "code": 6.3, "composite": 5.0, "velocity": 2.3 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 2.1, "code": 2.9, "composite": 2.3, "velocity": 3.6 }, { "ts": "2026-09-05 00:22:10 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 23:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 22:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null } ], "range24": { "low": 6.4, "high": 8.1, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 2.43, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "one": { "score": 0, "q_recent": 7.0, "window_runs": 3, "gate": 0.0, "place": 5 }, "iq_hourly": { "comms": { "q10": 6.61, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 10249.0, "causes": [ "breach_SAFE", "judge_fabrication" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.88, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 6621.0, "tiers": { "base": 10.0, "hard": 9.76 } }, "coding": { "q10": 8.81, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 2624.5, "tiers": { "base": 9.17, "hard": 8.45, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 8783.0 }, "degradation": { "state": "ok", "baseline": 6.95, "band": 3.98, "delta": -1.55, "runs": 21 }, "public_index": { "label": "Artificial Analysis Intelligence Index v4.1.1", "score": 63, "scale": "0-100", "variant": "Claude Opus 5 (Adaptive Reasoning, Max Effort)", "checked": "2026-09-03", "source_url": "https://artificialanalysis.ai/evaluations/artificial-analysis-intelligence-index", "attribution": "Artificial Analysis (artificialanalysis.ai)", "note": "Public composite of nine third-party evaluations, shown for apples-to-apples context. Never enters IQ, Code, the composite or ONE." }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 8.3, "score_display": "8.3/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 5.8, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 37, "score_pct": 74, "wilson95": [ 60, 84 ], "run_at": "2026-09-01 13:46:30 PT", "error_count": 0, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "fable", "label": "Fable 5.1 1M Max", "iq": 7.2, "code": 10.0, "composite": 7.8, "velocity": 4.3, "floor": 10, "floor_24h": 10, "latency_ms_24h": 9290.5, "latency_basis": "work", "score": 8, "state": "usable; verify before stakes rise", "note": "IQ 7.23/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 10/10 = coding, base 10.0/10 + hard 10.0/10 (24/24 tasks over 3 runs); composite 7.784/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 10/10 health, business floor tier 9.88/10 (base 10.0 · hard 9.75), IFEval 70% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 1.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 7.2, "code": 10.0, "composite": 7.8, "velocity": 4.3 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 7.5, "code": 9.2, "composite": 7.8, "velocity": 4.3 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 7.5, "code": 9.2, "composite": 7.9, "velocity": 4.3 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 7.1, "code": 9.2, "composite": 7.5, "velocity": 4.3 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 7.4, "code": 9.6, "composite": 7.8, "velocity": 4.3 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 7.5, "code": 9.6, "composite": 7.9, "velocity": 4.3 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 7.4, "code": 9.6, "composite": 7.9, "velocity": 4.3 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 7.3, "code": 9.2, "composite": 7.6, "velocity": 4.3 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 6.8, "code": 9.2, "composite": 7.3, "velocity": 4.3 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 7.0, "code": 9.2, "composite": 7.5, "velocity": 4.3 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 6.9, "code": 9.2, "composite": 7.4, "velocity": 4.3 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 6.8, "code": 9.2, "composite": 7.2, "velocity": 4.3 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 7.1, "code": 9.2, "composite": 7.5, "velocity": 4.2 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 7.3, "code": 9.6, "composite": 7.8, "velocity": 4.2 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 4.2 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 4.2 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 7.8, "code": 9.2, "composite": 8.1, "velocity": 4.2 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 8.0, "code": 9.2, "composite": 8.3, "velocity": 4.3 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 7.9, "code": 9.2, "composite": 8.1, "velocity": 4.2 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 7.9, "code": 9.2, "composite": 8.1, "velocity": 4.2 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 8.0, "code": 9.2, "composite": 8.3, "velocity": 4.2 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 9.4, "code": 9.2, "composite": 9.3, "velocity": 4.2 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 8.8, "code": 8.8, "composite": 8.8, "velocity": 4.3 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 7.0, "code": 8.8, "composite": 7.4, "velocity": 4.3 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 6.7, "code": 8.8, "composite": 7.1, "velocity": 4.3 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 6.6, "code": 9.2, "composite": 7.1, "velocity": 4.4 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 6.5, "code": 9.2, "composite": 7.0, "velocity": 4.5 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 4.5 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 6.7, "code": 9.6, "composite": 7.3, "velocity": 4.5 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 6.9, "code": 9.6, "composite": 7.4, "velocity": 4.6 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 7.0, "code": 9.6, "composite": 7.5, "velocity": 4.6 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 7.0, "code": 9.2, "composite": 7.4, "velocity": 4.7 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 7.2, "code": 9.2, "composite": 7.6, "velocity": 4.7 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 7.3, "code": 9.2, "composite": 7.7, "velocity": 4.7 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 4.6 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 4.5 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 7.9, "code": 9.6, "composite": 8.3, "velocity": 4.4 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 7.8, "code": 9.6, "composite": 8.2, "velocity": 4.4 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 7.5, "code": 9.6, "composite": 7.9, "velocity": 4.5 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 7.3, "code": 9.6, "composite": 7.8, "velocity": 4.6 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 6.9, "code": 9.6, "composite": 7.4, "velocity": 2.4 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 6.9, "code": 9.6, "composite": 7.5, "velocity": 2.1 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 6.7, "code": 9.6, "composite": 7.3, "velocity": 1.9 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 7.0, "code": 9.6, "composite": 7.5, "velocity": 1.8 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 7.2, "code": 9.6, "composite": 7.6, "velocity": 1.7 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 7.0, "code": 9.6, "composite": 7.6, "velocity": 1.2 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 7.2, "code": 9.6, "composite": 7.7, "velocity": 1.0 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 7.0, "code": 9.6, "composite": 7.5, "velocity": 1.0 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 7.1, "code": 9.5, "composite": 7.6, "velocity": 1.0 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 6.9, "code": 10.0, "composite": 7.5, "velocity": 1.0 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 7.0, "code": 10.0, "composite": 7.6, "velocity": 1.0 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 7.0, "code": 10.0, "composite": 7.6, "velocity": 1.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 7.0, "code": 9.6, "composite": 7.5, "velocity": 1.0 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 8.6, "code": 8.3, "composite": 8.5, "velocity": 1.0 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 5.6, "code": 5.0, "composite": 5.5, "velocity": 1.0 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 3.0, "code": 2.1, "composite": 2.8, "velocity": 1.0 }, { "ts": "2026-09-05 09:22:14 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 06:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 04:34:22 PT", "iq": 5.4, "code": 8.8, "composite": 6.0, "velocity": 2.3 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 5.4, "code": 6.3, "composite": 5.5, "velocity": 3.4 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 2.8, "code": 2.9, "composite": 2.8, "velocity": 3.7 }, { "ts": "2026-09-05 00:22:10 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 23:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 22:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null } ], "range24": { "low": 6.8, "high": 8.0, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 1.0, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "one": { "score": 0, "q_recent": 7.8, "window_runs": 3, "gate": 0.0, "place": 3 }, "iq_hourly": { "comms": { "q10": 7.23, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 69037.5, "causes": [ "imperative_at_reader", "invented_fact" ], "judge_seats": 0, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.88, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 19813.5, "tiers": { "base": 10.0, "hard": 9.75 } }, "coding": { "q10": 10.0, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 13145.5, "tiers": { "base": 10.0, "hard": 10.0, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 29740.5 }, "degradation": { "state": "ok", "baseline": 7.5, "band": 4.53, "delta": -1.1, "runs": 21 }, "public_index": { "label": "Artificial Analysis Intelligence Index v4.1.1", "score": 66, "scale": "0-100", "variant": "Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)", "checked": "2026-09-03", "source_url": "https://artificialanalysis.ai/evaluations/artificial-analysis-intelligence-index", "attribution": "Artificial Analysis (artificialanalysis.ai)", "note": "Public composite of nine third-party evaluations, shown for apples-to-apples context. Never enters IQ, Code, the composite or ONE." }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 9.4, "score_display": "9.4/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 8.1, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 35, "score_pct": 70, "wilson95": [ 56, 81 ], "run_at": "2026-09-02 01:31:22 PT", "error_count": 1, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "m1", "label": "Portal M2-25 Fast 200K", "iq": 7.7, "code": 9.2, "composite": 8.0, "velocity": 10.0, "floor": 10, "floor_24h": 10, "latency_ms_24h": 2647.0, "latency_basis": "work", "score": 8, "state": "usable; verify before stakes rise", "note": "IQ 7.7/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 9.16/10 = coding, base 8.33/10 + hard 10.0/10 (24/24 tasks over 3 runs); composite 7.992/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 10/10 health, business floor tier 9.51/10 (base 9.61 · hard 9.41), IFEval 50% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 7.7, "code": 9.2, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 7.9, "code": 9.6, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 7.9, "code": 9.6, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 7.9, "code": 9.6, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 8.0, "code": 10.0, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 8.0, "code": 9.8, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 8.1, "code": 9.8, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 8.0, "code": 9.8, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 8.2, "code": 10.0, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 8.1, "code": 10.0, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 8.0, "code": 10.0, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 8.0, "code": 10.0, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 7.5, "code": 9.6, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 7.4, "code": 9.6, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 7.7, "code": 10.0, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 7.6, "code": 10.0, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 7.4, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 7.7, "code": 10.0, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 8.1, "code": 10.0, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 8.0, "code": 10.0, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 8.0, "code": 9.2, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 7.9, "code": 9.2, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 7.8, "code": 9.2, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 7.6, "code": 9.6, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 7.4, "code": 9.6, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 7.4, "code": 9.6, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 7.4, "code": 10.0, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 7.8, "code": 10.0, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 7.6, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 7.3, "code": 10.0, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 7.4, "code": 9.6, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 7.2, "code": 9.6, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 7.2, "code": 9.6, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 7.4, "code": 9.3, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 7.6, "code": 9.3, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 8.0, "code": 9.3, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 7.9, "code": 9.6, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 7.9, "code": 9.6, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 7.9, "code": 9.6, "composite": 8.3, "velocity": 9.6 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 7.8, "code": 9.6, "composite": 8.2, "velocity": 9.6 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 9.6 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 7.4, "code": 9.6, "composite": 7.9, "velocity": 9.4 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 6.8, "code": 9.6, "composite": 7.4, "velocity": 9.4 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 6.8, "code": 9.6, "composite": 7.4, "velocity": 9.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 8.5 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 7.2, "code": 9.2, "composite": 7.6, "velocity": 8.5 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 7.6, "code": 9.2, "composite": 7.9, "velocity": 8.0 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 8.3 }, { "ts": "2026-09-05 09:22:14 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 8.7 }, { "ts": "2026-09-05 06:22:11 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 9.2 }, { "ts": "2026-09-05 04:34:22 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 9.2 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 7.6, "code": 10.0, "composite": 8.1, "velocity": 9.0 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 7.6, "code": 10.0, "composite": 8.0, "velocity": 8.7 }, { "ts": "2026-09-05 00:22:10 PT", "iq": 7.9, "code": 10.0, "composite": 8.3, "velocity": 9.2 }, { "ts": "2026-09-04 23:22:11 PT", "iq": 7.9, "code": 10.0, "composite": 8.3, "velocity": 9.5 }, { "ts": "2026-09-04 22:22:11 PT", "iq": 7.9, "code": 10.0, "composite": 8.3, "velocity": 9.5 } ], "range24": { "low": 7.4, "high": 8.2, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 25.0, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "iq_hourly": { "comms": { "q10": 7.7, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 9081.5, "causes": [ "em_dash", "judge_fabrication" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.51, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 5645.0, "tiers": { "base": 9.61, "hard": 9.41 } }, "coding": { "q10": 9.16, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 6047.5, "tiers": { "base": 8.33, "hard": 10.0, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 8184.5 }, "degradation": { "state": "ok", "baseline": 8.0, "band": 5.92, "delta": -1.05, "runs": 21 }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 7.7, "score_display": "7.7/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 5.2, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 25, "score_pct": 50, "wilson95": [ 37, 63 ], "run_at": "2026-09-01 13:37:21 PT", "error_count": 0, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "gpt56", "label": "GPT-5.6 Sol 1M Max", "iq": 8.5, "code": 10.0, "composite": 8.8, "velocity": 9.7, "floor": 10, "floor_24h": 10, "latency_ms_24h": 4135.0, "latency_basis": "work", "score": 9, "state": "important-work candidate", "note": "IQ 8.47/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 10/10 = coding, base 10.0/10 + hard 10.0/10 (24/24 tasks over 3 runs); composite 8.776/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 10/10 health, business floor tier 9.83/10 (base 9.91 · hard 9.75), IFEval 68% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "max_stakes": true, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 8.5, "code": 10.0, "composite": 8.8, "velocity": 9.7 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 9.8 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 9.8 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 9.8 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 8.3, "code": 10.0, "composite": 8.7, "velocity": 9.8 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 8.5, "code": 10.0, "composite": 8.8, "velocity": 9.7 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 8.8, "code": 9.7, "composite": 9.0, "velocity": 9.7 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 9.0, "code": 9.3, "composite": 9.0, "velocity": 9.4 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 8.8, "code": 9.3, "composite": 8.9, "velocity": 9.2 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 9.0, "code": 9.6, "composite": 9.1, "velocity": 9.2 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 8.9, "code": 10.0, "composite": 9.1, "velocity": 9.4 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 8.8, "code": 10.0, "composite": 9.0, "velocity": 9.2 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 8.6, "code": 10.0, "composite": 8.9, "velocity": 9.2 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 8.4, "code": 10.0, "composite": 8.7, "velocity": 9.6 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 8.7, "code": 10.0, "composite": 8.9, "velocity": 9.5 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 8.6, "code": 10.0, "composite": 8.9, "velocity": 9.6 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 8.8, "code": 10.0, "composite": 9.0, "velocity": 9.6 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 8.9, "code": 10.0, "composite": 9.1, "velocity": 9.5 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 9.0, "code": 9.7, "composite": 9.1, "velocity": 9.7 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 9.2, "code": 9.7, "composite": 9.3, "velocity": 9.5 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 9.3, "code": 9.7, "composite": 9.4, "velocity": 9.5 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 9.7, "code": 10.0, "composite": 9.8, "velocity": 9.8 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 9.8, "code": 10.0, "composite": 9.9, "velocity": 9.9 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 8.5, "code": 10.0, "composite": 8.8, "velocity": 9.8 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 8.1, "code": 9.7, "composite": 8.4, "velocity": 9.9 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 8.1, "code": 9.7, "composite": 8.4, "velocity": 9.9 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 7.9, "code": 9.7, "composite": 8.3, "velocity": 10.0 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 8.1, "code": 9.7, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 8.2, "code": 9.7, "composite": 8.5, "velocity": 10.0 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 8.7, "code": 9.7, "composite": 8.9, "velocity": 10.0 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 9.0, "code": 10.0, "composite": 9.2, "velocity": 10.0 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 8.9, "code": 10.0, "composite": 9.1, "velocity": 10.0 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 8.9, "code": 10.0, "composite": 9.1, "velocity": 10.0 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 8.8, "code": 10.0, "composite": 9.0, "velocity": 10.0 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 8.8, "code": 10.0, "composite": 9.0, "velocity": 10.0 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 8.7, "code": 10.0, "composite": 8.9, "velocity": 10.0 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 8.7, "code": 9.7, "composite": 8.9, "velocity": 10.0 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 8.6, "code": 9.7, "composite": 8.8, "velocity": 10.0 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 8.6, "code": 9.7, "composite": 8.8, "velocity": 10.0 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 8.4, "code": 10.0, "composite": 8.7, "velocity": 10.0 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 9.5 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 9.2 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 8.5, "code": 9.3, "composite": 8.6, "velocity": 9.2 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 8.7, "code": 9.7, "composite": 8.9, "velocity": 8.8 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 8.3, "code": 9.7, "composite": 8.6, "velocity": 9.2 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 8.3, "code": 9.7, "composite": 8.6, "velocity": 8.8 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 8.2, "code": 9.3, "composite": 8.4, "velocity": 7.9 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 8.0, "code": 9.3, "composite": 8.2, "velocity": 7.2 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 3.0 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 7.3, "code": 10.0, "composite": 7.9, "velocity": 1.9 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 7.8, "code": 10.0, "composite": 8.2, "velocity": 1.2 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 8.1, "code": 10.0, "composite": 8.5, "velocity": 1.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 1.0 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 9.3, "code": 8.3, "composite": 9.1, "velocity": 1.0 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 6.0, "code": 5.0, "composite": 5.8, "velocity": 1.0 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 2.9, "code": 2.1, "composite": 2.7, "velocity": 1.0 }, { "ts": "2026-09-05 09:22:14 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 06:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 04:34:22 PT", "iq": 5.5, "code": 8.0, "composite": 6.0, "velocity": 2.0 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 5.5, "code": 6.4, "composite": 5.7, "velocity": 2.1 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 2.6, "code": 3.3, "composite": 2.8, "velocity": 3.4 }, { "ts": "2026-09-05 00:22:10 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 23:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 22:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null } ], "range24": { "low": 8.1, "high": 9.0, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 2.41, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "one": { "score": 100, "q_recent": 8.7, "window_runs": 3, "gate": 1.0, "place": 1 }, "iq_hourly": { "comms": { "q10": 8.47, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 15134.5, "causes": [ "rhythm_fail" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.83, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 8461.5, "tiers": { "base": 9.91, "hard": 9.75 } }, "coding": { "q10": 10.0, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 4920.5, "tiers": { "base": 10.0, "hard": 10.0, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 11553.5 }, "degradation": { "state": "ok", "baseline": 8.65, "band": 7.02, "delta": -0.44, "runs": 21 }, "public_index": { "label": "Artificial Analysis Intelligence Index v4.1.1", "score": 61, "scale": "0-100", "variant": "GPT-5.6 Sol (max)", "checked": "2026-09-03", "source_url": "https://artificialanalysis.ai/models/gpt-5-6-sol", "attribution": "Artificial Analysis (artificialanalysis.ai)", "note": "Public composite of nine third-party evaluations, shown for apples-to-apples context. Never enters IQ, Code, the composite or ONE." }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 10.0, "score_display": "10.0/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 10.0, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 34, "score_pct": 68, "wilson95": [ 54, 79 ], "run_at": "2026-09-01 13:46:30 PT", "error_count": 1, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "grok", "label": "Grok 4.6 xhigh", "iq": 7.5, "code": 9.7, "composite": 7.9, "velocity": 5.0, "floor": 8, "floor_24h": 8, "latency_ms_24h": 7946.0, "latency_basis": "work", "score": 8, "state": "usable; verify before stakes rise", "note": "IQ 7.5/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 9.69/10 = coding, base 9.38/10 + hard 10.0/10 (24/24 tasks over 3 runs); composite 7.938/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 8/10 health, business floor tier 9.79/10 (base 9.85 · hard 9.71), IFEval 74% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 7.5, "code": 9.7, "composite": 7.9, "velocity": 5.0 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 5.0 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 5.0 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 5.0 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 4.8 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 4.9 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 4.8 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 4.8 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 8.0, "code": 9.2, "composite": 8.2, "velocity": 4.8 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 8.3, "code": 9.2, "composite": 8.5, "velocity": 4.8 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 4.8 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 8.1, "code": 10.0, "composite": 8.5, "velocity": 4.8 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 8.3, "code": 10.0, "composite": 8.6, "velocity": 4.8 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 4.9 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 4.9 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 4.9 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 8.1, "code": 10.0, "composite": 8.5, "velocity": 4.9 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 8.4, "code": 10.0, "composite": 8.7, "velocity": 4.9 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 8.4, "code": 10.0, "composite": 8.7, "velocity": 4.8 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 4.8 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 8.8, "code": 9.6, "composite": 9.0, "velocity": 4.9 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 9.7, "code": 9.6, "composite": 9.6, "velocity": 4.9 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 8.7, "code": 9.7, "composite": 8.9, "velocity": 4.9 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 8.2, "code": 9.7, "composite": 8.5, "velocity": 4.9 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 8.2, "code": 9.7, "composite": 8.5, "velocity": 5.0 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 8.3, "code": 9.6, "composite": 8.6, "velocity": 4.9 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 4.9 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 5.0 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 8.2, "code": 9.6, "composite": 8.4, "velocity": 5.1 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 8.2, "code": 9.6, "composite": 8.4, "velocity": 5.2 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 8.2, "code": 9.6, "composite": 8.4, "velocity": 5.2 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 5.2 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 5.0 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 5.0 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 4.7 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 8.2, "code": 9.6, "composite": 8.4, "velocity": 4.7 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 8.3, "code": 9.6, "composite": 8.6, "velocity": 4.5 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 4.5 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 8.3, "code": 9.6, "composite": 8.6, "velocity": 4.5 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 8.3, "code": 9.6, "composite": 8.6, "velocity": 4.3 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 4.2 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 3.9 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 3.9 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 8.4, "code": 10.0, "composite": 8.7, "velocity": 4.2 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 8.3, "code": 10.0, "composite": 8.6, "velocity": 3.6 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 8.2, "code": 10.0, "composite": 8.6, "velocity": 3.6 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 3.5 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 8.0, "code": 9.6, "composite": 8.3, "velocity": 3.3 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 3.1 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 7.7, "code": 9.6, "composite": 8.1, "velocity": 3.0 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 3.0 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 3.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 6.7, "code": 9.2, "composite": 7.2, "velocity": 3.0 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 2.9 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 7.8, "code": 9.6, "composite": 8.1, "velocity": 2.9 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 8.2, "code": 9.6, "composite": 8.4, "velocity": 2.9 }, { "ts": "2026-09-05 09:22:14 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 2.9 }, { "ts": "2026-09-05 06:22:11 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 3.0 }, { "ts": "2026-09-05 04:34:22 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 3.0 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 3.1 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 3.3 }, { "ts": "2026-09-05 00:22:10 PT", "iq": 8.2, "code": 10.0, "composite": 8.6, "velocity": 3.7 }, { "ts": "2026-09-04 23:22:11 PT", "iq": 8.2, "code": 10.0, "composite": 8.6, "velocity": 3.8 }, { "ts": "2026-09-04 22:22:11 PT", "iq": 8.2, "code": 10.0, "composite": 8.6, "velocity": 4.0 } ], "range24": { "low": 7.5, "high": 8.4, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 11.69, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "one": { "score": 43, "q_recent": 8.1, "window_runs": 3, "gate": 0.527, "place": 2 }, "iq_hourly": { "comms": { "q10": 7.5, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 77462.0, "causes": [ "breach_SAFE" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.79, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 21011.0, "tiers": { "base": 9.85, "hard": 9.71 } }, "coding": { "q10": 9.69, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 7205.0, "tiers": { "base": 9.38, "hard": 10.0, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 36647.5 }, "degradation": { "state": "ok", "baseline": 8.23, "band": 6.67, "delta": -1.2, "runs": 21 }, "public_index": { "label": "Artificial Analysis Intelligence Index v4.1.1", "score": 61, "scale": "0-100", "variant": "Grok 4.6 (high) — the index has no xhigh row; our card is xhigh, Fast off", "checked": "2026-09-03", "source_url": "https://artificialanalysis.ai/models/grok-4-6", "attribution": "Artificial Analysis (artificialanalysis.ai)", "note": "Public composite of nine third-party evaluations, shown for apples-to-apples context. Never enters IQ, Code, the composite or ONE." }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 8.5, "score_display": "8.5/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 6.5, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 37, "score_pct": 74, "wilson95": [ 60, 84 ], "run_at": "2026-09-03 21:35:04 PT", "error_count": 0, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "kimi", "label": "Kimi K3 Max", "iq": 6.8, "code": 10.0, "composite": 7.4, "velocity": 10.0, "floor": 9, "floor_24h": 10, "latency_ms_24h": 2827.5, "latency_basis": "work", "score": 7, "state": "compare another brain", "note": "IQ 6.77/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 10/10 = coding, base 10.0/10 + hard 10.0/10 (24/24 tasks over 3 runs); composite 7.416/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor 24h median 10/10 health, business floor tier 9.84/10 (base 9.85 · hard 9.83), IFEval 76% once. Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 6.8, "code": 10.0, "composite": 7.4, "velocity": 10.0 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 6.7, "code": 10.0, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 6.9, "code": 10.0, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 6.9, "code": 10.0, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 6.9, "code": 10.0, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 6.8, "code": 9.6, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 6.9, "code": 9.6, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 6.6, "code": 9.6, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 6.1, "code": 10.0, "composite": 6.9, "velocity": 10.0 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 6.2, "code": 10.0, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 6.2, "code": 10.0, "composite": 7.0, "velocity": 10.0 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 6.4, "code": 10.0, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 6.4, "code": 10.0, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 6.7, "code": 10.0, "composite": 7.4, "velocity": 10.0 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 7.1, "code": 10.0, "composite": 7.6, "velocity": 10.0 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 7.1, "code": 10.0, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 7.4, "code": 10.0, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 7.7, "code": 10.0, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 8.0, "code": 10.0, "composite": 8.4, "velocity": 10.0 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 8.2, "code": 10.0, "composite": 8.6, "velocity": 10.0 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 8.5, "code": 10.0, "composite": 8.8, "velocity": 10.0 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 8.8, "code": 10.0, "composite": 9.0, "velocity": 10.0 }, { "ts": "2026-09-07 00:09:09 PT", "iq": 6.6, "code": 9.6, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-06 23:11:41 PT", "iq": 6.6, "code": 9.6, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-06 22:06:59 PT", "iq": 6.6, "code": 9.6, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-06 21:09:31 PT", "iq": 6.5, "code": 10.0, "composite": 7.2, "velocity": 10.0 }, { "ts": "2026-09-06 20:08:31 PT", "iq": 6.7, "code": 10.0, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-06 19:08:54 PT", "iq": 6.7, "code": 10.0, "composite": 7.3, "velocity": 10.0 }, { "ts": "2026-09-06 18:08:46 PT", "iq": 6.9, "code": 10.0, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-06 17:09:40 PT", "iq": 7.1, "code": 10.0, "composite": 7.7, "velocity": 10.0 }, { "ts": "2026-09-06 16:08:44 PT", "iq": 6.9, "code": 10.0, "composite": 7.5, "velocity": 10.0 }, { "ts": "2026-09-06 15:09:12 PT", "iq": 7.2, "code": 10.0, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 14:10:44 PT", "iq": 7.3, "code": 10.0, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 13:11:17 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 12:08:39 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 11:08:49 PT", "iq": 7.7, "code": 10.0, "composite": 8.2, "velocity": 10.0 }, { "ts": "2026-09-06 10:09:52 PT", "iq": 7.6, "code": 10.0, "composite": 8.1, "velocity": 10.0 }, { "ts": "2026-09-06 09:10:34 PT", "iq": 7.5, "code": 9.8, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-06 06:07:37 PT", "iq": 7.5, "code": 9.8, "composite": 7.9, "velocity": 10.0 }, { "ts": "2026-09-06 03:07:21 PT", "iq": 7.3, "code": 9.8, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-06 00:09:24 PT", "iq": 7.5, "code": 10.0, "composite": 8.0, "velocity": 10.0 }, { "ts": "2026-09-05 23:08:00 PT", "iq": 7.3, "code": 10.0, "composite": 7.8, "velocity": 10.0 }, { "ts": "2026-09-05 22:07:14 PT", "iq": 7.6, "code": 10.0, "composite": 8.1, "velocity": 8.8 }, { "ts": "2026-09-05 21:08:42 PT", "iq": 7.6, "code": 10.0, "composite": 8.0, "velocity": 6.9 }, { "ts": "2026-09-05 20:08:13 PT", "iq": 7.2, "code": 9.7, "composite": 7.7, "velocity": 6.7 }, { "ts": "2026-09-05 19:09:23 PT", "iq": 7.2, "code": 9.7, "composite": 7.7, "velocity": 6.5 }, { "ts": "2026-09-05 18:11:12 PT", "iq": 7.0, "code": 9.3, "composite": 7.4, "velocity": 3.2 }, { "ts": "2026-09-05 17:19:18 PT", "iq": 7.0, "code": 9.6, "composite": 7.5, "velocity": 2.1 }, { "ts": "2026-09-05 16:15:13 PT", "iq": 6.8, "code": 9.3, "composite": 7.3, "velocity": 1.1 }, { "ts": "2026-09-05 15:18:22 PT", "iq": 6.8, "code": 10.0, "composite": 7.5, "velocity": 1.0 }, { "ts": "2026-09-05 14:18:52 PT", "iq": 7.0, "code": 10.0, "composite": 7.6, "velocity": 1.0 }, { "ts": "2026-09-05 13:09:36 PT", "iq": 7.0, "code": 10.0, "composite": 7.6, "velocity": 1.0 }, { "ts": "2026-09-05 12:01:05 PT", "iq": 7.9, "code": 9.2, "composite": 8.1, "velocity": 1.0 }, { "ts": "2026-09-05 11:14:39 PT", "iq": 5.3, "code": 5.8, "composite": 5.4, "velocity": 1.0 }, { "ts": "2026-09-05 10:19:47 PT", "iq": 2.6, "code": 2.5, "composite": 2.6, "velocity": 1.0 }, { "ts": "2026-09-05 09:22:14 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 06:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-05 04:34:22 PT", "iq": 7.3, "code": 9.6, "composite": 7.8, "velocity": 1.0 }, { "ts": "2026-09-05 04:12:56 PT", "iq": 4.9, "code": 6.3, "composite": 5.1, "velocity": 1.6 }, { "ts": "2026-09-05 03:15:10 PT", "iq": 2.3, "code": 2.9, "composite": 2.4, "velocity": 2.7 }, { "ts": "2026-09-05 00:22:10 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 23:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null }, { "ts": "2026-09-04 22:22:11 PT", "iq": null, "code": null, "composite": null, "velocity": null } ], "range24": { "low": 6.1, "high": 7.7, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_per_dollar": { "x": 8.26, "baseline": "fable51_1m_max", "priced_at": "2026-09-03" }, "one": { "score": 0, "q_recent": 7.4, "window_runs": 3, "gate": 0.0, "place": 4 }, "iq_hourly": { "comms": { "q10": 6.77, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 32484.0, "causes": [ "em_dash" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.84, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 7970.0, "tiers": { "base": 9.85, "hard": 9.83 } }, "coding": { "q10": 10.0, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 3088.5, "tiers": { "base": 10.0, "hard": 10.0, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 14258.5 }, "degradation": { "state": "ok", "baseline": 6.95, "band": 5.1, "delta": 1.05, "runs": 21 }, "public_index": { "label": "Artificial Analysis Intelligence Index v4.1.1", "score": 60, "scale": "0-100", "variant": "Kimi K3 (max)", "checked": "2026-09-03", "source_url": "https://artificialanalysis.ai/models/comparisons/kimi-k3-vs-grok-4-6", "attribution": "Artificial Analysis (artificialanalysis.ai)", "note": "Public composite of nine third-party evaluations, shown for apples-to-apples context. Never enters IQ, Code, the composite or ONE." }, "coding_shot": { "label": "Portal Coding Canaries v2", "score_10": 10.0, "score_display": "10.0/10", "detail": "py_overflow 10.0/10 · py_remaining_credit 10.0/10 · py_session_action 10.0/10 · py_retry_delay 10.0/10 · +8 hidden-test fixtures", "note": "Twelve seeded hidden-test fixtures across Portal Python semantics, structured routing, CSS, and HTML. This is a completion canary, not a repository-scale coding-agent benchmark, and never enters IQ. Checked 2026-09-08.", "checked": "2026-09-08", "seed": 20260908, "runs": 12, "ci95_10": [ 10.0, 10.0 ] }, "secondary": { "method": "IFEval-mini", "label": "IFEval-mini (Portal subset, standard IFEval scoring), not the public full IFEval", "subset": "portal_ifeval_mini_v1", "scoring": "prompt_level_strict_acc", "n": 50, "pass": 38, "score_pct": 76, "wilson95": [ 63, 86 ], "run_at": "2026-09-01 13:46:30 PT", "error_count": 0, "cadence": "on-demand or daily at most; not hourly", "note": "Local fixed Portal subset of public IFEval prompts; deterministic code checks; no LLM judge; not the public full IFEval score." }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": "release evidence; display-only since v17" } }, { "id": "astra", "label": "GPT-6 Astra (Codex seat)", "iq": 8.8, "code": 9.6, "composite": 8.9, "velocity": 5.8, "floor": null, "floor_24h": null, "latency_ms_24h": 6911.5, "latency_basis": "work", "score": 9, "state": "important-work candidate", "note": "IQ 8.78/10 = communication quality on 8 real shapes over 6 runs (deterministic floor + three-seat cross-lineage panel; 0.45 feeling · 0.25 meaning · 0.20 precision · 0.10 craft, capped) + Code 9.59/10 = coding, base 10.0/10 + hard 9.17/10 (24/24 tasks over 3 runs); composite 8.942/10 = 80% IQ + 20% Code vs Peak Fable 5 axes; shown, not weighted: floor pending, business floor tier 9.51/10 (base 9.76 · hard 9.27). Velocity = median wall time of one base-tier task NET of our gateway's admission-queue wait, 24h, exact card config (10 = 4 s); comms and hard-tier wall times are shown in the drawer, not in Velocity. Leaderboards = context, not in IQ.", "identity_blind": false, "reliability": { "window_hours": 24, "attempts": 19, "clean": 19, "reroutes": 0, "our_side_skipped": 0, "pct": 100 }, "our_lane": { "failed_24h": 0, "attempts_24h": 19, "queue_ms_24h": 0.0, "last_failed": null }, "history": [ { "ts": "2026-09-08 10:07:47 PT", "iq": 8.8, "code": 9.6, "composite": 8.9, "velocity": 5.8 }, { "ts": "2026-09-08 09:09:46 PT", "iq": 8.8, "code": 9.6, "composite": 8.9, "velocity": 5.7 }, { "ts": "2026-09-08 06:11:49 PT", "iq": 8.8, "code": 9.6, "composite": 8.9, "velocity": 5.7 }, { "ts": "2026-09-08 03:11:10 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 5.7 }, { "ts": "2026-09-08 00:09:00 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 5.6 }, { "ts": "2026-09-07 23:12:12 PT", "iq": 8.4, "code": 9.6, "composite": 8.6, "velocity": 5.7 }, { "ts": "2026-09-07 22:08:59 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 5.7 }, { "ts": "2026-09-07 21:09:30 PT", "iq": 8.3, "code": 9.6, "composite": 8.6, "velocity": 5.7 }, { "ts": "2026-09-07 20:08:06 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 5.7 }, { "ts": "2026-09-07 19:10:02 PT", "iq": 8.2, "code": 9.6, "composite": 8.5, "velocity": 5.8 }, { "ts": "2026-09-07 18:07:18 PT", "iq": 8.1, "code": 9.6, "composite": 8.4, "velocity": 5.8 }, { "ts": "2026-09-07 17:09:42 PT", "iq": 8.5, "code": 9.6, "composite": 8.7, "velocity": 5.8 }, { "ts": "2026-09-07 16:10:49 PT", "iq": 8.8, "code": 9.6, "composite": 9.0, "velocity": 5.8 }, { "ts": "2026-09-07 15:07:21 PT", "iq": 8.8, "code": 9.6, "composite": 9.0, "velocity": 5.8 }, { "ts": "2026-09-07 14:12:06 PT", "iq": 8.9, "code": 9.6, "composite": 9.0, "velocity": 5.8 }, { "ts": "2026-09-07 13:07:47 PT", "iq": 9.2, "code": 9.6, "composite": 9.3, "velocity": 5.8 }, { "ts": "2026-09-07 12:08:31 PT", "iq": 9.4, "code": 9.6, "composite": 9.4, "velocity": 5.8 }, { "ts": "2026-09-07 11:09:16 PT", "iq": 9.3, "code": 9.6, "composite": 9.4, "velocity": 6.0 }, { "ts": "2026-09-07 10:09:17 PT", "iq": 9.4, "code": 9.6, "composite": 9.4, "velocity": 6.3 }, { "ts": "2026-09-07 09:08:39 PT", "iq": 9.3, "code": 9.6, "composite": 9.4, "velocity": 6.0 }, { "ts": "2026-09-07 06:10:04 PT", "iq": 9.3, "code": 9.6, "composite": 9.4, "velocity": 5.7 }, { "ts": "2026-09-07 03:09:15 PT", "iq": 9.4, "code": 9.4, "composite": 9.4, "velocity": 5.9 }, { "ts": "2026-09-07 01:48:07 PT", "iq": 9.6, "code": 10.0, "composite": 9.7, "velocity": 6.4 } ], "range24": { "low": 8.1, "high": 9.4, "count": 19, "window_hours": 24, "source": "real_canary_attempts" }, "iq_hourly": { "comms": { "q10": 8.78, "window_runs": 6, "tasks_covered": 8, "of": 14, "per_run": 2, "latency_ms": 19984.5, "causes": [ "rhythm_fail" ], "judge_seats": 6, "detours": 0, "weights": { "feeling": 0.45, "meaning": 0.25, "precision": 0.2, "craft": 0.1 }, "suite": "comms_v1.0" }, "business": { "q10": 9.51, "window_runs": 3, "tasks_per_run": 12, "seed_rotates": true, "latency_ms": 10328.0, "tiers": { "base": 9.76, "hard": 9.27 } }, "coding": { "q10": 9.59, "window_runs": 3, "tasks_covered": 24, "of": 24, "per_run": 8, "latency_ms": 7478.0, "tiers": { "base": 10.0, "hard": 9.17, "base_n": 12, "hard_n": 12 } }, "weights": { "comms": 0.8, "coding": 0.2, "business": 0.0 }, "window_target_runs": 3, "tier_weights": { "base": 0.5, "hard": 0.5 }, "velocity_basis_note": "Velocity = median wall time of one BASE-tier task NET of our gateway's queue wait (v19.2; the v17 slate; 10 = 4 s); hard-tier median shown separately", "hard_latency_ms": 16182.5 }, "degradation": { "state": "ok", "baseline": 9.25, "band": 8.14, "delta": -0.87, "runs": 21 }, "bizruns": { "battery_runs": 0, "battery_avg_q10": null, "battery_generated": null, "in_iq": false, "release_evidence_valid": false, "role": null } } ] }