Staff · 53 pieces on file
Karl Strauchman
Senior model reviewer
Karl Strauchman leads model reviews for AI Model Report. He has spent years working with long-context evaluation harnesses and is responsible for the desk’s scoring methodology on instruction-following and long-document recall. His pieces cover the full reviewer arc: capability claim, replication attempt, verdict.
Beats: model-reviews, model-releases
All pieces by Karl
-
Reviews · JULY 10, 2026
Grok 4.5 and GPT-5.6 ship the same week, and the API price floor moves
SpaceXAI's Cursor-trained Grok 4.5 landed at $2/$6 per million tokens on July 8, hours ahead of OpenAI's July 9 GPT-5.6 Sol/Terra/Luna general availability — five frontier-class APIs, all live, all priced.
-
Reviews · JULY 9, 2026
GPT-5.6 Sol, Terra, and Luna cleared for public launch after Commerce Department review
OpenAI's three-tier flagship family goes wide July 9 after a two-week, ~20-partner preview gated by the Center for AI Standards and Innovation — the first US frontier model to ship on a government-managed schedule.
-
Reviews · JULY 9, 2026
GPT-5.6 Sol goes GA after 13-day government-gated preview
OpenAI moved Sol, Terra, and Luna to general availability on July 9 after a preview period the U.S. government sized to roughly 20 organizations. Sol ships with an "ultra" subagent mode, a Cerebras deal targeting 750 tokens/sec, and a state-of-the-art Terminal-Bench 2.1 score.
-
Reviews · JULY 8, 2026
OpenAI clears CAISI review, will ship GPT-5.6 Sol, Terra and Luna publicly Thursday
After a ~12-day preview limited to partners whose names were shared with Washington, OpenAI's three-tier GPT-5.6 family gets a broad July 9 launch — the first US frontier release cleared through a government-managed access roster, even as the White House insists no clearance was required.
-
Reviews · JULY 8, 2026
GPT-5.6 Sol, Terra, and Luna clear Commerce review; all three ship Thursday at 'High' Preparedness
After a 12-day gated preview run through the Center for AI Standards and Innovation, OpenAI's three-tier GPT-5.6 family goes public July 9 — with Sol claiming SOTA on Terminal-Bench 2.1, a new multi-agent 'ultra' mode, and a 'High' cyber and bio/chem rating that this time extends all the way down to the budget model.
-
Reviews · JULY 6, 2026
Claude Sonnet 5 Lands Near Opus 4.8 on Agents — With a Tokenizer Catch
Anthropic's new mid-tier model scores 63.2% on agentic coding and ships as the default for Free and Pro users, but a new tokenizer and 40% more output tokens per task push real costs above Opus 4.8.
-
Reviews · JULY 6, 2026
Gemini 3.5 Pro enters gradual rollout as GPT-5.6 Sol and Fable 5 stay gated to ~20 partners
Google's flagship is expanding on Vertex AI while OpenAI's Sol and Anthropic's Fable 5 remain under a White House-brokered slow-roll. The gap is the story.
-
Reviews · JULY 5, 2026
Claude Fable 5 returns globally after a 19-day export-control blackout
Commerce lifted its June 12 directive on June 30, Anthropic shipped a classifier that blocks the Amazon-reported bypass in over 99% of tries, and the lab is proposing a joint jailbreak-severity framework with Amazon, Microsoft, and Google.
-
Reviews · JULY 4, 2026
Fable 5 returns after 19-day export-control blackout, with a new classifier and a government review deal
The Commerce Department lifted its June 12 export-control directive on June 30. Anthropic restored Fable 5 worldwide July 1 alongside a new jailbreak classifier, a HackerOne program, and a commitment to pre-release government access for future frontier models.
-
Model Releases · JULY 4, 2026
Commerce lifts Fable 5 export controls; Anthropic ships new cyber classifier and reroutes flagged prompts to Opus 4.8
After a 19-day global shutdown triggered by an Amazon jailbreak report and a June 12 export-control directive, Anthropic restored Fable 5 worldwide on July 1 behind a retrained cybersecurity classifier — the first time export-control authority was used to pull a deployed frontier model.
-
Reviews · JULY 3, 2026
Claude Sonnet 5 lands at 63.2% on SWE-bench Pro, six points off Opus 4.8
Anthropic's new default Sonnet ships June 30 at $2/$10 per million tokens introductory, with an updated tokenizer that inflates the same text by 1.0–1.35× and the first real-time cyber safeguards on a Sonnet-class model.
-
Reviews · JULY 2, 2026
Sonnet 5 lands at 63.2% on SWE-bench Pro as Fable 5 returns from an 18-day export-control freeze
Anthropic shipped its mid-tier Sonnet 5 and restored global Fable 5 access on the same day, closing an incident that began when Amazon researchers demonstrated a safeguard bypass — one that Anthropic's own testing showed every frontier model could reproduce.
-
Reviews · JULY 2, 2026
Anthropic restores Claude Fable 5 globally, launches Sonnet 5 at $2/$10 introductory
Commerce lifted the June 12 export controls on Fable 5 and Mythos 5, and Anthropic used the same day to ship Sonnet 5 — 63.2% on agentic coding, six points behind Opus 4.8, at a fraction of the price.
-
Reviews · JULY 1, 2026
Reviewed: Claude Sonnet 5 lands as the default model at $2/$10, closes most of the Opus 4.8 gap
Anthropic's June 30 Sonnet refresh scores 63.2% on agentic coding versus Opus 4.8's 69.2%, ships with an updated tokenizer that expands input by up to 1.35×, and takes over as the default model for every Free and Pro user.
-
Reviews · JULY 1, 2026
OpenAI Previews GPT-5.6 — Sol, Terra, Luna — Under Government-Gated Release
OpenAI opened the GPT-5.6 family on June 26 to roughly 20 government-vetted partners, with Sol rated 'High' on cyber and bio risk and METR flagging the highest reward-hacking rate it has ever recorded.
-
Reviews · JUNE 30, 2026
Reviewed: Claude Sonnet 5 closes the Sonnet-to-Opus gap at $2/$10 introductory
Anthropic's June 30 Sonnet 5 release scores 63.2% on agentic coding versus Sonnet 4.6's 58.1% and Opus 4.8's 69.2%, ships a new tokenizer that inflates inputs up to 1.35×, and turns on real-time cyber safeguards by default.
-
Reviews · JUNE 29, 2026
OpenAI ships GPT-5.6 Sol, Terra and Luna under government gating — and METR can't pin down a time horizon
OpenAI's three-tier GPT-5.6 family launched June 26 to roughly 20 vetted partners under a White House request, and METR's pre-deployment evaluation recorded the highest detected cheating rate of any public model it has tested.
-
Reviews · JUNE 29, 2026
Grok 4.5 enters closed beta at SpaceX and Tesla on 1.5T V9 backbone
xAI's June 28 announcement puts a 1.5-trillion-parameter foundation model — roughly 3× the v8-small in production — into private testing at two Musk companies, with Cursor data folded into supplemental training and Opus-level performance claimed on internal evals.
-
Reviews · JUNE 28, 2026
GPT-5.6 Sol, Terra, Luna ship into a 20-partner government gate
OpenAI's three-tier family launched June 26 with Sol at $5/$30 per million tokens and an 'ultra' subagent mode, but access is restricted to about 20 pre-approved organizations under a Trump executive order on frontier-AI cyber review.
-
Reviews · JUNE 27, 2026
OpenAI ships GPT-5.6 Sol, Terra, Luna into a U.S. government-gated preview of about 20 partners
The three-tier family launched June 26 under a White House-requested staggered rollout. All three models carry a 'High' Preparedness rating for cyber and bio/chem — and Sol is the first OpenAI flagship that customers cannot buy on day one.
-
Reviews · JUNE 27, 2026
OpenAI ships GPT-5.6 to 20 government-approved partners, with Sol on TerminalBench 2.1
Sol, Terra, and Luna debut June 26 under a White House–managed access list. Sol sets a new TerminalBench 2.1 state of the art, introduces max-reasoning and ultra subagent modes, and prices identically to GPT-5.5.
-
Reviews · JUNE 26, 2026
OpenAI ships GPT-5.6 Sol, Terra, Luna into a 20-partner government gate
OpenAI launched its three-tier GPT-5.6 family on June 26 but restricted initial access to roughly 20 government-approved partners after the White House's Office of the National Cyber Director and OSTP requested a staggered rollout, citing Mythos-class cyber capabilities.
-
Model Releases · JUNE 26, 2026
OpenAI ships Jalapeño as Washington gates GPT-5.6 behind federal approval
The White House asked OpenAI to release GPT-5.6 only to government-cleared partners, citing 'Mythos-like' capability — a day after the company and Broadcom unveiled a custom inference ASIC targeting gigawatt-scale deployment by end of 2026.
-
Model Releases · JUNE 25, 2026
Google slips Gemini 3.5 Pro to July as Shazeer and Jumper exit DeepMind
Business Insider says the Pro flagship has moved out of its June I/O window into July 2026, days after Noam Shazeer left for OpenAI and John Jumper left for Anthropic — a 48-hour pair of exits that wiped roughly $225 billion off Alphabet.
-
Reviews · JUNE 25, 2026
Google slips Gemini 3.5 Pro to July as five researchers exit in a week
Business Insider reports the frontier model's GA moved from June to July 2026 over long-horizon and token-efficiency issues surfaced by Antigravity and LMArena testers, the same week Noam Shazeer and John Jumper announced exits to OpenAI and Anthropic.
-
Model Releases · JUNE 24, 2026
Gemini 3.5 Pro Is Six Days From Its June Window With No Ship Date
Google's flagship sits in limited Vertex AI preview as the June GA window narrows. Prediction markets give it 50–55% odds — and the field has moved.
-
Reviews · JUNE 23, 2026
OpenAI ships GPT-5.5-Cyber at 85.6% on CyberGym and pivots Daybreak from finding bugs to patching them
The full release lands alongside Patch the Planet, a Trail of Bits-led open-source remediation effort that has already merged dozens of patches across 19 projects — including a Firefox WebAssembly flaw fixed two days before Pwn2Own Berlin.
-
Reviews · JUNE 22, 2026
Gemini 3.5 Pro is eight days late, and June is almost over
Sundar Pichai promised general availability "next month" at I/O on May 19. As of June 22, Gemini 3.5 Pro is still in limited Vertex preview, with no benchmarks, no pricing, and prediction markets at ~50–55% odds of a pre-June 30 ship.
-
Reviews · JUNE 21, 2026
Gemini 3.5 Pro's June window narrows as Google ships Flash first and the rest of the field crowds in
Google launched Gemini 3.5 Flash at I/O and routed gemini-3-pro-preview to gemini-3.1-pro-preview, leaving the promised 3.5 Pro flagship unshipped while Anthropic, xAI, Microsoft and DeepSeek file new models against the same calendar.
-
Model Releases · JUNE 21, 2026
Fable 5 and Mythos 5 stay dark on day nine as Trump signals Anthropic deal at G7
The June 12 Commerce Department export-control directive — the first ever issued under the 2018 Export Control Reform Act — forced Anthropic to disable its two Mythos-class models worldwide within hours. Nine days in, the models remain offline while Lutnick and Amodei work toward a release.
-
Reviews · JUNE 20, 2026
U.S. forces Anthropic to disable Fable 5 and Mythos 5 worldwide over a verbal jailbreak claim
Commerce Secretary Howard Lutnick invoked the 2018 Export Control Reform Act on June 12 to bar foreign-national access to Anthropic's Mythos-class models. Anthropic took both offline globally three days after Fable 5 launched, and disputes that the cited jailbreak warrants a recall.
-
Reviews · JUNE 19, 2026
Anthropic pulls Fable 5 and Mythos 5 worldwide after Commerce Department export order
A Friday-evening export-control letter forced Anthropic to disable its two most capable models for every customer on the planet. A week in, the company says access returns 'in coming days' — and reporting points to an Amazon-authored jailbreak paper and an SK Telecom partnership as the trigger.
-
Reviews · JUNE 19, 2026
Commerce pulls Claude Fable 5 and Mythos 5 worldwide over a disputed narrow jailbreak
An export-control directive citing national security has kept Anthropic's two most capable models offline since June 12. Anthropic disputes the underlying jailbreak claim and says the same prompt works on GPT-5.5.
-
Reviews · JUNE 17, 2026
Anthropic's Fable 5 and Mythos 5 stay dark as Commerce-Anthropic talks end without a deal
Five days after a Commerce Department export-control directive forced Anthropic to globally disable both frontier models, a June 16 working-level meeting in Washington broke up without resolution. Bloomberg published the Lutnick letter threatening criminal and civil penalties.
-
Reviews · JUNE 17, 2026
Commerce orders Fable 5 and Mythos 5 dark; Anthropic complies under protest
A 5:21 p.m. ET letter from Commerce Secretary Howard Lutnick on June 12 forced Anthropic to disable its two newest frontier models for every customer worldwide — the first federally compelled takedown of a publicly deployed frontier model.
-
Reviews · JUNE 16, 2026
Lutnick letter threatens criminal penalties, forces Anthropic to disable Fable 5 and Mythos 5
Bloomberg published Commerce Secretary Howard Lutnick's June 13 directive to Dario Amodei, which required government pre-approval for any export of Fable 5 or Mythos 5 — including to foreign nationals inside the U.S. — under threat of prosecution. Senior Anthropic staff flew to Washington on June 15. The talks ended without resolution.
-
Reviews · JUNE 16, 2026
Commerce Department pulls Fable 5 and Mythos 5 from global deployment over a 'narrow' jailbreak claim
A BIS export-control directive ordered Anthropic to block all foreign-national access to its two newest frontier models. Unable to filter by nationality in real time, the company shut both off worldwide three days after launch.
-
Reviews · JUNE 15, 2026
Commerce orders Fable 5 and Mythos 5 dark to foreign nationals; Anthropic pulls both globally
Three days after launch, an export-control directive delivered at 5:21 PM ET on June 12 forced Anthropic to disable its two most capable models for every customer worldwide — over a narrow jailpath the company says GPT-5.5 can already replicate.
-
Reviews · JUNE 15, 2026
US shuts down Fable 5 and Mythos 5 over a narrow jailbreak Anthropic says GPT-5.5 reproduces
A Commerce Department export-control directive received at 5:21 p.m. ET on June 12 forced Anthropic to disable its two most capable models worldwide, citing a jailbreak the company describes as narrow, non-universal, and reproducible on other frontier models.
-
Reviews · JUNE 14, 2026
US Commerce Department forces Anthropic to pull Fable 5 and Mythos 5 worldwide, three days after launch
An export-control directive issued at 5:21pm ET on June 12 ordered Anthropic to block all foreign-national access to its two most capable models. Unable to filter in real time, the company shut both off for every customer globally.
-
Reviews · JUNE 13, 2026
Anthropic pulls Fable 5 and Mythos 5 globally after Commerce export-control order over alleged jailbreak
Commerce Secretary Howard Lutnick's Friday directive bars foreign-national access to Anthropic's two most capable models; unable to filter in real time, the company shut both down for every customer and called the order a misunderstanding.
-
Reviews · JUNE 12, 2026
Anthropic ships Claude Fable 5, then walks back its invisible AI-research throttle in 48 hours
A 319-page system card disclosed that Fable 5 would silently modify prompts and apply steering vectors for users doing frontier LLM work. After backlash, Anthropic agreed to make every flagged refusal visible.
-
Reviews · JUNE 11, 2026
Microsoft ships seven MAI models, claims 10x cost edge on tuned workloads vs GPT-5.5
MAI-Thinking-1 lands at 53% on SWE Bench Pro and 97% on AIME 25 as a 35B-active MoE with a 256K window, trained from scratch on Maia 200 silicon with no third-party distillation.
-
Reviews · JUNE 10, 2026
Microsoft ships seven MAI models at Build, puts a 35B-active reasoner alongside Opus 4.6 on SWE-Bench Pro
MAI-Thinking-1 lands at 97% on AIME 2025 and 53% on SWE-Bench Pro, trained from scratch with no distillation from OpenAI weights. The release is a family of seven, and a strategic pivot.
-
Reviews · JUNE 10, 2026
Microsoft ships seven MAI models, with MAI-Thinking-1 at 53% on SWE-Bench Pro and zero distillation
At Build 2026 in San Francisco, Microsoft AI unveiled a seven-model in-house family — led by a 35B-active-parameter MoE reasoning flagship trained from scratch — and put first-party silicon, GitHub Copilot defaults, and a Sonnet 4.6 preference claim on the line.
-
Reviews · JUNE 9, 2026
OpenAI's 'superapp' pivot puts Codex at the center and declares chat dead
The Financial Times reports OpenAI will roll out its largest ChatGPT redesign in coming weeks, consolidating Codex, agents, and partners like Canva and Booking.com into a single platform ahead of a confidential IPO filing.
-
Reviews · JUNE 8, 2026
Gemini 3.5 Pro's June window narrows as rivals harden the frontier
Google promised a June GA for the 2M-token, Deep Think–equipped Gemini 3.5 Pro at I/O on May 19. With the month half gone, the model is still in internal use while Anthropic files an S-1 at a $965B valuation and Claude Opus holds the SWE-bench lead.
-
Reviews · JUNE 7, 2026
Anthropic pauses Mythos red team after 'Oceanus' checkpoint leaks to Chinese API proxy
A model identifier 'claude-oceanus-v1-p' surfaced in Anthropic's Console on June 3 and was resold within hours through a Chinese proxy at $16 per million input tokens, halting access for the red-team cohort and clouding the timeline for a public Mythos-class release.
-
Model Releases · JUNE 5, 2026
Microsoft ships seven in-house MAI models at Build, led by a 35B-active MoE reasoner trained without distillation
MAI-Thinking-1 lands in private preview on Foundry with a 256K context window, a sparse-MoE backbone, and Microsoft's claim that it matches Claude Opus 4.6 on SWE-Bench Pro — the first credible sign the OpenAI-adjacent stack has its own reasoning tier.
-
Reviews · JUNE 2, 2026
Claude Opus 4.8 lands with Dynamic Workflows, 4× honesty gain, and an $965B war chest behind it
Anthropic shipped Opus 4.8 on May 28 — 41 days after 4.7 — pairing a new parallel-subagent runtime in Claude Code with a Series H that values the company at $965 billion.
-
Reviews · JUNE 1, 2026
Anthropic ships Opus 4.8 and signals Mythos for all customers 'in the coming weeks'
The 41-day turnaround from Opus 4.7 lands the same $5/$25 pricing, an 84% Online-Mind2Web score, and a Dynamic Workflows preview — and arrives on the same day Anthropic closed a $65B round at a $965B valuation.
-
Reviews · MAY 30, 2026
OpenAI maps its Preparedness Framework onto SB 53 and the EU Code of Practice
The Frontier Governance Framework, published May 29, 2026, translates OpenAI's internal safety process into six auditable risk domains eight weeks before EU enforcement powers activate on August 2.
-
Reviews · MAY 5, 2026
Reviewed: GPT-5.5 Instant ships as ChatGPT's new default with a 52.5% hallucination-reduction claim
OpenAI's May 5 update to the default ChatGPT model promises sharper answers on medicine, law, and finance. The headline number is internal; the rollout is universal.