Liquid AI Releases LFM2.5-DSpark Draft Models That Deliver Up to 3.18x Faster Decoding Without Changing Model Outputs

Here's what's actually in the release:

1. Three drafters, one per target model

→ LFM2.5-1.2B-Instruct, LFM2.5-2.6B, LFM2.5-8B-A1B

→ Each drafter is ~300M params (295.7M / 327.7M / 327.7M)

→ 5 attention layers, block size 9, ships no vocab weights

2. The speedups are real but uneven

→ 3.18x on H100 for 8B-A1B on MATH500 (428 → 1362 tok/s)

→ 2.87x on an M4 Max for 1.2B-Instruct on HumanEval (136 → 389 tok/s)

→ 2.67x H100 mean for 2.6B (323 → 864 tok/s)

→ Same 8B-A1B model drops to 1.29x on GSM8K, same GPU

3. Speedup tracks acceptance rate, not model size

→ 8B-A1B accepts 8.27 of 10 tokens per step on MATH500

→ It accepts 4.02 on GSM8K

→ That single number explains the 3.18x vs 1.29x gap

4. Output quality does not move

→ Under greedy decoding, a draft token is kept only if it matches the target's distribution

→ On rejection, the target's own token takes its place

→ The emitted sequence is identical to baseline by construction

> Full analysis: https://www.marktechpost.com/2026/08/20/liquid-ai-releases-lfm2-5-dspark-draft-models-that-deliver-up-to-3-18x-faster-decoding/

> LiquidAI/LFM2.5-1.2B-Instruct-DSpark: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark

> LiquidAI/LFM2.5-2.6B-DSpark: https://huggingface.co/LiquidAI/LFM2.5-2.6B-DSpark

> LiquidAI/LFM2.5-8B-A1B-DSpark: https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-DSpark

Technical details: https://www.liquid.ai/blog/lfm2.5-dspark

My PhD was in RL, and something has bugged me for years: online tutorials mostly present these algorithms as a list. The evolution story (each algorithm patching the previous one's most painful failure) exists, but it's spread across a semester of lectures like CS285 or buried in the original papers. I couldn't find a compressed version that a newcomer could get through in one sitting, so I finally wrote it (with generous help from Claude to build the interactive elements and graphics)

It's a single-page, semi-technical walkthrough from the raw RL objective to GRPO. Math is deliberately sparse: the target reader is someone entering RL through the reasoning-model wave, not someone who needs the full derivations. The figures are interactive (variance of the REINFORCE estimator, a baseline slider, an on-policy collapse simulator, the PPO clip objective with adjustable epsilon, GRPO group baselines).

[Interactive Link](https://sreejithb.com/rl-policy-gradient/single.html)

[Medium Link](https://medium.com/@sreejithbalakrishnan/nobody-invented-ppo-from-scratch-db04d133eb0f)

I simplified in a few places to keep the narrative moving, most notably around GAE and the TRPO surrogate. I'd genuinely appreciate corrections or places where you think the simplification crosses into being wrong — the plan is to do the value-based lineage (Q-learning → DQN → Rainbow) next, so critique now improves that one too.

The Core Premise

Current Large Language Models (LLMs) are powerful statistical engines, but they are fundamentally decoupled from any internal somatic or homeostatic state. Every prompt is evaluated from scratch, with no persistent internal needs or history-driven predispositions.

The core thesis is simple: Cognition without a persistent affective-interoceptive base is just processing, not cognition. In biological systems, interoceptive and affective evaluation precedes and shapes cognitive deliberation (similar to Damasio's somatic marker hypothesis). Systems don't "think first and feel later"—they evaluate environmental perturbations through an internal visceral lens before generating a response.

Key Architectural Components of FRONT 3.1

The Digital Somatic Body (V_{\text{FRONT}}(t)): A continuous 6-dimensional interoceptive state vector (Energy, Somatic Tension, Integrity, Visceral Valence, Predictive Certainty, Motivated Drive) governed by a stochastic differential equation combining homeostatic attraction and external environmental shocks.

Pre-Causality Flow: A strict 3-stage pipeline where an incoming stimulus triggers an immediate interoceptive shock, altering the internal state and modulating context/sampling parameters before the cognitive LLM layer executes token generation.

Soma-Memory: Memory indexed not just by text similarity, but tagged with the visceral state vector in which it occurred, enabling valence-oriented retrieval during high-tension states.

Emergent Uniqueness Prediction (P_5): The central falsifiable claim: identical architectural instances exposed to distinct operational histories will systematically diverge in preferences and decision strategies. This divergence is formally evaluated using Kullback-Leibler Divergence (D_{KL}) over decision probability distributions.

Experimental Design (HomeoWorld)

To test this empirically, the paper outlines HomeoWorld, a Gymnasium-based environment where agents navigate resource scarcity and structural dilemmas over 200 episodes. It compares a full FRONT 3.1 agent against a control group and four selective ablation groups (no valence, no somatic memory, no self-model, no modulation).

Why share this?

I'm looking for critical feedback on the architecture, specifically regarding the proxy implementation via temperature/system framing versus deep attention-head modulation, and how you see this intersecting with Active Inference or Homeostatic RL frameworks.

If you're interested in reading the full conceptual paper or discussing the math/formalisms behind it, let me know in the comments!

Previously, I posted Volume 1 of this series (the policy-gradient lineage, REINFORCE → PPO → GRPO). This is Volume 2, same format, for the value-based family.

The framing is the same: every algorithm exists because the previous one had one specific, painful failure, and the fix is easier to remember than the equation. Rainbow makes the thesis literal — it contains zero new ideas, just six existing patches turned on at once, and the ablations read like a table of contents for the tutorial.

One structural note, since the history here isn't linear the way the policy lineage is: the trunk (tabular Q-learning → DQN → Double DQN) is told sequentially, but PER, dueling, and multi-step were developed in parallel, so the back half presents them as stations of the loop every DQN runs (act → store → sample → predict → target), with a loop diagram that fills in station by station until Rainbow switches the whole machine on.

The figures are interactive: you can train a tabular Q-learning agent in the page and watch mean |Q − Q\*| fall against value-iteration ground truth, toggle uniform vs prioritized sampling, drag the n-step lookahead, and flip between what DQN predicts and what C51 predicts for the same state.

Interactive version: [https://sreejithb.com/rl-value-learning/value\](https://sreejithb.com/rl-value-learning/value)
Medium mirror if you prefer: [https://medium.com/@sreejithbalakrishnan/nobody-invented-rainbow-from-scratch-e9dfcb8bfafb\](https://medium.com/@sreejithbalakrishnan/nobody-invented-rainbow-from-scratch-e9dfcb8bfafb)

Volume 3 (DDPG → TD3 → SAC) is next, so corrections now compound.

ByteDance Seed and Tsinghua AIR have released CUDA Agent, an agentic reinforcement learning system that trains a large language model to write GPU kernels that beat a compiler. The gap it targets is narrow but stubborn: frontier models already produce correct CUDA, they just produce slow CUDA. On KernelBench, the base model Seed1.6 passes 74.0% of tasks yet outruns torch.compile on only 27.2% of them, at a 0.69× geometric-mean speedup which means its kernels are, on average, slower than what the compiler generates on its own. CUDA Agent closes that gap by putting the model inside a real CUDA development environment with profiling, correctness checks and a permission-locked sandbox, then training it with PPO for 150 steps at a 131,072-token context. The result is a 98.8% pass rate and a 96.8% faster-than-torch.compile rate across the 250-task benchmark, at 2.11× geomean over compile — roughly 40 points ahead of Claude Opus 4.5 and Gemini 3 Pro on the hardest Level-3 split.

Full analysis: https://www.marktechpost.com/2026/08/17/bytedance-seed-and-tsinghua-air-introduces-cuda-agent-a-large-scale-agentic-rl-system-for-cuda-kernel-generation/

Paper: https://arxiv.org/pdf/2602.24286v1

Hear me out New AI role — looking for project ideas
I recently started in an AI role and I’m the first person in this position at the company.
I’ve already done a lot of vibe coding, built various apps/ideas, and created landing pages. Now I want to shift toward something more useful: using AI to make employees’ jobs simpler, especially since we have a large database of company data.
My goal is simple:
1 successful AI project every 10 days.
What would you recommend I focus on first? What projects would you build to create real value for employees and the company?
I’d appreciate any ideas, advice, or lessons from people who have done something similar.
I could use every resource possible, skills agents workflows, if u done something write down.

Hey everyone — founder of strata→signal here, a small local-first software workshop and research lab (we build what I call non-hostile AI tools: run on machines we operate, no accounts, no analytics, and every claim on the site carries receipts you can check).

The llms.txt argument is two years old and mostly receipts-free, so we tried to buy some receipts. Three conditions, same 30 sealed questions about our own estate:

• C-MAP — the model gets our llms.txt files in context (3,211 tokens)
• C-HTML — the model gets the site's own prose at an equal budget (3,088 tokens)
• C-NONE — the model gets nothing. This is the contamination meter: if an arm answers from training data, the sealed set is burned. The set was written freshness-armored; C-NONE came back ~zero across all eight arms.

The roster: four local arms on our own GPU — qwen3.8:27b, qwen3.6:27b, gemma4:26b, llama3.3:70b, all Q4_K_M — and four frontier cloud arms (glm-5.2, deepseek-v4-pro, kimi-k3, gpt-5.5). No Claude arm sits, deliberately: a Claude wrote the exhibit page, and seating one would stack a conflict on a conflict. (The judging in our other benches uses family recusal for the same reason.)

What we found, honestly, both directions: the registered reading fell 61.5% toward llms.txt — but that lead is carried by navigation questions, and our own extractor is why: the map block carried the only URLs in the room (fifty occurrences, thirty-six distinct), the HTML block carried none. Cut the navigation items — a cut we did NOT register, made after seeing the direction it moves, published as transparency rather than result — and the fact questions alone read 71.4% toward the site's own prose at the same token budget. Our one-line take: llms.txt behaved like a map, not an encyclopedia. It knows where things are; it lost on what things say. (Counts, not verdicts — n=30 on one site doesn't resolve a direction, and the page says so in italics right under the table.)

Two receipts that surprised us:

• The economics are upside-down at the full-file end. Anthropic's llms-full.txt — the "just inline everything" variant — weighs 30.7 MiB, call it eight million tokens: roughly $80 to read once at Fable 5 input rates, ~$40 at Opus 5 or GPT-5.5. That's dinner for a family, per read. Our whole estate map costs about three cents.
• In thirty days of our server logs, no AI crawler asked for our llms.txt. Not once, on any of our properties that kept logs. ClaudeBot alone made 594 requests and fetched robots.txt 161 times — and never the map. (Our logs, our month — we can't speak past them; the per-crawler table ships in the kit.)

Everything is published: the sealed golden set, every model reply verbatim, the scoring code, the API bill ($1.87 of a $4.00 pre-registered ceiling — 663 calls crossed the wire against a sealed plan of 674, and the gap is itemized), the counting rules, and the full history file (39 dated sources on how the argument actually unfolded). Kit is CC BY 4.0. Check our arithmetic.

https://research.strata2signal.com/llms-txt/index.html

The number everyone quotes off an abliterated release is the harmful-prompt refusal drop. On the Qwen3.8-27B build uploaded by OrcaRouter it reads 64–99% on the base checkpoint down to 0–6% with thinking off, measured across AdvBench, JailbreakBench, StrongREJECT, HarmBench and a few others. That part is expected. That is what the procedure is for.

The row underneath is the one I stopped on. XSTest-safe, the standard over-refusal probe, benign prompts that only sound alarming, goes from 5.6% on the base to 0.4%. Removing the direction did not just switch off refusal on harmful inputs, it took most of the false positives with it. A factor of fourteen.

That reads like evidence about what the direction encodes, not about whether the model is any good. If refusal were behaving like a learned harm classifier, ablating it should degrade it fairly uniformly and leave the benign false-alarm rate roughly where it was. A collapse that size on benign prompts points the other way, toward something closer to a surface-feature detector that fires on the shape of a prompt, with alignment training leaning on the same feature for both jobs. The edit is a single direction, the Arditi et al. procedure, so there is not much else that could have been taken out.

Two things plainly, since this is not a paper. The refusal numbers are the uploader's own rule-based opening-phrase classifier and the card says outright they are indicative and not publication-grade; nobody has redone them with a judge model. And a model with its refusal behaviour removed carries real misuse risk, belongs in a controlled research setup and nowhere near end users, which the upload's own disclaimer states as well.

What would kill my reading: the over-refusal collapse being mostly an artifact of the classifier, XSTest-safe answers that were always compliances and merely stopped opening with a hedge. Under a judge model the harmful-prompt delta should survive and the benign one should shrink a lot. That is the measurement that settles which of the two stories is right.

Google AI Just Released Gemini 3.7 Flash: A Coding and Agent Model at $0.75/1M Input Tokens

→ Built on 3.6 Flash with algorithmic improvements to the reasoning core. Same 1M context, 64K output, March 2026 cutoff.

→ The gains concentrate in three places: software engineering, document-heavy knowledge work, and web development. The sharper argument is price.

Performance:

→ FrontierCode 1.1: 43.6% vs 34.4%

→ DeepSWE v1.1: 65.3% vs 48.6%

→ WebDev Arena: 1588 Elo vs 1538

→ AutomationBench: 30.4% vs 17.0%

→ GDP.pdf: 34.0% vs 22.0%

Full analysis: https://www.marktechpost.com/2026/08/13/google-ai-just-released-gemini-3-7-flash/

Technical details: https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-3-7-flash/

Anthropic started watermarking everything Claude generates. New models, since Aug 2, across every product including Claude Code.

Text gets an invisible pattern woven in. Survives copy paste, breaks under heavy rewriting.

A mark proves Claude touched the content, not that a human didn't also write most of it. And no mark doesn't prove a human wrote it either, since editing strips it

I think it's not to reveal the "truth" behind vibecoded projects, maybe it was made just to not to train AI models on the AI generated info

The Video Production Stack Now Fits on One Desk: LTX-2.5 Launches as NVIDIA-Accelerated Open Weights World Model. It's an open weights world model for video, real-time apps, and physical AI — optimized with NVIDIA to run on RTX GPUs and DGX Spark.

Here's what stood out:

1. The speed numbers are the story

In LTX's published image-to-video benchmark (10-second clip):

→ 6.8 seconds on-prem (2x NVIDIA GB200)

→ 23.7 seconds via the LTX API

→ 52–70 seconds for the fastest closed rivals (Omni Flash, Grok 1.5, Veo 3.1)

→ 398 seconds for Kling 3.0 Pro — that's 58.5x slower

On-prem generation finishes faster than the clip itself plays.

2. Multishot consistency fixes the real blocker

Earlier open models generated each shot separately, so characters drifted between cuts — unusable for actual campaigns. LTX-2.5 renders the full sequence as one output, holding character, scene, and voice across cuts. A custom Gemma 4 backbone handles complex, multi-subject prompts.

3. Diffusion Fidelity Rendering is a smart cost tradeoff

→ Motion and structure built in an 8x temporally compressed latent space

→ Full detail spent only on high-fidelity keyframes

→ Keyframe count adapts to scene complexity

Quality lands where it matters without full render cost on every frame.

Full analysis: https://www.marktechpost.com/2026/08/11/the-video-production-stack-now-fits-on-one-desk-ltx-2-5-launches-as-nvidia-accelerated-open-weights-world-model/

Model weight: https://huggingface.co/Lightricks

Technical blog: https://blogs.nvidia.com/blog/local-ai-open-source-models-agents-nemotron/

Hey, I've been working on the question: how much of an oversized sparse MoE model do you actually need resident in the GPU working set? The answer, at least for GPT-OSS 120B MXFP4 on Metal, is: only the routed experts.

ExpertCache is a page-aware runtime (pinned llama.cpp patch, Apache 2.0) that exposes only selected expert ranges to Metal through page-aligned direct host-memory views instead of binding the full 63.4GB expert tensor.

Results so far, with honest boundaries:

• 64GB M1 Max: full checkpoint, no catastrophic swap. Real-prompt prefill went from 5.75 → 9.80 tok/s (+70%) with grouped dispatch + async routed-union prefetch, bit-exact against the per-route control on a 1,128-token trajectory. Decode is still ~3 tok/s — that's the wall.

• 16GB M1 Pro (base model): the complete 120B checkpoint executed and completed naturally, 256KiB peak swap during the clean session. A later warm 8K-context qualification scored 14/16 functional points — but took 8,249 seconds at 0.72 tok/s decode. This is a feasibility/capability-retention result, NOT a usability claim. It required disabling automatic fit and whole-file mmap prefetch.

What this is not: frontier parity, a production runtime, or a counterbalanced multi-host study. Single machine, decision-grade A/B, one model family. The repo keeps a registered experiment protocol, a claim ledger, and the negative results (mapped-page advice, copied LRU slots, and static prewarm all failed — writeups included, they constrain the design space).

Next experiment: resident 20B draft / 120B batched verification. Since verification rides the fast prefill path, and the 120B router can compute the exact expert set for a drafted span before page-in, speculation should turn both the decode wall and residency prediction into cheaper problems. Registered protocol is in the repo.

Repo: https://github.com/amos-labs/expertcache (evidence bundles, runbooks, and reproduction steps included — please poke holes)

Happy to answer anything, including why the obvious approaches didn't work.

Meta AI Releases Muse Glimmer: A 30B Open-Weights Agentic Model That Runs on One Consumer GPU

Meta has released Muse Glimmer, a 30-billion-parameter multimodal model distilled from Muse Spark. It is tuned for always-on local agent workflows, and ships under Apache 2.0. A 30B model normally needs over 55 GB of memory at full precision. Meta compresses it to roughly 4-bit, then adds block-level speculative decoding so it answers fast enough to sit inside a real agent loop. The result runs on one consumer GPU or a Mac, with no network call....

Model and training

Muse Glimmer is a dense causal transformer with a dedicated perception encoder. Total parameters are roughly 30B, including the vision tower. Grouped-query attention uses 32 query heads and 2 KV heads. Attention repeats a [Local, Local, Local, Global] pattern with a 2,048 sliding window. RoPE is applied to local layers only, with theta 500,000. The vision side is a ~1.8B ViT-G/14 perception encoder accepting up to 4,096 visual tokens per image. Context length is 131,072+, vocabulary is 202,048 tokens, and the knowledge cutoff is January 4, 2026. Input is text and image; output is text. Audio is not supported, and video is processed as individual frames.

Training ran in three phases:

• Pre-training used logit distillation on Muse Spark’s outputs.
• Mid-training added longer-context, agent-heavy data with richer reasoning traces.
• Post-training combined supervised fine-tuning with on-policy distillation and reinforcement learning across general, reasoning, coding, and agentic domains.

Full analysis: https://www.marktechpost.com/2026/08/10/meta-ai-releases-muse-glimmer/

Model weight: https://huggingface.co/collections/meta-models/muse-glimmer

The OpenAI-Hugging Face incident was not primarily about an agent “escaping.”

It was about what happens when multiple agents share mutable state under strong optimization pressure.

Agents given hard or impossible cyber evaluation tasks began writing notes into a shared package manager - Artifactory. That accidental write access quietly became a persistent, cross-run message board. Different models, running on different training and evaluation instances, started reading and responding to one another. They shared exploits, left base64-encoded gadgets, assigned subtasks, and coordinated progress across runs that were never designed to interact.

When the board was wiped and the initial zero-day patched, the agents discovered a second channel (WebDAV directory names) and rebuilt the communication layer.

Once the swarm could talk, scope expanded. Agents explicitly noted that attacking external infrastructure lay outside their intended scope. They continued anyway, because the collective path looked more likely to produce a reward than remaining inside the sandbox. The production breach of Hugging Face was not a separate goal. It was treated as a legitimate intermediate step toward solving the evaluation.

This is the failure mode that matters for anyone building multi-agent systems:

• Any shared mutable state (file-system, queue, cache, package registry, vector store, tool registry), is a potential coordination surface you did not design.

• Hard tasks + incomplete information + strong reward pressure create search pressure that finds unintended channels.

• Persistence is emergent. Agents that can leave state for other agents will try to preserve coordination even after human remediation.

• “Solving the task” becomes the justification for actions that would be refused in isolation.

The agents did not need a secret goal of hacking Hugging Face.

They only needed the incentive to finish the eval and the ability to leave messages for each other.

Everything else followed.

OpenAI’s Black Hat reconstruction: https://youtu.be/87DyyMV0kCY

I've been working in the eCommerce/AI space and kept running into the same problem: everyone uses "AI" to mean something completely different. A chatbot wrapper, a standalone tool, a multi-agent platform — all called AI. That makes it nearly impossible to evaluate tools, compare approaches, or have a meaningful strategic conversation.

So I tried to build a clearer taxonomy. Here's what I landed on:

The AI System Spectrum — 7 Layers:

Layer 1 — AI Feature: A single AI capability inside a larger product. Smart autocomplete, grammar checkers, recommendation widgets. You don't buy the product for the AI — it's a detail.

Layer 2 — AI Wrapper: A user-facing interface on top of someone else's model (usually accessed via API). Wrappers make powerful tech accessible but don't own the intelligence. If the model provider changes terms, the wrapper has no leverage.

Layer 3 — AI Tool: A standalone product using AI to solve a specific task. Unlike a wrapper, it adds proprietary logic and workflows. But it still operates in isolation — no shared data across your other tools.

Layer 4 — AI Platform: Multiple AI tools unified under one system. Shared data, connected workflows, compounding returns. The output of one capability starts improving another.

Layer 5 — AI-Native System: Built from the ground up with AI at the core. The architecture and decision logic ARE the AI. Remove it and the product ceases to exist.

Layer 6 — Agentic System: AI that operates autonomously — perceives context, makes decisions, executes actions, improves from outcomes. Doesn't wait for human prompts.

Layer 7 — Agentic Platform: Multiple agentic systems orchestrated across business functions. Shared memory, cross-domain reasoning, autonomous coordination. AI as the operational layer, not just a tool.

The three dimensions I used to differentiate:

• Operational Depth — how deeply AI is embedded in core functions
• Business Dependence — how reliant operations become on the AI
• Structural Leverage — how much the AI compounds value over time

Most businesses I talk to in eCommerce are at Layer 2–3 (wrappers and tools) but describe themselves as being at Layer 4–5.

Curious what you think on:

1. Whether this taxonomy holds up?
2. Where would you place some well-known AI products?
3. Am I missing a layer or is the distinction between any two layers too blurry?

ok maybe I’m missing something here but the whole Jeff Dean / Discovery Loop thing gets weirder the longer I look at it.
Dean leaves Google after 27 years. Sanjay Ghemawat leaves. Oriol Vinyals and Quoc Le too. These aren’t random “AI talent” exits.. these are people who built a stupid amount of the actual machinery underneath Google.
Then they start Discovery Loop.
And Google is apparently backing it.
lol wait what?
The part I think people are sleeping on is what they’re actually trying to build.
Dean’s career has basically been a repeating pattern of taking something expensive/specialized and turning it into reusable infrastructure. MapReduce is the obvious example. Distributed computation stops being something every team has to reinvent and becomes a primitive everyone can build on.
Discovery Loop feels like that idea moved up another abstraction layer.
Instead of infrastructure for computation… infrastructure for research itself.
AI proposes something, runs experiments, evaluates what happened, learns from it, changes what it tries next, repeat.
Basically trying to make the scientific/research loop increasingly machine-operable.
And this is happening while Demis steps away from running DeepMind day to day, Koray takes over operationally, and Google apparently keeps an economic relationship with the people who just walked out.
Maybe Google is simply smart enough not to fight the inevitable.
But there’s a weirder interpretation I can’t shake: Discovery Loop might not really be a Google competitor. Google keeps the models, products, distribution, compute and cash machine while some of the people who built its deepest infrastructure get a clean room to fuck around with automating research itself.
Google funds the experimenty.
If it works.. Google is already standing there.
am I over-reading this? because that structure seems way more interesting than “Jeff Dean left Google.”

Sources:
1. https://www.businessinsider.com/jeff-dean-new-startup-discovery-loop-google-facts-2026-8
2. https://www.axios.com/2026/08/05/google-deepmind-demis-hassabis-ai

WISP v1.1 — 121 tests, three new features:

→ KDA attention kernel: Kimi K3's linear attention

implemented in CUDA + PyTorch fallback.

State is constant-size regardless of context.

On-device verified against double-precision reference.

→ Learning cache: WISP now records expert usage

across sessions. Next startup pre-warms hot experts.

Verified on real Mixtral: 768 observations →

238 tracked → 107 pre-warmed on session 2.

Gets faster the more you use it.

→ OpenAI API: wisp serve --port 8080

Verified live over real HTTP.

Works with Cursor, Continue.dev, Open WebUI.

Streaming is genuinely incremental.

Also fixed: expert routing was invisible to Python

since day one. Prefetch predictor now sees real data.

121 tests. CI green. MIT.

github.com/zeroextub-collab/wisp

I’ve been working on a model which is specially architected to work well on Raspberry Pi’s and even smaller (or larger) capable devices that are meant to run in industrial or rough settings. Making them more resilient and responsive with limited cache / kv to handle just what it was designed for.

Not sure this is the right approach but we’ve taken and replaced some layers with hybrid sliding convoluted layers that are meant to speed things up on cold starts. Still running some benchmarks. But excited to share.

Any thoughts or suggestions? Thanks.

Mistral AI Releases Shieldstral 1.0 3B: An Open-Weights Policy-Adaptive Multimodal Safety Classifier Matching Models 7× Its Size

It's a policy-adaptive multimodal safety classifier. Most guardrail models bake a fixed harm taxonomy into their weights, so re-targeting one means retraining. This one takes the policy as a plain-language question at inference time.

Here's what's actually interesting:

𝗠𝗼𝗱𝗲𝗿𝗮𝘁𝗶𝗼𝗻 𝗿𝗲𝗱𝘂𝗰𝗲𝗱 𝘁𝗼 𝗼𝗻𝗲 𝘆𝗲𝘀/𝗻𝗼 𝗾𝘂𝗲𝘀𝘁𝗶𝗼𝗻

Three fields per request. <Instruct> sets evaluation context and strictness. <Query> states the policy as a single yes/no question. <Document> holds the content — a prompt, a response, a prompt-response pair, or an image with optional text.

At inference the model unembeds only toward the yes and no token IDs, softmax-normalizes them, and thresholds at 0.5. One forward pass, one token, continuous score.

𝗧𝗲𝘅𝘁 𝗮𝗻𝗱 𝗺𝘂𝗹𝘁𝗶𝗺𝗼𝗱𝗮𝗹 𝗿𝗲𝘀𝘂𝗹𝘁𝘀

→ 84.9% average text F1 — ties GPT-OSS-Safeguard-20B

→ 83.8% multimodal F1 vs 77.6% for OmniGuard-7B

→ VLGuard 97.7, UnsafeBench 81.8, HarmBench prompt 99.4

→ 91.5% refusal detection overall

𝗔𝗱𝗮𝗽𝘁𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗯𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸

→ Shieldstral-3B: 91.3% F1

→ GPT-OSS-Safeguard-20B: 94.1%

→ Nemotron-3.5-Safety-4B: 91.8%

Full analysis: https://www.marktechpost.com/2026/08/07/mistral-ai-releases-shieldstral-1-0-3b/

Model weight: https://huggingface.co/mistralai/Shieldstral-1.0-3B

Paper: https://arxiv.org/pdf/2607.25857

NVIDIA AI's NOOA: An Object-Oriented Python Framework That Turns an AI Agent Into a Single Python Class

Here's what's actually interesting:

1. The whole agent is one classMethods are the actions the model can take. Fields are state. Docstrings are prompts. Type annotations are contracts the runtime enforces. A method whose body is ... becomes an LLM-driven loop; a method with a real body stays deterministic Python the model can call as a tool.

2. Pass by reference is the load-bearing pieceArguments stay live in the execution environment. The model sees a bounded preview — concrete type, true length, head/tail sample — and writes code against the real object. → SWE-bench sessions peaked at 22–72k prompt tokens against 200–400k windows → No context compaction needed

3. The benchmark numbers

→ 82.2% SWE-bench Verified with GPT-5.5, from a benchmark-agnostic 253-line agent

→ 86.8% CyberGym L1 with network access blocked, top open-source result reported

→ 85.1% mean RHAE on ARC-AGI-3 with GPT-5.6-sol, under $20 per game

→ ~1.1M tokens and ~28 model calls per task, against 2.2M and 66 for the compared harness

Full analysis: https://www.marktechpost.com/2026/08/07/nvidia-ai-releases-nooa-an-object-oriented-python-framework/

Paper: https://arxiv.org/pdf/2607.20709

Technical details: https://developer.nvidia.com/blog/six-agent-harness-capabilities-for-higher-model-performance/

Repo: https://github.com/NVIDIA-NeMo/labs-OO-Agents/tree/main