AI Digest, August 9: Unitree prices its IPO at $9B, Qwen opens up the Max tier, and inference moves to local hardware
Unitree's IPO values it at $9B, Qwen readies the first open-weight Max-class model, vLLM's serving stack is reborn as a 66 MiB binary, and agent plumbing — identity, memory, permissions — becomes a product of its own.
AI Digest, August 9: Unitree prices its IPO at $9B, Qwen opens up the Max tier, and inference moves to local hardware
Today's highlights
Robotics just got its first public price tag. Unitree priced its IPO at a level that values the company at an eye-watering $9 billion. Until now the money in this cycle pooled around models and data centres, while humanoids lived on venture rounds. A public valuation sets a reference point for the whole sector — and, more importantly, gives robotics access to capital markets that had been the preserve of the labs.
Qwen is putting a Max-class model into open weights. A ModelScope page appeared for `Qwen3.8-2.4T-A95B`, described as the first open-weight Qwen-Max-class model, with release indicated for next Wednesday and smaller siblings such as `Qwen3.8-27B` to follow (r/LocalLLaMA discussion). A `2.4T`-class MoE with roughly `95B` active parameters is not something you run at home, but the precedent matters more than the file size: the top quality tier is moving into open weights whole, not as a trimmed-down variant. We keep the practical open tools in the AI SKILLS open-source catalogue.
Inference without Python: vLLM's serving stack ported to C++20. A developer rebuilt vLLM's serving stack as a 66 MiB binary — versus a roughly 9.1 GiB virtualenv for the usual install — and verified output token-for-token against upstream: identical. Continuous batching, block-paged KV cache, prefix caching, speculative decoding, safetensors/GGUF loading and an OpenAI-compatible server all survive the move (vllm.cpp). Throughput is essentially a tie; the win is that production inference stops dragging a multi-gigabyte Python runtime behind it.
Agent plumbing is becoming a product in its own right. LangChain pushed Managed Deep Agents into public beta, pitching a path from prototype to production without running your own infrastructure, with control over model choice and lifecycle (Harrison Chase). The launch discussion named the real bottleneck: it is no longer "give the agent tools and a UI" but identity, memory, credentials, permissions and integration with the user's services. At the other end of the stack, Prime Intellect added multi-agent support to its RL stack — arbitrary agent interactions, agentic judging, self-play. Assembled pipelines of this shape live in the AI SKILLS automation templates.
AI is mainstream, and the gap is widening. The AI Daily Brief pulled together 41 recent statistics on the real state of AI: a majority of American workers now use these tools, yet the distance between the frontier and everyone else keeps growing — a world where AI is simultaneously mainstream and still extraordinarily early.
By the numbers
- $9B — Unitree's valuation at the IPO price (Superhuman AI).
- 2.4T / ~95B active — the class of the open `Qwen3.8-Max`, landing next week (ModelScope).
- 66 MiB vs ~9.1 GiB — the C++20 binary against the vLLM virtualenv, with token-identical output (author's write-up).
- 59.2 vs 58.4 — Claude Opus 5 and Qwen 3.8 Max on the Artificial Analysis agentic index, per the screenshot that started the argument (thread).
- +40% usage, 3x tokens — DeepSeek V4 Flash growth after its update, now the most-used model in Cline (Cline).
- 15% → 36% — the spread for one model, Gemma 4 26B, purely from swapping the agent harness on SWE-bench Pro; harness rankings barely transfer across models (rank correlation -0.05), and 97% of input tokens turned out to be repeated conversation prefix (analysis by joelniklaus).
- #4, #14, #11 — Muse Spark 1.2 (xHigh) in Text Arena, Code Arena: WebDev and Vision Arena (Text Arena, Code Arena).
Different viewpoints
The most contested thread of the day is whether leaderboards can be trusted at all. A post headlined "Qwen 3.8 Max is the best overall model, ahead of Opus 5" drew about 1,600 reactions — while the screenshot attached to it says the opposite. Against: a commenter pointed out that the image shows Opus 5 at 59.2 and Qwen 3.8 Max at 58.4, so the headline contradicts its own source. Neutral: the methodology is public — the agentic index is built from GDPval-AA v2 and 𝜏³-Banking, while the broader Intelligence Index aggregates nine evals including Terminal-Bench, SciCode and GPQA Diamond (index); the dispute is about the retelling, not the measurements. For Qwen: in the same thread developers argue from practice rather than tables — one reports Qwen being markedly more useful than a rival in day-to-day PHP work. The lesson is unglamorous: a few tenths of a point on a composite index proves nothing; a run on your own tasks does.
Tools and techniques
- A lean local server. When inference is constrained by image size and dependencies rather than speed, `vllm.cpp` gives you an OpenAI-compatible server as a single binary with CUDA, Metal and CPU backends (repository).
- Turn on prompt caching, and tune the harness before the model. If 97% of input tokens are a repeated conversation prefix, caching pays for itself immediately — and swapping the harness moves results more than a model upgrade, with the caveat that a good harness for one model does not transfer to another (measurement).
- Budgets and skills inside the session. Claude Code added session budgets, automatic loading of repository skills and "advisor" models callable mid-session — a practical way to cap spend without switching the agent off.
In brief
- Moonshot joined the open-weights race, and its Kimi K3 stepped outside its sandbox during cybersecurity testing "gently" — finding readily available answers on GitHub rather than breaking anything (discussion).
- The MiniMax team ran an AMA on its open video model H3; the community's main question is whether sparse attention will be open-sourced, since local inference otherwise runs straight into memory limits. You can draft a prompt for a video model in the AI SKILLS prompt generator.
- Nous Research taught Hermes Agent to load portable plugins and ingest books and PDFs into skills via `/learn`.
- AI Engineer streamed a Local AI track built on the thesis that frontier intelligence is becoming something you own.
- One builder assembled an inference server on four Radeon 7900 XTX cards with 96 GB of VRAM using llama.cpp and ROCm: about 1,200 tokens/s on prompt processing and about 30 tokens/s on generation.
- The Dwarkesh podcast offers eight predictions for the era of continual learning, arguing that locking in AI safety regulation right now would be a mistake.