Blog · Launch week, part 2 of 3 · August 25, 2026
Local is solved. Ownership isn't.
In one August week, Perplexity and NVIDIA shipped a local-first agent, a Berkeley lab shipped an engine that runs 120B-class models on a gaming GPU, two of the best open models of the year dropped their weights, and two benchmark sites launched to help you choose between all of it. Here is what that week means — and what none of it says.
The week, in six releases
- FreeToken FlashML, UC Berkeley · Apache-2.0 · weeks old
An edge engine that keeps a sparse model's experts in host RAM and streams only the active set to the GPU — so 20B to 120B-total mixture-of-experts models run on one consumer NVIDIA card plus the memory already in your box. - Nemotron 3.5 Lightning 30B-A3B NVIDIA · August 11 · OpenMDW-1.1, commercial use allowed
Thirty billion parameters of experts, three billion active per token, a hybrid Mamba-2/attention design, and GGUF builds that Ollama pulls directly. - Qwen3.8-27B Alibaba · weights August 14 · Apache-2.0
A dense 27B model with a 262K-token context, image and video understanding, and a thinking mode. At four-bit it is about 16 GB — it fits a 32 GB machine. - Pipette Liquid AI × Artificial Analysis · August 24 · Apache-2.0 clients
Benchmarks speed, latency and peak memory on your device (phones included) and scores quality separately in the cloud. - local.ai data by Exo Labs · new this month
An independent leaderboard for local setups: an "intelligence" index, measured tokens per second at a cold 32K context, energy, and a value index — across ten machines from $2,700 to $15,500. - Portable Computer Perplexity with NVIDIA · August 25
Perplexity's agent harness brought fully on-device: on the NVIDIA DGX Spark today, with GeForce RTX, RTX PRO, and Windows support to follow; Qwen3.8-27B or Perplexity's own post-trained "PPLX 27B"; and — the part everyone quoted — every task starts locally, and the system asks before sending a single step to a frontier model in the cloud, showing you what would go.
What they all agree on
Inference has come home. Not "will come home" — the model that runs on the machine under your desk is now good enough for most of the work people actually do, and the economics have flipped: a token you generate locally costs nothing at the margin. Perplexity's own numbers make the case better than we could. On their coding benchmark the local model alone scores 59.6% for free; letting a frontier model advise on the hard steps lifts that to 73.0% at about 42 cents a task; the frontier model alone scores 82.4% at 65 cents. The gap is real, but so is the price, and the price is now something you choose per step rather than per subscription.
That is the tell. When a company whose business is an answer engine in the cloud ships a product where the cloud is the exception you approve, the argument about where computation should run is over. The cloud has become what it should have been all along: a specialist you consult, not a landlord you rent from.
The benchmark sites are the other half of the same signal. local.ai's tagline is the most honest sentence written about this market this year: "Running AI locally is easy now. Choosing what to run is not." When the hard problem moves from can I to which one, a category has matured.
What none of them say
"Local" describes where a computation runs. "Sovereign" describes who holds the result. Those are different words because they are different things, and the week's announcements are eloquent about the first and silent about the second.
We keep a public ledger of our own product's claims, and we propose the same three questions for any product that calls itself private:
- Can I read every line that runs?
- Can I take everything out — verified, in a documented format — and leave?
- When something isn't private, does the product tell me at that moment?
Run the week through them. Portable Computer answers the third question better than anyone has, and we will come back to that. On the first two it is quiet: the harness is closed, a Perplexity subscription and account are required, the Gmail, Drive, Slack and GitHub connectors sign in on your behalf and nothing says where those credentials live, and nothing in the launch material says where your memory lives, how you export it, or what deletion means. The benchmarks measure tokens per second on machines that cost more than most people's cars — useful, and beside the point for the laptop you already own.
None of this is a criticism of the engineering, which is excellent. It is an observation about what the industry is optimizing for. A local model attached to a cloud memory, behind a login, is a better-ventilated cage. The moat was never the model. The moat is the memory — the accumulated record of what you asked, decided, and were told — and the week that solved local inference did not move that moat one inch.
Where they are right, and we were behind
Credit where it is owed. Perplexity's per-step disclosure is the right instinct executed well: before anything leaves the machine, you see what would leave, and you say yes or no. We have disclosed which model answers and whether it is local since the first release. They show the bytes. That is better, and we were behind.
So we built it (the deep dive takes it apart). As of today's build, before any request goes to a remote provider, SovereignAI shows you the customs declaration: the system prompt, the memories it is about to inject, the document excerpts it retrieved, the prior messages, and your new one — with sizes — and waits. Every answer that came back from a remote model carries a receipt of how much left and to which host. Local models never gate, because nothing leaves.
One deliberate difference: there is no PII classifier in front of that dialog. A classifier is one more model reading your data and making a judgment you cannot audit. You can read the bytes yourself; that is the whole point of showing them.
What we are doing this week
The shelf is where a product like ours stays honest, so the shelf got the work.
- The starter shelf is refreshed and dated. Qwen3.8-27B joins as the top reasoning pick — the same model Perplexity chose, at four-bit on a 32 GB machine. Nemotron 3.5 Lightning joins the frontier tier as the first sparse model Ollama pulls directly, no special engine required. Every entry carries its license, because open weights are not automatically an open license.
- The sizing is a rule of thumb, and says so. We estimate about 0.6 GB per billion parameters at four-bit against 60% of your RAM, and since last week your GPU too. That is an estimate, not a measurement; the shelf now links to local.ai and Pipette for measured numbers. We have no relationship with either.
- The frontier tier starts at the GPU you have. Through FreeToken, the 20B–120B sparse class runs on a 4–8 GB card plus host RAM. Portable Computer runs on a DGX Spark today, and its engineers put the coming RTX floor at 24 GB of VRAM. Different bets about who this is for.
- Reasoning is shown live and never stored. The new models think out loud; you can watch, and nothing of it is written down, distilled, or exported.
Why it matters
Our thesis is that you are the most fragmented database on earth — every service holds a shard of you, and the joins between the shards are where your life actually is. The reassembled whole is the most sensitive dataset that could exist about a person, which is why it is only safe on hardware you control, in formats you can walk away with.
This week made the first half of that easy. The models are good, the engines are clever, and the hardware you already own is enough. What it did not do is settle the second half, and the second half is the part that decides whether "local-first" becomes a property you own or a feature you rent. If the industry stops at inference — local model, cloud memory, vendor login — it will have rebuilt the last decade's lock-in with better latency.
The honest version of local-first has to answer all three questions, and it has to answer them about itself first. So, for the record, the parts of SovereignAI that are not sovereign yet:
The database is not encrypted at rest; the honest answer today is full-disk encryption. The model layer is borrowed — even open weights are someone else's artifact, trained on data nobody can audit. A rented GPU is tenancy, and we print that before you provision. An unknown is reported as unknown, never rounded up to a feature.
Counterintuitively, the ability to leave is the strongest reason to trust a product like this. That has not changed this week. It just got a better week of company.
Your models. Your memory. Your machine.
The open trial is one Docker command — the real product, no account. The ledger lists what we cannot claim.
Sources
- Perplexity Portable Computer — Perplexity's announcement, product page (install commands, model sizes and RAM, Pro and Max), and research post (the PII classifier, the context shown before escalation, every benchmark figure quoted here); NVIDIA's local AI blog (GeForce RTX and RTX PRO support "coming soon"). Coverage: VentureBeat (the 24 GB RTX floor and the advanced-mode endpoint, from interviews), Moor Insights & Strategy, Tom's Guide.
- FreeToken — FlashML-org/FreeToken.
- Nemotron 3.5 Lightning — model card; Ollama library.
- Qwen3.8-27B — model card; Ollama library.
- Pipette — pipette.liquid.ai; pipette-clients.
- local.ai — local.ai, about.
- Our own claims — the Sovereignty Ledger and the FAQ. Where this post says "today's build", it means the release deployed alongside it.