← DAK · Read before you buy

What a local model is good at, and what it isn't

An honest list, so you know what you're buying before you buy it.

Open models have improved quickly. The ones that fit on an office machine today handle work that needed the biggest cloud models two years ago. They're still not the same as the largest models running in a data center, and we'd rather you hear that from us.

Where local models do well: drafting and rewriting letters, emails and reports. Summarising long documents. Translating between Arabic, French and English. Answering questions from your own files, with the source shown. Reading scanned documents and pulling out tables. Transcribing meetings. Filling forms and running routine multi-step jobs. For these, most staff won't notice a difference in quality, and they'll notice the speed.

Where the cloud is still ahead: the hardest reasoning problems, very long chains of steps where one mistake spoils the result, and work that needs current information from the internet. If your firm depends on these daily, a local box alone isn't enough, and we'll say so.

Memory is the other limit. A box is built with a fixed amount, and that sets the size of the models it can run and how many people it can serve at once. We size the machine for your headcount and the next two years, and we put that sizing in writing.

Finally, a model is only as useful as what it can see. Search over your documents works when the documents are organised and readable. Part of our setup is getting them that way, and it's often the part that makes the biggest difference.

The practical answer for most offices is local by default, cloud by exception. Sensitive and everyday work runs on the box. The few jobs that truly need the cloud go there, on purpose.

Keep reading

Tell us about your office.

Headcount, the kind of files you handle and what you'd like it to do. We reply within a business day with a first recommendation.

Request a quote →