This seems to be the demo:<a href="https:&#x2F;&#x2F;chat.webllm.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;chat.webllm.ai&#x2F;</a>I am getting:<pre><code> WebGPUNotAvailableError: WebGPU is not supported in
 your current environment, but it is necessary to
 run the WebLLM engine.
</code></pre>
On both, FireFox and Chromium on Linux.

I really enjoy this engine. I’ve used it for personal projects, but it hasn’t been updated since Gemma 2. I suggest using Transformers.js instead these days.

You might like webml-kit <a href="https:&#x2F;&#x2F;npm.im&#x2F;webml-kit" rel="nofollow">https:&#x2F;&#x2F;npm.im&#x2F;webml-kit</a>

Project is de facto dead, used it for many years and had to rip it out 6 months ago, don&#x27;t waste your time.

Bake me a cakeresponds with&gt; Error: Cannot initialize runtime because of requested maxStorageBuffersPerShaderStage exceeds limit. requested=10, limit=9.

A WebX technology that actually involves browsers!

HN

WebLLM: high-performance in-browser LLM inference engine

Comments (16)