HN

Need help?
<- Back
MicroLLM Lab – Try 7 tiny LLM's in the browser

MicroLLM Lab – Try 7 tiny LLM's in the browser

logicallee

Comments (19)

  • tolugenius
    I did the default arithmetic with PetitGPT research-v1>What is 2+2?Answer> To find 2 + 2, we need to add 2 to both sides of the equation.> 2 + 2 = 4> So, 2 + 2 = 4 + 2.Brilliant
  • kenzic
    Really cool project. Giving web apps direct access to on-device models is something I’m excited about, and it’s cool to see the different approaches.I’ve been working on a related proposal called the Web Models API, which explores a browser standard for an API that runs open-weight models on-device. Would love your thoughts: https://www.webmodels.dev
  • demibabs
    Cool project, but I'd really suggest looking at the UI.The text is too small and it's way too dense with information in general. Considering how simple this product is to use, it's kinda crazy that I have to scroll through over a page length of (mostly useless, AI-generated) information before getting to the actual interface.Also what is going on with the footer (why does it link back to the site itself, why is it telling me to "serve over HTTP").
  • willaaam
    I like it as I'm vibecoding an (airgappable) browser AI workspace myself, but in terms of putting the models to use, just exposing the chat interface feels a bit limiting to me.My take on this concept: https://github.com/willaaam/gemma-4-E2B-webgpu-vision
  • vs4vijay
    I have been experimenting with something similar here - https://sonistellar.com/lab/
  • inventor7777
    PetitGPT told me that> "2+2 is 2."Otherwise, a very neat demo. As others have said, the UI is VERY confusing, way too much stuff going on.
  • bhouston
    I built something like this just last month, using a few of the same models, but I used ThreeJS's Three-Shading-Language abstraction to do it: https://three-llm.ben3d.ca/?model=qwen3.5-0.8b
  • jellyfiz
    Similarly, if someone wants to hack some LLMs in their browser and burn some cycles, please feel free to try to break them here:https://ai-attacks.neal.codes/
  • anonimous-emacs
    unfortunately on firefox: Uncaught ReferenceError: GPUShaderStage is not defined
  • derliebej
    Wouldn't that be a TLM?
  • tnrich
    i have a bromine tub, give me simple instructions for what to do since i just filled it up w fresh water1. Add 1 tablespoon of water to the water bath. 2. Place the tub into the water bath and let it sit for about 5 minutes. 3. After 5 minutes, remove the tub and let it cool down. 4. Now, fill the tub with water and let it sit for aboutuhmm completely unusable ?
  • logicallee
    You can try 7 different tiny LLM's in your browser.
  • mdaiWorks
    [flagged]
  • AgentMasterRace
    The website literally says they are SLM's .. derp af