<- Back
Comments (46)
- gherkinnnNow this is a development I like.With the Claude bug, or so it is known, burning through tokens at record speed, I gave alternative models a try and they're mostly ... interchangeable. I don't know how easy switching and low brand loyalty and fast markets will play out. I hope that local LLMs will become very viable very soon.
- convexlyI like the approach of running everything locally. I'm strongly of the opinion that the privacy angle for local models is going to keep getting stronger and more relevant. The amount of articles that come out about accidents happening because of people handing too much context to cloud models the more self reinforcing this will become.
- briansI’ve seen several projects like this that offer a network server with access to these Apple models. The danger is when they expose that, even on a loop port, to every other application on your system, including the browser. Random webpages are now shipping with JavaScript that will post to that port. Same-origin restrictions will stop data flow back to the webpage, but that doesn’t stop them from issuing commands to make changes.Some such projects use CORS to allow read back as well. I haven’t read Apfel’s code yet, but I’m registering the experiment before performing it.
- mattkevanAs an experiment I built a prototype chatbot app that uses the built-in LLM. It’s got a small context window, but is surprisingly capable and has tool-calling support. Without too much effort I was able to get it to fetch weather data, fetch and summarise emails, read and write reminders and calendar events.
- nottorp> Starting with macOS 26 (Tahoe), every Apple Silicon Mac includes a language model as part of Apple Intelligence.So you have to put up with the low contrast buggy UI to use that.
- VanTodiJust a small thing about the website: your examples shift all the elements below it on mobile when changing, making it jump randomly when trying to read.
- nose-wuzzy-padDoes the local LLM have access to personal information from the Apple account associated with the logged-in user? Maybe through a RAG pipeline or similar? Just curious if there are any risks associated with exposing this in a way that could be exploited via CORS or through another rogue app querying it locally.
- arendtioFor those who don't know, 'Apfel' is the German word for Apple.
- alwinaugustinRead Austria as Australia and thought this as an April fool
- m-s-yA serious project would do the work to be delivered via the native homebrew repository, not a “selfhosted” one.
- khalicAFM models are very impressive, but they’re not made for conversation, so keep your expectations down in chat mode.
- swiftcoderAnyone tried using this as a sub-agent for a more capable model like Claude/Codex?
- phplovesongThis is pretty cool. My bet is that we have more LLMs running locally when its possible, either thru "better hardware as default" or some new tech that can run the models on commodity hardware (like apple silicon / equivalent PC setup).
- OrasI like the idea and the clarity to explain the usage, my question would be: what kind of tasks it would be useful for?
- elcritchAny know if these only installed on Tahoe? I'm running Sequoia still and get an error about model not found.
- gigatexalIt’s a very small model but I’ve been playing with it for some time now I’m impressed. Have we been sleeping on Apple’s models?Imagine they baked Qwen 3.5 level stuff into the OS. Wow that’d be cool.
- p1anecrazyReally like demo cli tools description. Are they limited by the context window as well? What’s your experience with log file sizes?
- brtkwr[dead]
- 3yr-i-frew-up[dead]
- anonundefined
- anonundefined
- Remi_Etien[dead]
- skrun_devNotes.app handles big notebooks without choking on storage?
- ramon156Cool tool but I don't get why these websites make idiotic claims> $0 costNo kidding.Why not just link the GH Github: https://github.com/Arthur-Ficial/apfel