Need help?
<- Back

Comments (41)

  • fulafel
    > Apple Silicon changes the physics. The CPU and GPU share the same physical memory (Apple's Unified Memory Architecture) ... no bus!Beware the reality distortion field: This is of course how it's worked on most x86 machines for a long time. And also on most Macs when they were using Intel chips.
  • saagarjha
    I'm curious what this offers over just building the host side code to be native?
  • nl
    I'm pretty sure this is just "yes (parts of), memory control in WASM works"[1].The whole Apple Silicon thing is (in this case) just added details that don't actually matter.[1] https://github.com/WebAssembly/memory-control/blob/main/prop...
  • itamos
    On one side it sounds promising to exploit shared memory properties to speed up inference. But on the other hand, the well established inference engines are perhaps already well optimized to overlap compute and communication efficiently. In this case the host-device copies are likely not a problem to tackle.
  • trueno
    > on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffersenhance> no copies, no serialization, no intermediate bufferswould it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bonkers.
  • jedisct1
    Doesn't work on web browsers, only with one headless runtime, one one CPU architecture. What's even the point of using webassembly here?
  • wmf
    This works in wasmtime not browsers.
  • pjmlp
    Goodbye WebAssembly "security".Also, these folks should be amazed by 8 and 16 bit games development, or games consoles in general.
  • adamsilvacons
    [dead]
  • EthanFrostHI
    [flagged]