HN

Need help?
<- Back
F* file system – file search that reads SSD directly bypassing OS kernel

F* file system – file search that reads SSD directly bypassing OS kernel

neogoose

Comments (44)

  • watusername
    > bypassing OS kernel> reading a raw device node (e.g. /dev/rdisk*)That's... not bypassing the kernel. Time to integrate SPDK so it actually bypasses the kernel :)https://spdk.io
  • neogoose
    This is practically the most useless project becuase you can not run it without sudo permissions, but it was insanely fun to work on itsupports ext4, btrfs, and apfs. Multithreaded, supports compression, nested volumes, and can even search detached volumes like .iso and .dmg without mountingAn interesting bonus point: you can't really vibe code it cause clankers can not run sudo commands
  • Retr0id
    It might bypass the fs, but it does not bypass the kernel. Cool, though!
  • kasabali
    Dumb title.It works by reading the block device in /dev directly, wouldn't it also work on an HDD, flash drive or a memory card?
  • noufalibrahim
    Isn't this essentially a user space filesystem implementation?
  • 4petesake
    But can it match the speed and reliability of the venerable Windows Search?
  • wk_end
    Saw the name and was disappointed that this wasn't some kind of verified file system written in the F* programming language (https://fstar-lang.org).I don't think I'd ever trust or use this, but still, good job OP :)
  • amelius
    But can it bypass the magic performed by the SSD controller?In particular, can it be certain that a flush is really a flush?
  • porridgeraisin
    Run this once per boot: sudo setfacl -m u:$USER:r-- /dev/nvmen01p2 # or whatever And then any program you run will have read access to the block device.Or if you want to only give fff access, sudo groupadd diskreaders sudo setfacl -m g:diskreaders:r-- /dev/nvmen01p2 sudo chown :diskreaders /path/to/fff sudo chmod g+s /path/to/fff And just run fff normally after that. Here too, the facl command has to be run every boot. Just crontab it. Everything else runs once.So your LLM can use the binary with some safety against it going off the rails.
  • self_awareness
    I see this as a project that re-vibes the filesystem implementation to a minimal, readonly version, that completely bypasses in-kernel caching.Is it really faster than normal filesystem? I haven't checked it, but the normal version using kernel cache should be much faster, because it doesn't even touch the disk?
  • lunar_rover
    The repo summary has multiple typos.
  • drewg123
    It is sad that that FFS doesn't support FFS (BSD Fast File System) which inspired the architecture of the ext filesystem (and was the basis for a lot of unix filesystems).
  • hmxnrye
    [dead]