HN

Need help?
<- Back
Garage – An S3 object store so reliable you can run it outside datacenters

Garage – An S3 object store so reliable you can run it outside datacenters

ibobev

Comments (126)

  • adamcharnock
    Copy/paste from a previous thread [0]:We’ve done some fairly extensive testing internally recently and found that Garage is somewhat easier to deploy in comparison to our existing use of MinIO, but is not as performant at high speeds. IIRC we could push about 5 gigabits of (not small) GET requests out of it, but something blocked it from reaching the 20-25 gigabits (on a 25g NIC) that MinIO could reach (also 50k STAT requests/s, over 10 nodes)I don’t begrudge it that. I get the impression that Garage isn’t necessarily focussed on this kind of use case.---In addition:Next time we come to this we are going to look at RustFS [1], as well as Ceph/Rook [2].We can see we're going to have to move away from MinIO in the foreseeable future. My hope is that the alternatives get a boost of interest given the direction MinIO is now taking.[0]: https://news.ycombinator.com/item?id=46140342[1]: https://rustfs.com/[2]: https://rook.io/
  • fabian2k
    Looks interesting for something like local development. I don't intend to run production object storage myself, but some of the stuff in the guide to the production setup (https://garagehq.deuxfleurs.fr/documentation/cookbook/real-w...) would scare me a bit:> For the metadata storage, Garage does not do checksumming and integrity verification on its own, so it is better to use a robust filesystem such as BTRFS or ZFS. Users have reported that when using the LMDB database engine (the default), database files have a tendency of becoming corrupted after an unclean shutdown (e.g. a power outage), so you should take regular snapshots to be able to recover from such a situation.It seems like you can also use SQLite, but a default database that isn't robust against power failure or crashes seems suprising to me.
  • SomaticPirate
    Seeing a ton of adoption of this after the Minio debaclehttps://www.repoflow.io/blog/benchmarking-self-hosted-s3-com... was useful.RustFS also looks interesting but for entirely non-technical reasons we had to exclude it.Anyone have any advice for swapping this in for Minio?
  • thhck
    BTW https://deuxfleurs.fr/ is one of the most beautiful website I have ever seen
  • topspin
    No tags on objects.Garage looks really nice: I've evaluated it with test code and benchmarks and it looks like a winner. Also, very straightforward deployment (self contained executable) and good docs.But no tags on objects is a pretty big gap, and I had to shelve it. If Garage folk see this: please think on this. You obviously have the talent to make a killer application, but tags are table stakes in the "cloud" API world.
  • ai-christianson
    I love garage. I think it has applications beyond the standard self host s3 alternative.It's a really cool system for hyper converged architecture where storage requests can pull data from the local machine and only hit the network when needed.
  • Powdering7082
    No erasure coding seems like a pretty big loss in terms of how much resources do you need to get good resiliency & efficiency
  • faizshah
    One really useful usecase for Garage for me has been data engineering scripts. I can just use the S3 integration that every tool has to dump to garage and then I can more easily scale up to cloud later.
  • eduardogarza
    I use this for booting up S3-compatible buckets for local development and testing -- paired up with s5cmd, I can seed 15GB and over 60,000 items (seed/mock data) in < 60s... have a perfect replica of a staging environment with Docker containers (api, db, cache, objects) all up in less than 2mins. Super simple to set up for my case and been working great.Previously I used LocalStack S3 but ultimately didn't like the lack of persistance thats not available on the OSS verison. MinIO OSS is apparently no longer maintained? Also looked at SeaweedFS and RustFS but from a quick reading into them this once was the easiest to set up.
  • supernes
    I tried it recently. Uploaded around 300 documents (1GB) and then went to delete them. Maybe my client was buggy, because the S3 service inside the container crashed and couldn't recover - I had to restart it. It's a really cool project, but I wouldn't really call it "reliable" from my experience.
  • JonChesterfield
    Corrupts data on power loss according to their own docs. Like what you get outside of data centers. Not reliable then.
  • tenacious_tuna
    Anyone know if it's possible to bandwidth-limit the sync operations? I'd love to set up garage instances across my families' houses to act as a distributed backup, but I don't want to hose their (or my) down/uplink during awake hours. Having redundant selfhosted S3like storage would solve many problems for me, but I really need that capability.
  • awoimbee
    How is garage for a simple local dev env ? I recently used seaweedfs since they have a super simple minimal setup compared to garage which seemed to require a config file just to get started.
  • BOOSTERHIDROGEN
    I use juicefs
  • anon
    undefined
  • apawloski
    Is it the same consistency model as S3? I couldn't see anything about it in their docs.
  • wyattjoh
    Wasn't expecting to see it hosted on forgejo. Kind of a breath of fresh air to be honest.
  • agwa
    Does this support conditional PUT (If-Match / If-None-Match)?
  • anon
    undefined
  • yupyupyups
    Garage is amazing! But it would be even more amazing if it had immutable object support. :)This is used for ransomware resistant backups.
  • k__
    Half-OT:Does anyone know a good open source S3 alternarive that's easily extendable with custom storage backends?For example, AWS offers IA and Glacier in addition to the defaults.
  • allanrbo
    I use Syncthing a lot. Is Garage only really useful if you specifically want to expose an S3 drop in compatible API, or does it also provide other benefits over syncthing?
  • Eikon
    Unfortunately, this doesn’t support conditional writes through if-match and if-none-match [0] and thus is not compatible with ZeroFS [1].[0] https://git.deuxfleurs.fr/Deuxfleurs/garage/issues/1052[1] https://github.com/Barre/ZeroFS
  • ekjhgkejhgk
    Anybody understand how this compares with Vast?
  • doctorpangloss
  • anon
    undefined