HN

Need help?
<- Back
Inside The Internet Archive's Infrastructure

Inside The Internet Archive's Infrastructure

dvrp

Comments (62)

  • hedora
    It's frustrating that there's no way for people to (selectively) mirror the Internet Archive. $25-30M per year is a lot for a non-profit, but it's nothing for government agencies, or private corporations building Gen AI models.I suspect having a few different teams competing (for funding) to provide mirrors would rapidly reduce the hardware cost too.The density + power dissipation numbers quoted are extremely poor compared to enterprise storage. Hardware costs for the enterprise systems are also well below AWS (even assuming a short 5 year depreciation cycle on the enterprise boxes). Neither this article nor the vendors publish enough pricing information to do a thorough total cost of ownership analysis, but I can imagine someone the size of IA would not be paying normal margins to their vendors.
  • BryantD
    They have come a very long way since the late 1990s when I was working there as a sysadmin and the data center was a couple of racks plus a tape robot in a back room of the Presidio office with an alarmingly slanted floor. The tape robot vendor had to come out and recalibrate the tape drives more often than I might have wanted.
  • mcpar-land
    Is this some kind of copypasted AI output? There are unformatted footnote numbers at the end of many sentences.
  • rarisma
    I think this was writen wholly by deep research.It just reads like a clunky low quality article
  • semiquaver
    This article is way too LLMey for my taste.
  • bpiche
    IA is hosting a couple more of Rick Prelinger’s shows this month. Looking forward to visiting
  • ghm2199
    Does any one know how the size of this compares to archive.today?
  • vladiim
    How long will it take for them to send the PetaBox to space?
  • brcmthrowaway
    Does IA do deduplication?
  • schmuckonwheels
    Disappointed with the lack of pictures.
  • brcmthrowaway
    [flagged]
  • krunck
    [flagged]
  • lysace
    The IA needs perhaps not just more money, but also more talented people, IMO. I worry that it has stagnated, from a tech pov.
  • cowhax
    >And the rising popularity of generative AI adds yet another unpredictable dimension to the future survival of the public domain archive.I'd say the nonprofit has found itself a profitable reason for its existence