HN

Comments (18)

• mschwaig
  I've been thinking if this could be done in Nix and toyed around with the idea just a little bit using nano-gpt.Hermeticity always seems to mean isolation, but depending on who you ask it does not always mean computing some sort of hash over all build input as the 'identity' of a particular step in the pipeline, like Nix does.If you do that hash-based identity part, looking up intermediary results and resuming from there happens using this sort of hash.Does savanah do that, or will it resume where it left off based on a less strict notion of identity?I could see arguments for either approach.
• michaelchicory
  Author here, happy to answer any questions!
• Menu

  delichon
  Some good stuff here from Dwarkesh around mashing up training and inference:https://youtu.be/20p5-kQXF_Q?is=72ImTNxkOEKmOXQ9He predicts this kind of model factory will become central to organizational learning and operations. Updating and upgrading the model stack becomes the core staff function.
• virajk_31
  I doubt if anything can really solve "oops"
• Menu

  SpyCoder77
  What is this "aleph" thing in names now? First aleph neuro, and now aleph alpha.
• Menu

  random3
  > TL;DR: Model training has grown complexSo they’ve built Savanah - a workflow engine because the existing zoo of hundreds of workflow engines didn’t cut it :)
• modgate
  [flagged]