HN

Comments (87)

• Menu

  Animats
  Not learning from new input may be a feature. Back in 2016 Microsoft launched one that did, and after one day of talking on Twitter it sounded like 4chan.[1] If all input is believed equally, there's a problem.Today's locked-down pre-trained models at least have some consistency.[1] https://www.bbc.com/news/technology-35890188
• Menu

  zhangchen
  Has anyone tried implementing something like System M's meta-control switching in practice? Curious how you'd handle the reward signal for deciding when to switch between observation and active exploration without it collapsing into one mode.
• Garlef
  I think restrcicting this discussion to LLMs - as it is often done - misses the point: LLMs + harnesses can actually learn.That's why I think the term "system" as used in the paper is much better.
• Menu

  aanet
  by Emmanuel Dupoux, Yann LeCun, Jitendra Malik"he proposed framework integrates learning from observation (System A) and learning from active behavior (System B) while flexibly switching between these learning modes as a function of internally generated meta-control signals (System M). We discuss how this could be built by taking inspiration on how organisms adapt to real-world, dynamic environments across evolutionary and developmental timescales. "
• Menu

  krinne
  But doesnt existing AI systems already learn in some way ? Like the training steps are actually the AI learning already. If you have your training material being setup by something like claude code, then it kind of is already autonomous learning.
• Menu

  utopiah
  I remember a joke from few years ago that was showing an "AI" that was "learning" on its "own" which meant periodically starting from scratch with a new training set curated by a large team of researchers themselves relying on huge teams (far away) of annotators.TL;DR: depends where you defined the boundaries of your "system".
• est
  "don't learn" might be a good feature from a business point of viewImagine if AI learns all your source code and apply them to your competitor /facepalm
• beernet
  The paper's critique of the 'data wall' and language-centrism is spot on. We’ve been treating AI training like an assembly line where the machine is passive, and then we wonder why it fails in non-stationary environments. It’s the ultimate 'padded room' architecture: the model is isolated from reality and relies on human-curated data to even function.The proposed System M (Meta-control) is a nice theoretical fix, but the implementation is where the wheels usually come off. Integrating observation (A) and action (B) sounds great until the agent starts hallucinating its own feedback loops. Unless we can move away from this 'outsourced learning' where humans have to fix every domain mismatch, we're just building increasingly expensive parrots. I’m skeptical if 'bilevel optimization' is enough to bridge that gap or if we’re just adding another layer of complexity to a fundamentally limited transformer architecture.
• logicchains
  There's already a model capable of autonomous learning on the small scale, just nobody's tried to scale it up yet: https://arxiv.org/abs/2202.05780
• shevy-java
  The whole AI field is a misnomer. It stole so much from neurobiology.However had, there will come a time when AI will really learn. My prediction is that it will come with a different hardware; you already see huge strides here with regards to synthetic biology. While this focuses more on biology still, you'll eventually see a bridging effort; cyborg novels paved the way. Once you have real hardware that can learn, you'll also have real intelligence in AI too.
• Menu

  tranchms
  We are rediscovering Cybernetics
• Menu

  himata4113
  Eh, honestly? We're not that far away from models training themselves (opus 4.6 and codex 5.3 were both 'instrumental' in training themselves).They're capable enough to put themselves in a loop and create improvement which often includes processing new learnings from bruteforcing. It's not in real-time, but that probably a good thing if anyone remembers microsofts twitter attempt.
• Menu

  jdkee
  LeCun has been talking about his JEPA models for awhile.https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa/
• followin_io82
  good read. thanks for sharing
• Menu

  lock-locku
  [dead]
• theLewisLu
  [dead]
• Menu

  seedpi
  [flagged]
• Frannky
  Can I run it?
• lovebite4u_ai
  claude is learning very fast