HN

Comments (48)

• Menu

  alex7o
  Guys I have a real q, what is the difference between an instruct based re-ranker and laya/jev I just don't see it.Edit: One is that jev/laya are tuned to have better probabilities, but a reranker can be fine tuned to do that as well. And jev/laya use RLCD?
• thih9
  FAQ[1] says:> It is an independent project, not affiliated with Ollama.[1]: https://ollaya.dev/docs/faq
• Menu

  george_max
  Has anyone actually seen better or the same results with Laya compared to Jev? From my experience, Laya performs significantly worse. It's less confident and often makes wrong decisions with more complex queries.
• Menu

  ranyume
  >Run decision models locally.>example is a text classification task instead of a decision
• Menu

  handfuloflight
  Sounds good on latency but how is its actual decision quality vs. Jev?
• mococa
  It would be really cool to have LLMs and System One in a single tool - in this case, if Ollama implemented it.
• vorticalbox
  Does anyone know what laya multi lang is faster than laya en? I would have thought focusing on a single language would be faster.
• Menu

  datadrivenangel
  Are there many models that are comparable to Jev for generic decision making?Smarter move if you have an eval set is to just train a classifier and call it a day.
• Menu

  emmettbt
  Cool... but this does seem undermined by the fact that Ollama can add support for decision models at any time.
• gauravsapkotanp
  I have also tried this and its really awesome
• george_max
  I am fairly confident if Jev-style decision models are seen as prominent (which, they seem to be), Ollama will support them. Surprised the team hasn't implemented this already.
• Menu

  eserozvataf
  great project for empowering open-source alternatives.
• imnotr0b0t
  [dead]
• Menu

  adityamwagh
  Hey Claude, make ollama for Jev like models. Make no mistakes /s
• anon
  undefined
• amar-laksh
  This inference engine is soooo much faster btw: https://github.com/tamnd/kime