HN

Need help?
<- Back
Perplexity Decider v1.3: Training, eval, and use cases

Perplexity Decider v1.3: Training, eval, and use cases

gmays

Comments (21)

  • 0o777
  • waximabbax
    Well congrats.Here are some thoughts not facts:On AA Decision Index.Decider v1.3 and Decider v.1.2 seem to have same benchmarks. However, V1.3 flash beats V1.2 flash by 4 points.I am not particulary excited about this pattern/trend of having flash versions for decision models. The whole point of Decision models was to deliver faster ouput for high volume requests at much cheaper cost than Reasoning models. Since most reasoning models can and probably do outperform decision models already in accuracy but they are a lot slower and are pricier. Reasoning Models can already return structured ouput.So your flagship model must be fastest and most accurate.Unless it can handle some different form of input other than just image and text, I don't see the point of having both flagship and flash version for the same model.
  • senjin
    Perplexity Decider is my favorite of these new decision models but this version is a step back in my benchmark for my use case. The decision index benchmark[1] actually agrees with this and makes me think I should look at a higher ranked modelhttps://huggingface.co/spaces/multimodalart/jev-decision-ind...
  • nchmy
    Because of this post, i discovered and dug into various decider and other models. The "locate" mechanism in Decider 1.3 seems to have an equivalent in Clairic from cloudflare and Extract from ScaleDown. I'm particularly impressed with scaledown for my use case - much cheaper and more accurate than the others.https://scaledown.aihttps://blog.cloudflare.com/clairic-extraction-model/https://blog.cloudflare.com/clef-decision-models/
  • stri8ted
    It performs well on my local benchmark, and is priced competitively. Good timing too, considering that inception Labs is discontinuing their Mercury models API, which I was previously using. It seems plausible that the bidirectional attention performs better for decision models.
  • redanddead
    Complete lack of creativity in the field of AI...Here's new product, which is just our shitty version of this easily reproducible technologyWhat is this?Same for Google and their decisions api
  • jstummbillig
    Any ideas what decider models are actually good? There does not seem to be a strong competitive benchmark culture (as with LLMs) for whatever reason?
  • k__
    Does anyone really use such things for security?
  • theropost
    [flagged]
  • omegaSigma95
    [flagged]