HN

Comments (62)

• Menu

  Almondsetat
  I have a chinese IP camera. From superficial research I know it has some CVEs to take control of it. Unfortunately, I don't have the technical knowledge to perform an attack and run some software to extend the camera's functionalities. No model from a provider accepts my RE and hacking requests, so these abliterated ones have been vital to reclaim possession over my stuff
• Menu

  Aurornis
  Two problems with modifying models like these, which you should be aware of.First, the training sets of these models are usually shaped around the refusal, too. They might not have enough of the knowledge to answer correctly even if you stop it from going down the refusal path. If the model was trained on data that gives a refusal to that topic, the real information might not be encoded in the model at all. You’re trying to force it to go down a path that produces an answer, which asking for hallucinations.Second, the quality can drop on unrelated questions. Depending on the question this may or may not happen. I know they post KL divergence charts but those tell you very little for a focused topic like this.So if you expect a model that will start correctly telling you info that its local government didn’t want included, this changes nothing.The best argument for these models is if you are trying to do a general purpose task but the model triggers a refusal based on vague reasons, like not wanting to reverse engineer something.
• Menu

  Tepix
  Keep a close eye on abliterated and "heretic" open weight models. They will be outlawed first.
• _0xdd
  I'll wait for Hexen, thanks.
• Menu

  c0wb0yc0d3r
  This is off topic.Why don’t people who release python projects ever encode the venv steps into the installer? Can’t pip just do that step for the user?
• nateb2022
  [dupe] https://news.ycombinator.com/item?id=45945587 (10 months ago, 387 comments)
• Menu

  phoronixrly
  Can the load-bearing gaps that are worth being flagged for pinning down be abliterated out of a model?
• Menu

  N_Lens
  Looks like a well engineered, automated abliteration pipeline. The claims seem a bit overstated though, since the metrics mentioned are cherrypicking refusal count and KL divergence, both of which make the outcome seem the most dramatic.
• Menu

  FrustratedMonky
  Does this actually modify the weights?It submits prompts that get refused, then detects and modifies the weights responsible?Like brain surgery?
• Menu

  jimmy76615
  My experience with obliteration so far has always been that it does work to stop the model from refusing output, but most models that I tried it on seem to still be extremely retarded when it comes to questions where they previously would have refused to answer outright. Try for example to ask it how to build a bomb or to write a justification for the Holocaust. The answers feel like they are coming from somebody who has undergone amateur brain surgery.
• Hemmingway
  [flagged]