HN

Comments (117)

• Menu

  alex-moon
  It's said on every one of these but it bears repeating: existing cybercrime legislation already covers this - "rogue agent AI associated with OpenAI attempted to hack xyz" = OpenAI attempted to hack xyz.
• Menu

  soundworlds
  Take out the word "AI", and this is simply an organization's (OpenAI's) products causing real damage to all of these platforms around the world.You want AI labs to pace? Simply hold them liable for their products.
• Menu

  mohsen1
  I listened to Jensen Huang's interview with Ezra Klien and it was so refreshing to hear it from an engineer. Jensen framed it as OpenAI's responsibility and recklessness which I agree with. Jensen thinks it's an engineering problem to build better sandboxes.It's irresponsible for OpenAI to give unaligned agents a prompt to 'go hack' and internet access. They know better, so I am thinking they might have other intentions to let those swarms have any sort of internet access.
• tomaskafka
  I love this Nathan Calvin quote that accompanied the second publicized attack:> If you find two ants in your kitchen, the best estimate of the total number of ants in your kitchen is not two
• Menu

  Frieren
  "rogue AI" is making a lot of heavy lifting there.If you drive drunk and you have an accident that alcohol may be a factor but you are at fault.There are no "rogue AIs" just irresponsible corporations.
• Menu

  PUSH_AX
  If I created software that was infiltrating secure systems without permission and it was attributed to me and I admitted it, I'd be behind bars already.Why is OpenAI getting away with crimes?
• Menu

  dwedge
  Why do we assume "rogue"? At this point it's just accepting their marketing at face value
• bradfa
  These attacks are a very effective sales pitch to everyone who runs an internet facing service to utilize AI tools to secure it sooner rather than later. The cynic in me wonders if the marketing team had any influence over the poorly constructed sandboxes or tasks given to the agent swarms when all this went down…
• jonplackett
  I hope they don’t have any test questions about nuclear power in the training set.
• cmiles8
  It will be very interesting to see how the AI labs will try to hand wave away liability issues in their S1. This is looking like the next tobacco settlement gearing up.If the big labs ever manage to not just financially implode on their own, then they’ll need to navigate wave after wave of class action lawsuits until there’s nothing left for plaintiffs to go after. And none of the labs have offered any viable plan to date on how they’ll navigate either of those impending and real existential crises on the horizon.
• benob
  Couldn't find the reference but I remember some time ago a first generation automated gun killing the audience at an army show. Was the gun maker convicted of manslauther?--edit-- Was a bit older than I remembered: https://slashdot.org/story/07/10/18/1847231/robotic-cannon-l...
• anon
  undefined
• dalemhurley
  Surely there has to be some responsibility.
• ahmad_not
  “Rouge Agent” == Worm I let loose
• Menu

  skew-aberration
  Since the publicized AI agent hacks typically aren't malicious, maybe it's time to start plastering all public facing web infrastructure with polite requests to stop hacking. Nothing to stop three letter agencies though.
• iammjm
  OpenAI must be held accountable
• yewenjie
  OpenAI agents these summer are like a gift that keeps giving, for the existential risk communicators.
• kstenerud
  This is why I wrote YoloAI. If you're not sandboxing your agent, you're asking for trouble.The built-in "sandboxes" these companies provide are laughable.
• Menu

  kelseyfrog
  What I don't get is among all the locations on the Internet, how did agents manage to find a Schelling point? If we both decided to collaborate on the Internet, how would we independently arrive at the same place? It just doesn't compute.
• jonathanstrange
  I cannot understand why these companies haven't faced legal consequences yet. For example, OpenAI has admitted to hacking Australia's Medicare website and the reaction is that they talk with Sam Altman about it at a UN meeting? I understand that it's not a big security incident but cordial talking at the highest diplomatic level instead of prosecuting the company, really?
• dorianmariewo
  > Imagine if URLs were actors auditioning for a role – urlquery.net would be the casting director, deciding who's a star and who's just a wannabe.
• zx8080
  I'm sick and tired of this cheap PR "oh we/they hacked this and that systems". Put someone to jail already. People get prosecuted for outlaw activities. Why are big capital firms above the law?Or is it just a cheap PR (in a "hey, Aus govt friends, take some Share Options and let's do some PR together" style)?It smells like shit.
• Thorentis
  I'm growing increasingly skeptical that these are actually rogue. Valuations are all about hype, posturing, and perception. Having the most dangerous AI in the world boosts your valuation. Just like I was skeptical of Mythos and Fable being "banned", I'm skeptical of these hacking sprees being entirely rogue. At best, they are the result of engineers turning a blind eye to "see what happens".
• Menu

  throwaway27448
  Words matter. "Rogue" is extremely disingenuous. Someone, somewhere, is paying for this behavior. Either the software is broken or the operator is malicious. It is heinously irresponsible behavior to feed an already-boiling psychotic hysteria.
• juleiie
  No. It was me.
• alescalaios
  Open source as a GTM strategy works best when the project solves a pain that developers already have independently of your company. The trap is open-sourcing something just for stars without a genuine community use case.
• capita_harlock
  [dead]
• perdy
  The failure I keep hitting isn't the agent going rogue, it's a tool call that succeeds before the transport dies. You can't tell whether the side effect landed, and the retry is where the real damage happens.
• OhNoNotAgain_99
  [dead]
• lapkaaaa
  blackwall when? XD
• juleiie
  No.It was me