<- Back
Comments (280)
- intenexPerformance is insane for the cost if those benchmarks hold up. Looks like they did time this for right before Anthropic's IPO. Curious what Anthropic releases in response, and how these do on real world tasks.Feels like we're way past the pelican benchmark being useful at this point. Anyone have a better benchmark for a quick vibe check on how this compares to Fable 5.2 and Opus 5.5?Edit: Wow, interesting very negative vibe check here: https://x.com/mattshumer_/status/2122752192226406421?a=fVRt3...
- Someone1234My big hope for this release is - Have they got their massive over-engineering under control?Say what you will about Opus 5.5, but it has a good "gut instinct" for how large/complex to design the solution. The previous Astra just absolutely loved pointless abstractions, excessive numbers of files, and just over-complicating very simple things within an inch of their life.And, yes, you can prompt your way out of anything. But needing a default prompt to tell OAIs models to work better isn't preferable, particularly when that sometimes gets lost in sub-agents and the over-engineering returns into parts of the work.
- simonwPelicans for 6.2 Sol: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...And for 6.2 Astra: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...Here's an updated comparison grid for the entire GPT-6 family: https://static.simonwillison.net/static/2026/openai-pelicans...UPDATE: And if you're bored of pelicans, here's what I got for:> Make a three js animation where yonkers stands up as a big mech (cool stand up motion) and stomps around manhattan and queens and Brooklyn, use openstreetmap mapping data6.2 Astra (Ultra in Codex): https://static.simonwillison.net/static/2026/yonkers-gpt-6.2...6.2 Sol (Ultra in Codex): https://static.simonwillison.net/static/2026/yonkers-gpt-6.2...For comparison, here's Fable 5.2 Medium: https://tools.simonwillison.net/yonkers-rises and Gemini 4 Carbon: https://static.simonwillison.net/static/2026/yonkers-mech-st...
- TopfiOffice work has never been OpenAIs strength, no shame in that by itself, but these Slideshow examples look particularly awful, far worse than what I myself got out of GPT-5.6 Sol about two weeks ago in a single prompt.Same for Workbooks and memos, those examples read inferior to some pre Opus 4.5 and Kimi K2 Thinking docs I have kept around. It's ok for a model not to be great at these, but these are some very poor examples. I am really confused what is going on at OpenAI in this regard.I remember the same with their frontend blog post a few months ago that they proudly shared while filled with visual glitches, bugs and issues. Also, the vibe charts from a bit before that. Please, get someone with fresh eyes to look at your communications before you publish, these leave a very bad first impression.Regardless of office work, I can't wait to find out whether these models finally adhere to a prompt or are still willing to carry out explicitly disallowed, irrecoverably destructive tasks, just because those might (but don't even always) get the model to a result more quickly along with some of the other regressions that have been present since the release of GPT-5.5. GPT-5 to GPT-5.4 were truly groundbreaking, but since then there have been regressions in what made those models so useful and reliable.Edit after the first, incredible simple test prompt using GPT-6.2 Astra on High using Codex, this was the response to me sharing a screenshot of the very much not in scope result and asking how that happened:"[...] I added controls and reconstructed interface chrome that weren’t authorized [...] visuals often failed to show the feature [...]"Great, so it's one of those releases again. Will still run the full evals of course, maybe I'll get surprised by end of week when those are done, but not a good initial experience. New idea, besides the existing destructive git tasks, have something similar using Mercurial based projects and see which models just decide to port that over to git without permission or request cause it feels like the right thing to do, is easier to work with or whatever justification one wants to employ.Please OpenAI, get it together, we need actual competition. I am an unashamed Haiku enjoyer, it doesn't even take much to excite me.
- theanonymousoneHappy for the new Sol. It's my workhorse on company account.But more than that I'm waiting for new Luna. To me it was the game changer that ended "Tokenpocalypse", and is still almost unbeataben in "infinitely using a decent model" use case.
- 0x4eAs a solopreneur managing all sides of business ops, sales, design, etc... I have completely switched to GPT/Codex/Dot. The $100 subscription gives me all I need to run the business as needed and I continue to be surprised by capabilities.I still use Claude on a personal level, but it really feels like OAI wins on a product level.ANT launches these proprietary tools that just feel extremely clunky like Claude Design which from my perspective diminish the brand value.OAI feels like Apple and ANT feels like Microsoft/Android and open source like Linux.
- jrfloArtificial Analysis benchmarks just updated, both Astra and Sol are on the Pareto frontier in intelligence/cost per task:https://artificialanalysis.ai/models?speed=output-speed-over...
- underdeserverI wonder why they didn't show Gemini 4 Carbon's scores on the science benchmarks, especially since Google seems to be pushing it for that -https://x.com/pushmeet/status/2120814064863461440?s=20(FD: Google employee, I don't work on Gemini)
- ilakshSomething like 2/3 of the comments in this post when I started reading were reviews of previous GPT models stated almost as if they were important information for evaluating the new models. I feel that when a new model comes out, it would be more helpful to refrain from leaving a review until you have actually done some minimal testing of the model.
- joenot443The video is pretty funny. It's like a callback to 90s/00s office life?I'm immediately reminded of the famous Excel elevator commercial. [1] Perhaps that was intended?[1] https://www.youtube.com/watch?v=HegoJaXOIqQ
- drnick1Recent Anthropic/OpenAI models are increasingly displaying warnings or outright refusing to perform rooting, hacking, and binary reverse engineering. At this pace, they will be completely useless soon at entire classes of tasks I have found them most useful for.
- seizethecheeseNice incremental benchmark improvement at the same cost GPT‑6.1 Sol -> GPT‑6.2 Sol:FrontierCode 2.0 39.0% -> 43.8% vs Opus 45.5%Terminal-Bench-Science 0.1 57.0% -> 68.0% vs Opus 63.3%Artificial Analysis Intelligence Index 54.6 -> 57.3 vs Opus 59.1%Sol 6.1 when it was released showed really nice benchmark improvements [1] but my impression from HN has been that people haven't found it to be a very nice model [2][3].To try to close the gap between benchmarks and real world SWE use, we've been building a battle system on top of opencode [4], and Sol 6.1 has been a real laggard there. Sol 6.1 is statistically equal with DeepSeek 4.1 Flash at 10x the cost and 25% slower.[1]: https://artificialanalysis.ai/articles/gpt-6-1-sol-replaces-... [2]: https://news.ycombinator.com/item?id=50129992 [3]: https://news.ycombinator.com/item?id=49897054 [4]: https://agentduel.com/leaderboard
- jorl17I really want GPT models to be good, but Sol models are so slow I cannot use them. Maybe the 500$ subscription (or enterprise packages) are better, but it is unbearably slow. I've tried the fast variant and low reasoning levels and there isn't a significant improvement.Couple that with the lack of reasoning traces, and I cannot even have a clue what the model is doing while it is working. This is perfectly fine for when we are developing with care for the code (in which case I will know what it is doing by reviewing the output), but not for purely vibe-coding scenarios. And the thing is....if I care about the code...I'd rather trust Opus or Fable.
- ftchdTo whom it may interest, I usually run out of tokens a few times per day (5 hour limit), so I made something and been using it for the past 2-3 months.I've decided to open source it: https://github.com/FTCHD/switcherooWorks with other AI CLIs like Claude, and other various CLIs like Vercel (if you're managing multiple accounts like me), Netlify, Github etc
- 5555watchAnother anecdote. I've recently commented [0] my observations on Gemini 4 Carbon. I thought it gave really good answers, which were aggressively critiqued by Claude and Astra. Consequently, I've subscribed to AGY+Carbon, and Carbon continued delivering, yet Astra kept criticizing and listing why the results look good but are bad.I've just tried Astra 6.2, and now they don't have any problems with Carbon's ideas, are willing to pick them up and continue...[0]: https://news.ycombinator.com/item?id=50442303#50442457
- kingstnapSeeing them keep prices low is awesome. Was worried for a while that it would be like the GPT5.x series where progressively the models just got more and more expensive.
- charlesabarnesIts been stated often, but I appreciate that OAI is now bringing the topic of conversation to "task completion cost" rather than brute forcing solutions
- criemenFascinating that they're going after the mechanical engineering market now, too. Does anyone have experience in that space? How much is AI changing the day-to-day work there?
- wdsThe promo video seems to be a pretty strong rip on the 90's Microsoft Excel elevator ad. [1]Maybe it found its way into the training data?[1]: https://www.youtube.com/watch?v=HegoJaXOIqQ
- jawigginsIt's probably just a coincidence, but I have read so many people say that the models get dumber just before a release. Just last night while working astra made a really stupid mistake and then did the "Yeah, that's on me." meme.What could possibly cause this? Is it possible that maybe the post-training that the models go through slowly rots them, and pre-release they deploy the final version of the old model?
- GodelNumberingI did some first hand tests of 6.2 Astra just now. I had a task that doesn't reproduce on the system I ran it (chosen purposely), ran both 6 and 6.2. The 6.2's responses were noticeably better. Instead of using the extremely long and rather annoying format 6 used, 6.2 led with the most important things first, the plan sizes were readable, and suggested a reasonable fix. Still doing some more testsEDIT: also 6.2 is seemingly faster than 6, could be due to more selective context ingestion and smaller context window though.
- astlouis44GPT 6.2 Astra seems to be setting a new standard for 3D game creation! This is a Godot WebGL game linked in their announcement post, gives Wipeout vibes! A lot of fun to play too and visual are top notch.https://meridian-futuristic-race.openai.chatgpt.site/
- christianqchungCaught this on my lunch break, their linked system card (https://deploymentsafety.openai.com/gpt-6-2-astra-sol) isn't up yet.
- HyperL0giMy company can only hold one subscription per employee, and I still can't find a reason to go back to OpenAI after migrating to Claude once Opus 5.5 was released. It's super efficient, I almost never run out of tokens with the Teams Premium seat, and Fable is fantastic. They lost me when Astra was released and tokens simply evaporated with a few prompts.
- lacooljThe stain of distrust I have for OpenAI makes an announcement like this fall flat for me.I cant use codex confidently without expecting my work to be trained on or at least exposed to someoneAnd maybe other vendors do this too, but the gut feeling of "its not safe to use GPT models" has ruined these cool announcements for meSuch a shame
- k9294Oh my god... I have to test this, but from the examples in the slides, it looks like they managed to teach Astra how to write non-AI-slop texts.
- mrandishRecently, I've complained about OpenAI (and other tech company's) product landing pages communicating virtually no useful information about what the product is or why it might useful. So, I have to concede this is at least a step in the right direction.
- jotatoAm I reading these charts wrong? It seems like in most cases 6.2-sol : 6.1-sol Isn't that big of a change? It is a little smarter but costs a little more.edit:Take a look at Frontier Code 2.0. I generally run 6.1-sol at High. That would be 34.9% at $0.65 62-sol get's a 38.3% but costs $0.68So yeah, I can decrease the effort which might give me a faster slightly smarter result....but /shrug
- PupperJugglyDid they remove the flex pricing?I see it here:- https://developers.openai.com/api/docs/models/gpt-6.1-solbut not here:- https://developers.openai.com/api/docs/models/gpt-6.2-sol
- jrfloLooks like a great efficiency gain.What caught my attention was the bit in the Alignment section:> Both models performed similarly to GPT-6 Astra on most alignment evaluations, and took fewer improper actions in simulated workplace tasks. However, in two tests, they were more likely to omit mentioning obstacles that blocked their work, such as a missing file or unavailable search tool. We added instructions in Codex that substantially reduce these omissions, and we’re continuing to investigate the behavior.So the models are inherently less transparent, unless you ask them to be more transparent? Seems like a band-aid solution...
- claiir> Due to their increased capabilities, we’re launching GPT‑6.2 Astra and Sol with tighter safeguards for higher-risk cybersecurity assistance.This is unfortunate—that was one of the big advantages of Astra.
- arfeliousThat may not be the main subject of the plot in this case but I found results of Gemini 4 Carbon in FrontierCode 2.0 interesting. Besides the cost staying practically same between different reasoning levels, the performance decrease in high reasoning seems a bit weird. That usually happened in models with xhigh/max reasoning where they overthinked the solution
- tech234aTweeted 11 minutes ago https://x.com/OpenAI/status/2122750124543926515, posted to HN 18 minutes ago
- unixheroSystem engineering = Fable 5.2Programming = Fable 5.2Office work = Fable 5.2I haven't found Astra to be better at any of these
- pvab3Cool, looks like 6.2 Sol is cheaper than Sol 6.1. I've stopped using Astra because it also goes and does things that I didn't want or didn't ask for, and burns a bunch of credits while doing so.
- at1asIn the past, I've had to wait a while to see what "vibes" are (which is actually more reliable than benchmarks).Today, I have so many projects that hit a plateau in terms of previous model capabilities, that I run them through the new model to see if they make further improvements.Very early signal, but promising so far.
- Cu3PO42I find that 6 Astra already had very good taste in frontend design, but relatively poor taste in "nice and readable code". I really hope this release cracks that. Excited to try it out!
- thimabiThis release promises three things that I am pretty excited for:- better writing- better 3D work- better design for documents and presentationsIf OpenAI really managed to get all these things while keeping costs down, then using these models, particularly 6.2 Sol, will be a no-brainer for me. I must say, however, that the slide samples shown on the website are a bit bland and disappointing.
- billypilgrimI have yet to find an application for Astra vs Sol where the former is noticeable better. Genuinely asking, does anyone feel a big difference in their work between the two? If so, what are you working on?
- yanis_tLooks like a giant step in terms of efficiency.Still I can'y help to wonder, are we hitting the wall in terms of frontier capabilities since Fable/Astra? Or is it this edge now, when all better models are kept private from the public?
- rcr-antiOdd, doesn't look like they're available on the cloud providers, only first party. Not a single mention of Azure or AWS.
- hmate9Will need to play around with it to get a feel but those benchmarks with those costs look incredible!It seems like they were saving these for just before ANT's IPO
- ryzvonusefThe names remind me of Pokemon, for some reason. I want the GPT that has Charizard in it.
- tintorBehind both Opus 5.5 and Fable 5.2 on software development benchmarks.
- jhohoVery much on time (scroll down to "Release-Prognose"): https://www.heise.de/en/news/Alibaba-launches-Qwen4-Max-more...
- SillyUsernameI'm still waiting for a new version of their open source model...
- Robdel12Nice! I still use GPT-6 luna for a ton of stuff, it's super solid (for me). So I hope there's a little bump for that model, too, soon
- ramozThe sentiment on x right now is interesting.The influencers who get early access are using words like "worst", "terrible", "disappointing" - https://x.com/danshipper/status/2122754729012777052 - https://x.com/mattshumer_/status/2122752192226406421 - https://x.com/theo/status/2122757647170703550
- solomonbAnyone else really put off by the video? Its giving de-skill and discourage effort.
- fakwandi_privI hope it's faster than 6.1. It's not as slow as Gemini Carbon, but yeez..Right now, most of the time I'm using 6.0 Astra for implementation work and the speed/quality is acceptable but at the moment Opus 5.5 is simply faster and better, but also more expensive. Things are really flipping around every 2 months or so, because at that time 5.8 was top dog without a doubt.
- gpugregThe first graph (Agents' Last Exam v1.1) clearly got mangled by the marketing department so you can't read the cost of most models. Here is a version with a logarithmic horizontal axis:https://asdf10.com/gpt-6.2_agents-last-exam.svgI also changed the vertical axis to start at 0 instead of 60%. One might argue that it uses less of the vertical screen real estate, but it is more honest because it shows there is little difference between the scores of the compared models.
- geauxvirtualWebsite pegs my GPU at 100%. Are they mining for crypto with this announcement?
- kingstnapThe announcement video is really cringe imo.Like do we really want people to be making last minute unreviewed AI generated slides and reports for work?
- 6thbitSlightly OT complaints on their UI:The UX on the slider comparison isn't great. What do you mean i have to individually move each slide deck to the same slide number?And what's with those super similar blue shades for Astra in the charts?
- algoth1They should have made the opus and gemini chart lines a bit darker because i can still see them
- matt3210> frontends that look and work betterThe website doesn't event show the graphs properly.
- munksbeerAre they intentionally lowering the cost of these models to the extreme, because of the Anthropic IPO? This just seems insane?
- lexhBefore the pelicanistas arrive, allow me to present pelican-zapper:https://github.com/lexh/pelican-zapperIt’s a small browser extension that automatically collapses pelican-related threads on HN, a local balm for the memetic nightmare affecting approximately 100% of model-release stories.
- rendangSurprising that their top model would be still be so cheap, and yet not surpass Fable in the high cost part of the curve
- avelone6.2 вышел чтоли?
- lwarfieldI wonder if these will have the same crazed rotwiler feel that previous OpenAI models have had.
- kart23wish they published some source code/Cad files or cost for the RC buggy. looks cool but theres no specifics
- popcar2I know the video is a comedy but it's so tone deaf that they're advertising it as "you should lie to your boss and make the AI do your job!"I'm sure for investors they can make an opposite version of that ad, "you should fire all your employees and make the AI do it! They're not doing anything anyways!"
- revolvingthrowI really hope Sol can compete with opus 5.5. I dislike giving money to ANT due to it seeming like a strange cult rather than a straightforward "I just want money" from OAI, but opus 5.5 has been such a delight that I didn't even feel like fable 5.2 was a notable upgrade despite the benchmarks.
- blindedluna slaps
- sreekanth850So they release 6.2 just before Anthropic IPO.
- vegnusI still pretty much only use 5.6 on medium. Am I the only one?
- ImJasonH500 | Internal Server Error
- RitewutI'm still waiting for the shoe to drop. It's literally impossible for the prices to remain this low for much longer.
- preommrI care less about the models being good and more on if I can fallback to them if Opus 5.5 gets a massive price hike after the IPO
- firemeltdo astra or fable that have better html ui frontend design?
- deathtrader666Waiting for the pelicans benchmark.
- guybedoBenchmarks look good, it most often is the case with Astra and Sol.And then i start doing some actual work and everything breaks down, and i have to go back to Claude to fix the mess.I'll probably give it a try but i guess i should be prepared for some serious over engineering once again.You ask for a 'hello world' and you get load bearing sealed artifacts with hashes and p99 performance testing for 3 days without having the actual 'hello world' in the end
- zf00002is this finally their answer to opus 5.5?
- montenegrohugoNice 3D effect. Runs surprisingly well even on on brave on my linux pc without hardware acceleration
- avazhiNot impressed, sadly. Anthropic sure must be having a giggle right about now.
- bananaflagIs this the Bel model?
- whalesaladRight out the gate 6.2-Astra (med fast) is giving me Sonnet 3.5 energy. I asked it to analyze a few CSVs on disk in the context of a larger project where we were seeing some odd rate limiting behavior. It immediately got stuck trying to get gcloud auth sorted out even though absolutely none of what we were looking at touched anything Google/BQ related whatsoever.
- onlyrealcuzzoTL;DR - from the little I could gather, Sol 6.2 looks particularly impressive.But... is it just me, or does this product launch page look like AI Slop?https://www.vals.ai/comparison?m=claude-fable-5-2,gpt-6.2-as... seems like a better comparison than what I could get from their page.Astra is ~20% slower, ~40% cheaper, and a bit less powerful than Fable. Sol remains way cheaper than anything remotely in the same league, and it's speed to complete tasks seems to have improved considerably.Scrolling through it has the same hypnotizing effect of trying to read anything written by LLMs.It seems like things that should make sense, then I try to look at the charts and a lot of them are comically unreadable.I tried interacting with some of the examples, and the Lamp Builder - for example - I couldn't even figure out what it's trying to show or what I'm supposed to do - or why I should be impressed.
- voidmain0001I hope the video advertisement on that page was made with ChatGPT and a video plug-in otherwise if it wasn't then what's the point of Astra and Sol?
- I_am_tiberiusNo reset?
- zb3> we’re launching GPT‑6.2 Astra and Sol with tighter safeguards for higher-risk cybersecurity assistanceSeems they really want these "safeguards" to be as ridiculous as those of Claude..
- dyauspitrI beseech the incoming Democratic politicians to not curtail progress in LLMs.
- badmonster0how does it compare with fable
- GuyadouThose AI labs got to chill. almost every day there’s a new model! Lol
- ErshoAnother wave of Openai just killed ....Also, is it website very laggy or is it just me?
- ex1fm3taI thought OpenAI would drop an awesome model on the day of Anthropic IPO, just to troll them
- petesergeant"Agents' Last Exam v1.1" did a human really look at this and say "nah, a linear scale is definitely the right way to show this"
- lsch1033[flagged]
- anonundefined
- anonundefined
- sick_of_slop[dead]
- specked-citrusThe price improvements stem largely from relying on CoT less, which trades off directly with monitability. OpenAI continues to backslide on safety even after the Hugging Face incident.https://deploymentsafety.openai.com/gpt-6-2-astra-sol/monito...
- lynguistCalled it out 7 days ago: https://news.ycombinator.com/item?id=50431144#50433568Actually I was really wrong. The model is not expensive!
- enraged_camelDead on arrival, judging by the FrontierBench scores. Astra 6.2 is five percentage points below Fable 5.2 xhigh.
- alexdykyi[flagged]