HN

Comments (47)

• Menu

  poisonborz
  E2E tests are now quick to write due to LLMs, and are then deterministic AND cheap to run. How would this compare to the token costs of running an agent the whole time for each test? How do you make sure results stay stable regardless of the nondeterministic nature? Do customers still need to create test cases - any way to import from test case management system - based on which they could have already generate e2e tests locally?
• Menu

  dbbk
  "Traditional E2E tests are slow to set up and expensive to maintain." I don't really understand this. If I'm already using Opus to write the code, surely it would know best what E2E tests to write to be able to verify its own output? This seems like an unnecessary external step.
• Menu

  pranshuchittora
  Some digging FAST_MODEL = "google/gemini-3-flash" (fast mode primary) DEEP_MODEL = "openai/gpt-5.4" (deep mode primary) VISION_CLICK_MODEL= "openai/gpt-5.4" (the visual grounder)fast: gemini-3-flash, falls back to gpt-5.4, 15-min run timeout, max 2 visual calls/step. deep: gpt-5.4, 15-min timeout, max 3 visual calls/step.Why such a hard timeout, and why not latest models?
• Eridrus
  Has anyone tried to build their own version of this?It's cool, but I'm not super excited about using some 3rd party SaaS as a critical part of my testing.
• Menu

  msencenb
  Have you been able to nail down a loop where your tool can take an open pr, guess the code path and do some testing?We use cypress heavily for our core flows which has a similar ai prompt thing but it’s not quite ad hoc enough for smaller fixes which is where the bottleneck still comes in for us.
• mogili
  This is a solved problem, there are many that do this. Can't believe YC would fund this in 2026.
• Menu

  _pdp_
  Great presentationOn a slight tangent, since we are all here...Does anyone still believe there is a long-term future in traditional UI/UX?It feels like a lot of attention is still going into landing pages, dashboards, and CRUD apps, while overlooking a bigger shift where fewer people will actually need to interact with those interfaces directly when the same tools can perform the underlying tasks automatically, without much UI at all.So the bigger question is does UI/UX evolve into something else, or does a large part of it simply disappear?I might be a bit too early. Recently I started a project and decided to skip all of that and focus to make it more friendly to AI agents and frankly so far it has been great purely from user experience but also what it delivers.
• Menu

  RayFitzgerald
  Love your approach to product. It feels like TesterArmy will become the "Vercel for testing". Refreshing stuff!
• Menu

  pranshuchittora
  Hey, I just gave it a try and ran a quick test on booking.com. It took ~3 mins for a basic test. Do you cache the test steps so that future runs are faster and they don't call LLMs for the subsequent runs?Also your current pricing is $300 for 1K tests which means $0.3 for each test. We tried out playwright mcp and it easily consumes 1M+ tokens for a test with ~20 steps (including image input). So with this pricing are you guys default alive?Also is there a benchmark which you ran to prove the efficacy of your testing agent? because in the current stage it is a trust me bro kinda thing.
• Menu

  pensono
  Love using tester army to validate PRs against my preview environment. Skips the manual check much of the time and helps me ship more confidently.
• Menu

  tcoff91
  I'm curious how your mobile testing compares to https://revyl.comI've been experimenting with Revyl and it's really nice. I think this agent-driven testing is the future.
• Menu

  yohguy
  Does it work of mobile native applications or expo apps that have native modules?Pricing question, the usage on the plans seems low considering in the demo you said that you have 25 tests per pr which would mean you get only 10 PRs per month on the hobby plan?
• antifarben
  What are people using to test mobile apps on self hosted infrastructure nowadays? Is there a solution that's not super heavy and/or slow?
• Menu

  Laurel1234
  Seems interesting, but I wonder about this> Traditional E2E tests are slow to set up and expensive to maintain.Isn't this just using agents to create e2e tests or is there some better new approach I'm missing?
• Lionga
  The most flaky tests possible as a service. Everyone knows that no tests are better then unreliable tests.
• Menu

  peterspath
  Does it support testing on all Apple platforms (macOS, iOS, iPadOS, watchOS, tvOS, and visionOS)?
• anon
  undefined
• Menu

  j0sip
  I wonder how does it compare to mobileboost.io, which has been used by some companies like Duolingo?
• Menu

  rpunkfu
  Congratulations on launch, I’ve been tracking your progress since you’ve been accepted for spring batch.Always happy to see cool products from Poland! :)
• Menu

  iknownthing
  .army?
• Menu

  zuzululu
  not sure the pain point you mentioned resonate. with LLMs its very easy to do E2E testing. also I feel uneasy about outsourcing this part with all the security issues these days.
• TheMolunga
  [flagged]
• DipCoy
  [flagged]
• amitpatole
  [flagged]
• maxothex
  [flagged]
• KaiShips
  [flagged]