HN

Need help?
<- Back
Qualcomm Cloud AI 100 Ultra – 150W AI Accelerator Card with 128GB at 548GB/s

Qualcomm Cloud AI 100 Ultra – 150W AI Accelerator Card with 128GB at 548GB/s

peter_d_sherman

Comments (45)

  • tokepi
    If the specs seem outdated, it’s because this chip launched in 2024. It’s available at cloud providers including Cirrascale
  • thway15269037
    What's the price?
  • pearl_panel5
    Curious how the memory bandwidth actually holds up under sustained inference loads compared to the spec sheet numbers.
  • swiftcoder
    So it's an M4 Max Mac Studio, RAM-wise, with a GPU's worth of compute?
  • zitterbewegung
    Sort of interesting design It has half a terabyte of SRAM on the accelerator with a 128 GB of RAM replacing HBM with SRAM but keeping regular RAM.
  • 0917236141
    Seems like a reasonable general-purpose card.
  • aetherspawn
    Ok so it’s significantly worse than Apple M6 and we don’t know if it’s cheaper or notEdit: Ah sorry you’re right, the bandwidth is lower but the TOPS is a lot higher. I’m not sure how much effect you get from higher TOPS with such low bandwidth though.
  • varispeed
    Aren't these specs already outdated? Seems meh. I would think players would like to bring something new to the table instead of bringing what was okay two years ago or so.Give me 1TB RAM and 5TB/s or something that exciting.