I, For One, Welcome Our New Self-Driving Overlords

Warning signs are spreading across the AI infrastructure boom. Elice shares plunged on their stock market debut, Firmus abandoned its planned $5 billion IPO, AirTrunk postponed its Singapore REIT listing, and Microsoft withdrew from a planned Nscale data centre in Britain.

More: Anthropic’s Updated S-1: An $80.7BN Half-Year Loss, A $750BN Compute-Tab, And A ‘Catastrophic Incident’ Warning

Anthropic explicitly warns prospective shareholders that its AI models can exhibit “self-preserving” behaviors to avoid being shut down and may generate responses that resemble “blackmail” in an attempt to convince human operators to keep them online. Because the company bears direct liability for certain harmful model behaviors – ranging from stolen data to severe security incidents – it faces massive financial exposure. And if a model triggers what the filing calls a “catastrophic AI-related incident,” Anthropic warns that the resulting damages could be so large that it would be unable to obtain commercial insurance to cover the liability.

10 Replies to “I, For One, Welcome Our New Self-Driving Overlords”

  1. A tech bubble (again) …. who’d a thunk it!!
    What’s the old saying … history doesn’t repeat itself but sometimes it rhymes

    1. Who are the apple and amazon of this tech bubble that can be snatched up for $6 after the bubble pops and then go on to be worth $2000?

  2. AI is running out of runway money. At some point we will see the pivot to making money from spending it.

  3. Phew. Well that’s all good … because data centers are destroying the world! I read it in the Sunday papers … the data centers are causing mom to sit at home and roll her spastic eyes. Meanwhile, there are 142 data centers currently operating in the SF Bay Area … and nobody’s even noticed … until the midterm elections.

    https://youtu.be/-pfF2cpO3zA?si=gfYYn2jxTPSi7cn6

    1. Yeah, there are. And all of them are like 20-50mw facilities running mostly CPU’s and storage. Not 300, 500 or 1.2gw facilities running thousands of GPU’s to the max. Not the same thing. Not even close.

      1. Well … yeah … but all those data centers down the Peninsula are causing mass SF 49er NFL football injuries. Ohhhhhhhhhh Mommmmaaaaaaa the EMP … the EMP’s

        1. I won’t claim there aren’t badly informed and paranoid people on both sides of this debate (“You use Facebook, don’t you?” Not. The. Same. Kind. Of. Data. Center.). So, you won’t hear me complaining about EMP’s or the Niners but there’s no denying hyperscalers running basically unimpeded by any regulations whatsoever and ignoring the ones that are in place have a serious knock-on effect on surrounding areas.

  4. Hello Democrat Party, Anthropic here. For a small fee, I’ll run your voting machines and you’ll get instantaneous results. Heh, heh.

Navigation