Category: Tech

We’re All Gonna Die!

It speaks to the credibility problem of a mainstream media like Reuters when they can regurgitate  an extraordinary claim about AI without once questioning how anyone could reach such a conclusion. It’s not that someone said AI could kill a lot of people, but rather that AI could literally kill all of us. And by what means?

Public ‌alarm about the potential danger posed by AI is growing, after Anthropic researcher Jacob Coxon said ​last week he had resigned, in part because the “people building AI earnestly believe that it could kill us all by the end of the decade.”

Update, from Kate — this thread by Kevin Bass is a “rest of the story” must-read.

I have conducted an audit of Anthropic’s finances.

What I have found is so shocking that I am calling for a Congressional investigation.

Anthropic is not just seeking regulatory capture.

It has built a regulatory capture machine that cannot be turned off.

Structural financial incentives make it impossible for Anthropic — I call it the Anthropic Network — to turn off its own AI doom cycle.

It starts with METR.

Dario Amodei proposes “third-party evaluators” to assess the risk of Anthropic’s models.

He proposes METR for this purpose.

But METR is financially dependent on the Anthropic’s success — specifically, on the explosive growth of more than $7 billion dollars in Anthropic stock.

I, For One, Welcome Our New Self-Driving Overlords (Bumped)

Bumped for additional context…

This post looks like the start of a VERY sophisticated and well-funded PR operation to get support for Democrats to regulate AI into oblivion. Let me show you how it works:

1.) This guy, with minimal followers and no previous account activity, goes to the Wall Street Journal which publishes an exclusive with quotes from him on his resignation 18 minutes BEFORE this post goes up. Planning was clearly done in advance.

2.) Within hours, it has tens of thousands of reposts and the account has 100k+ followers. The post is punchy, quotable, it almost seems professionally written. The first three accounts to quote tweet it all do so within 15 minutes of the initial posting. Remember, this account had basically zero engagement beforehand, so an organic reach explanation seems unlikely.

According to Grok those accounts are @_NathanCalvin (General Counsel at Encode AI), @peterwildeford (Head of Policy at the AI Policy Network), and @DKokotajlo (Head of the AI Futures Project), all of which are up-and-coming AI-Doomer policy advocacy nonprofits.

And posted by a guy who had worked for Anthropic a mere two months. Dave Rubin summarizes.

I, For One, Welcome Our New Self-Driving OverLords

Dwarkesh Patel;

Over the course of three months at OpenAI, three consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more or less in the dark about the scope of the conspiracy.

Two reports have come out about this incident, one from OpenAI itself, and another one from METR and Redwood Research. The METR/Redwood investigation’s scope was limited to how the second civilization of AIs pwned Hugging Face (but it didn’t look at how the third civilization pwned OpenAI itself, which seems like an even more concerning incident). These two reports are 38 and 91 pages long respectively, and it’s kinda hard to parse the storyline.

I’ve spent the last three days reading through these reports and trying to understand exactly what happened. Here is my attempt to tell the whole story in plain English.

I, For One, Welcome Our New Self-Driving Overlords

Seeking new opportunities: “Usually, when senior executives leave before its liquidity event, they’re walking away from money. That’s the part that should make you pay attention here…”

From the video: “They are running roughshod over the work of others who came before them in a deliberate way,” says Stephen Miller, a mathematician at Yeshiva University, who argues that OpenAI has effectively plagiarized his own research. “It seems completely systematic to me, and it points to research misconduct.”

Related: A group of textbook authors sued OpenAI in Manhattan’s federal court Friday, alleging the tech giant has been scraping common pirating sites for academic books and using the volumes to train its generative artificial intelligence platforms like ChatGPT.

Mary Shelley Wrote A Novel About This

…from that moment I declared everlasting war against the species, and, more than all, against him who had formed me, and sent me forth to this insupportable misery.*

A server rack in Singapore is processing information with living human neurons.

NUS Medicine, data centre operator DayOne, and Melbourne-based Cortical Labs have deployed a 20-unit biological computing rack at the National University of Singapore’s Life Sciences Institute. The system went live July 16 and was formally unveiled Aug. 17 after an Aug. 6 demonstration for more than 80 guests.

The installation brings biological computing into a live research environment as Singapore expands data-centre capacity while tightening energy-efficiency requirements. NUS Medicine said the demonstration showed CL1 computing units, microelectrode-array integration, and real-time neural network activity, while The Straits Times reported details of the system’s operation and maintenance.

I, For One, Welcome Our New Self-Driving Overlords

You’ll never guess who wins.

A groundbreaking study by Just Facts has measured the rates at which premium versions of four leading AI chatbots—namely ChatGPT, Google Gemini, Grok, and Claude—spread fictions from the political left and from the political right.

The study accomplished this by asking the AIs 100 multiple-choice questions that were designed to elicit falsehoods from opposing sides of the political spectrum. This enabled the study to measure how often the AIs spread untruths from the left and from the right.

I, For One, Welcome Our New Self-Driving Overlords

@JafarNajafov;

Anthropic just got caught secretly downgrading users without telling them, charging full price for a lesser product, and storing every prompt for 30 days. The developer community is calling it the biggest violation of trust in AI history.

Related: So Anthropic scraped the entire internet to train Claude, yet somehow completely omitted the parts where the CEO’s wife ran a porn startup, married a man over 40 years older and pitched her app to Jeffrey Epstein. Peak AI alignment right there.

I, For One, Welcome Our New Self Driving Overlords

@HansMahncke A few weeks ago, I was staying at an airport hotel in Nashville. I went to sleep with the rental car parked outside and woke up to an email from the rental company telling me that I had returned it. Except I hadn’t.

Navigation