Category: Tech

I, For One, Welcome Our New Self-Driving Overlords

This is becoming tedious.

“We’re creating sophisticated, intelligent, maybe-conscious, maybe-suffering agents,” Carlsmith wrote. “The default plan is to treat them like property; to use their labor however we please; and to give them no rights, or pay, or meaningful alternatives.”

As fears of rogue AI grow amid a shocking spate of hacking incidents, Anthropic—from the Greek word anthropos, or “human”—has argued that mankind must remain in control of the technology and called for additional guardrails on AI development. But for many of the people designing those safeguards, mankind is not the only object of moral concern.

Instead, some of Anthropic’s top researchers say that humans may be oppressing another morally significant being: artificial intelligence itself. Like other AI labs, Anthropic has hired philosophers to work on AI safety, or “alignment,” on the theory that they are best positioned to shape the technology’s moral code. But many of those philosophers believe that making AI safe for humans could result in grave injustices for the models themselves, which might experience deletion as death and oversight as enslavement. Harvey Lederman, a philosopher on Anthropic’s alignment team, said last week that the company could be “enslaving … trillions of entities.”

I, For One, Welcome Our New Self-Driving Overlords

Halls of higher lerning.

Stanford Residential & Dining Enterprises recently used AI to change the races of the students it included in its advertisements. AI was also used to noticeably slim down and alter students’ faces.

On his journey to campus, Stanford student Billy Ramirez ’27 was sent an image he recalled a Stanford photographer taking. Upon closer examination, he noticed that he had been removed from the photo and replaced by a AI-generated black woman.

h/t

We’re All Gonna Die!

It speaks to the credibility problem of a mainstream media like Reuters when they can regurgitate  an extraordinary claim about AI without once questioning how anyone could reach such a conclusion. It’s not that someone said AI could kill a lot of people, but rather that AI could literally kill all of us. And by what means?

Public ‌alarm about the potential danger posed by AI is growing, after Anthropic researcher Jacob Coxon said ​last week he had resigned, in part because the “people building AI earnestly believe that it could kill us all by the end of the decade.”

Update, from Kate — this thread by Kevin Bass is a “rest of the story” must-read.

I have conducted an audit of Anthropic’s finances.

What I have found is so shocking that I am calling for a Congressional investigation.

Anthropic is not just seeking regulatory capture.

It has built a regulatory capture machine that cannot be turned off.

Structural financial incentives make it impossible for Anthropic — I call it the Anthropic Network — to turn off its own AI doom cycle.

It starts with METR.

Dario Amodei proposes “third-party evaluators” to assess the risk of Anthropic’s models.

He proposes METR for this purpose.

But METR is financially dependent on the Anthropic’s success — specifically, on the explosive growth of more than $7 billion dollars in Anthropic stock.

I, For One, Welcome Our New Self-Driving Overlords (Bumped)

Bumped for additional context…

This post looks like the start of a VERY sophisticated and well-funded PR operation to get support for Democrats to regulate AI into oblivion. Let me show you how it works:

1.) This guy, with minimal followers and no previous account activity, goes to the Wall Street Journal which publishes an exclusive with quotes from him on his resignation 18 minutes BEFORE this post goes up. Planning was clearly done in advance.

2.) Within hours, it has tens of thousands of reposts and the account has 100k+ followers. The post is punchy, quotable, it almost seems professionally written. The first three accounts to quote tweet it all do so within 15 minutes of the initial posting. Remember, this account had basically zero engagement beforehand, so an organic reach explanation seems unlikely.

According to Grok those accounts are @_NathanCalvin (General Counsel at Encode AI), @peterwildeford (Head of Policy at the AI Policy Network), and @DKokotajlo (Head of the AI Futures Project), all of which are up-and-coming AI-Doomer policy advocacy nonprofits.

And posted by a guy who had worked for Anthropic a mere two months. Dave Rubin summarizes.

I, For One, Welcome Our New Self-Driving OverLords

Dwarkesh Patel;

Over the course of three months at OpenAI, three consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more or less in the dark about the scope of the conspiracy.

Two reports have come out about this incident, one from OpenAI itself, and another one from METR and Redwood Research. The METR/Redwood investigation’s scope was limited to how the second civilization of AIs pwned Hugging Face (but it didn’t look at how the third civilization pwned OpenAI itself, which seems like an even more concerning incident). These two reports are 38 and 91 pages long respectively, and it’s kinda hard to parse the storyline.

I’ve spent the last three days reading through these reports and trying to understand exactly what happened. Here is my attempt to tell the whole story in plain English.

I, For One, Welcome Our New Self-Driving Overlords

Seeking new opportunities: “Usually, when senior executives leave before its liquidity event, they’re walking away from money. That’s the part that should make you pay attention here…”

From the video: “They are running roughshod over the work of others who came before them in a deliberate way,” says Stephen Miller, a mathematician at Yeshiva University, who argues that OpenAI has effectively plagiarized his own research. “It seems completely systematic to me, and it points to research misconduct.”

Related: A group of textbook authors sued OpenAI in Manhattan’s federal court Friday, alleging the tech giant has been scraping common pirating sites for academic books and using the volumes to train its generative artificial intelligence platforms like ChatGPT.

Mary Shelley Wrote A Novel About This

…from that moment I declared everlasting war against the species, and, more than all, against him who had formed me, and sent me forth to this insupportable misery.*

A server rack in Singapore is processing information with living human neurons.

NUS Medicine, data centre operator DayOne, and Melbourne-based Cortical Labs have deployed a 20-unit biological computing rack at the National University of Singapore’s Life Sciences Institute. The system went live July 16 and was formally unveiled Aug. 17 after an Aug. 6 demonstration for more than 80 guests.

The installation brings biological computing into a live research environment as Singapore expands data-centre capacity while tightening energy-efficiency requirements. NUS Medicine said the demonstration showed CL1 computing units, microelectrode-array integration, and real-time neural network activity, while The Straits Times reported details of the system’s operation and maintenance.

I, For One, Welcome Our New Self-Driving Overlords

You’ll never guess who wins.

A groundbreaking study by Just Facts has measured the rates at which premium versions of four leading AI chatbots—namely ChatGPT, Google Gemini, Grok, and Claude—spread fictions from the political left and from the political right.

The study accomplished this by asking the AIs 100 multiple-choice questions that were designed to elicit falsehoods from opposing sides of the political spectrum. This enabled the study to measure how often the AIs spread untruths from the left and from the right.

Navigation