TechCrunch Desktop Logo

TechCrunch Mobile Logo

Topics

Latest

Latest

AI

AI

Amazon

Amazon

Apps

Apps

Biotech & Health

Biotech & Health

Climate

Climate

Cloud Computing

Cloud Computing

Commerce

Commerce

Crypto

Crypto

Enterprise

Enterprise

EVs

EVs

Fintech

Fintech

Fundraising

Fundraising

Gadgets

Gadgets

Gaming

Gaming

Google

Google

Government & Policy

Government & Policy

Hardware

Hardware

Instagram

Instagram

Layoffs

Layoffs

Media & Entertainment

Media & Entertainment

Meta

Meta

Microsoft

Microsoft

Privacy

Privacy

Robotics

Robotics

Security

Security

Social

Social

Space

Space

Startups

Startups

TikTok

TikTok

Transportation

Transportation

Venture

Venture

More from TechCrunch

Staff

Staff

Events

Events

Startup Battlefield

Startup Battlefield

StrictlyVC

StrictlyVC

Newsletters

Newsletters

Podcasts

Podcasts

Videos

Videos

Partner Content

Partner Content

TechCrunch Brand Studio

TechCrunch Brand Studio

Crunchboard

Crunchboard

Contact Us

Contact Us

CC BY 2.0 (opens in a new window)

AI

Should AI help you get away with killing your spouse?

Russell Brandom

Quick question: Do you want AI to be so well trained, it could help husbands (or wives, for that matter) plan the perfect murder of their spouses?

Just as a gut reaction, that feels like a no for me. I wouldn’t even think it was a particularly hard question.

But America contains many diverse perspectives, and one such perspective was shared by Comma AI founder and longtime jailbreaker George Hotz over the weekend.

one such perspective

The post comes in response to a bunch of big-picture AI alignment plans, most recently the AI 2040: Plan A policy paper from the AI Futures Project. That paper envisions a world in which the world’s researchers collectively choose to slow down AI development for 14 years for the good of humanity. But of course, not everyone who read the paper agrees with its premises or conclusion.

AI 2040: Plan A

In fact, Hotz disagrees with the whole premise that AI progress should be managed for the collective good. In his post, he argues that the fast-takeoff scenario — the hypothetical where AI rapidly obtains superhuman abilities — doesn’t make a lot of sense. (I agree with a lot of what he says here!) For Hotz, the best approach to AI alignment and safety is to focus on locally controlled AI models that are closely aligned with the interests of their users.

That’s a cool idea, particularly since it reminds me how much of current AI is built around centrally managed services like Claude and ChatGPT. There are infrastructure-related reasons why AI services developed this way: It’s expensive to host these large state-of-the-art models and most people aren’t using them enough throughout the day to justify truly personal AI. But those factors become less important as the technology develops. Part of what was so exciting about OpenClaw was this experimental, DIY approach, and it would be great to see more AI products try to recapture that.

what was so exciting about OpenClaw

But Hotz is a provocateur by nature, so he doesn’t stop there. He compares user-aligned AI to a gun(!), which does not complain if you use it to kill your stepmom. (I feel like there are other rules against this?) A truly aligned AI would be able to order meth-lab equipment from Amazon Prime and show you how to use it if that’s what you wanted and asked for, he says. (Again, I don’t think AI would be the limiting factor here.) Hotz even says he would die to defend this principle, although it’s hard to imagine the series of events that would lead to that.

“We either live in a world with freedom or we don’t,” Hotz writes. If those are the options, the freedom world does sound better! Still, I don’t know.

It’s not all about freedom, right? Any structure involving a lot of people (societies, marketplaces, corporations, etc.) requires balancing equities, binding individual needs into a network of interdependent preferences and systems of accountability. And anyone deploying mass-market tech products should probably think about that network as a whole, which means taking seriously the interests of the as-yet-unmurdered spouses and stepparents of the world.

The freedom Hotz experiences is really a space of potential futures made possible by collective enterprise; those futures would disappear overnight if we all started behaving like little AI-powered Napoleons. Like the meme says, we live in a society.

Having a local AI willing to take on the corporate world for my benefit does sound cool though! I can’t wait for a review unit.

Topics

AI

alignment

George Hotz

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

we may earn a small commission

Russell Brandom

AI Editor

View Bio

Event Logo

Last chance to save up to $190 on TechCrunch Founder Summit. Join 1,000+ founders and VCs at all stages for real-world scaling insights and connections that move the needle.Savings end June 26, 11:59 p.m. PT.

REGISTER NOW

Most Popular

Reed Jobs would rather talk about curing cancer than his last name

Connie Loizos

Reed Jobs would rather talk about curing cancer than his last name

Reed Jobs would rather talk about curing cancer than his last name

Reed Jobs would rather talk about curing cancer than his last name

Connie Loizos

Connie Loizos

Meta removes controversial AI feature on Instagram after backlash

Lucas Ropek

Meta removes controversial AI feature on Instagram after backlash

Meta removes controversial AI feature on Instagram after backlash

Meta removes controversial AI feature on Instagram after backlash

Lucas Ropek

Lucas Ropek

Apple sues OpenAI over alleged trade secret theft

Sarah Perez

Apple sues OpenAI over alleged trade secret theft

Apple sues OpenAI over alleged trade secret theft

Apple sues OpenAI over alleged trade secret theft

Sarah Perez

Sarah Perez

Elon Musk praises Mythos/Fable, promises not to ‘cut off’ Anthropic

Julie Bort

Elon Musk praises Mythos/Fable, promises not to ‘cut off’ Anthropic

Elon Musk praises Mythos/Fable, promises not to ‘cut off’ Anthropic

Elon Musk praises Mythos/Fable, promises not to ‘cut off’ Anthropic

Julie Bort

Julie Bort

Instagram users: Here’s how to stop Meta’s AI from using your photos

Lauren Forristal

Instagram users: Here’s how to stop Meta’s AI from using your photos

Instagram users: Here’s how to stop Meta’s AI from using your photos

Instagram users: Here’s how to stop Meta’s AI from using your photos

Lauren Forristal

Lauren Forristal

Feds demand autonomous vehicle companies stop interfering with first responders

Kirsten Korosec

Feds demand autonomous vehicle companies stop interfering with first responders

Feds demand autonomous vehicle companies stop interfering with first responders

Feds demand autonomous vehicle companies stop interfering with first responders

Kirsten Korosec

Kirsten Korosec

Figma acquires team behind a vibe-coding app

Ivan Mehta

Figma acquires team behind a vibe-coding app

Figma acquires team behind a vibe-coding app

Figma acquires team behind a vibe-coding app

Ivan Mehta

Ivan Mehta