Joe Carlsmith Audio - podcast cover

Joe Carlsmith Audio

Audio versions of essays by Joe Carlsmith. Philosophy, futurism, and other topics. Text versions at joecarlsmith.com.
Last refreshed:
Follow this podcast in the Metacast mobile app to refresh it and see new episodes.
Download Metacast podcast app
Podcasts are better in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episodes

"Clean" vs. "messy" goal-directedness (Section 2.2.3 of "Scheming AIs")

This is section 2.2.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-pow...

Nov 16, 202317 min

Two sources of beyond-episode goals (Section 2.2.2 of "Scheming AIs")

This is section 2.2.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-pow...

Nov 16, 202321 min

Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs")

This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-pow...

Nov 16, 202312 min

Situational awareness (Section 2.1 of "Scheming AIs")

This is section 2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power...

Nov 16, 20239 min

On "slack" in training (Section 1.5 of "Scheming AIs")

This is section 1.5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power...

Nov 16, 20237 min

Why focus on schemers in particular? (Sections 1.3-1.4 of "Scheming AIs")

This is sections 1.3-1.4 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-...

Nov 16, 202331 min

A taxonomy of non-schemer models (Section 1.2 of "Scheming AIs")

This is section 1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power...

Nov 16, 202311 min

Varieties of fake alignment (Section 1.1 of "Scheming AIs")

This is section 1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” Text of the report here: https://arxiv.org/abs/2311.08379 Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power...

Nov 16, 202318 min

Full audio for "Scheming AIs: Will AIs fake alignment during training in order to get power?"

This is the full audio for my report "Scheming AIs: Will AIs fake alignment during training in order to get power?" (I’m also posting audio for individual sections of the report on this podcast, but the ordering was getting messed up on various podcast apps, and I think some people might want one big audio file regardless, so here it is. I’m going to be posting the individual sections one by one, in the right order, over the coming days. ) Full text of the report here: https://arxiv.org/abs/2311...

Nov 15, 20236 hr 13 min

Introduction and summary of "Scheming AIs: Will AIs fake alignment during training in order to get power?"

This is a recording of the introductory section of my report "Scheming AIs: Will AIs fake alignment during training in order to get power?". This section includes a summary of the full report. The summary covers most of the main points and technical terminology, and I'm hoping that it will provide much of the context necessary to understand individual sections of the report on their own. (Note: the text of the report itself may not be public by the time this episode goes live.)

Nov 14, 202357 min

On the limits of idealized values

Contra some meta-ethical views, you can't forever aim to approximate the self you would become in idealized conditions. You have to actively create yourself, often in the here and now. Originally published in 2021. Text version here: https://joecarlsmith.com/2021/06/21/on-the-limits-of-idealized-values

May 12, 20231 hr

Predictable updating about AI risk

How worried about AI risk will we feel in the future, when we can see advanced machine intelligence up close? We should worry accordingly now. Text version here: https://joecarlsmith.com/2023/05/08/predictable-updating-about-ai-risk

May 08, 20231 hr 3 min

Existential Risk from Power-Seeking AI (shorter version)

A shorter version of my report on existential risk from power-seeking AI. Forthcoming in an essay collection from Oxford University Press. Text version here: https://jc.gatspress.com/pdf/existential_risk_and_powerseeking_ai.pdf

Mar 19, 202355 min

Problems of evil

Is everything holy? Can reality, in itself, be worthy of reverence? Text version here: https://joecarlsmith.com/2021/04/19/problems-of-evil

Mar 05, 202336 min

Seeing more whole

On looking out of your own eyes. Text version at joecarlsmith.com.

Feb 17, 202352 min

Is Power-Seeking AI an Existential Risk?

Audio version of my report on existential risk from power-seeking AI. Text here: https://arxiv.org/pdf/2206.13353.pdf. Narration by Type III audio.

Jan 25, 20233 hr 21 min

On sincerity

Nearby is the country they call life. Text version at: https://joecarlsmith.com/2022/12/23/on-sincerity

Dec 23, 20221 hr 35 min

Against meta-ethical hedonism

Can the epistemology of consciousness save moral realism and redeem experience machines? No.

Dec 01, 20221 hr 2 min

Against the normative realist's wager

If your find a button that gives you a hundred dollars if a certain controversial meta-ethical view is true, but you and your family get burned alive if that view is false, should you press the button? No. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 09, 202243 min

On infinite ethics

Infinities puncture the dream of a simple, bullet-biting utilitarianism. But they're everyone's problem. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 20221 hr 25 min

Actually possible: thoughts on Utopia

Life in the future could be profoundly good. I think this is an extremely important fact, and one that often goes under-estimated. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 202229 min

On future people, looking back at 21st century longtermism

I find imagining future people looking back on present-day longtermism (the view that positively influencing the long-term future should be a key moral priority) a helpful intuition pump, especially re: a certain kind of “holy sh**” reaction to existential risk, and to the possible size and quality of the future at stake. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO ....

Oct 05, 202225 min

Can you control the past?

Sometimes, you can “control” events you have no causal interaction with (for example, if you're a deterministic software twin). Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 20221 hr 17 min

Killing the ants

If you kill something, look it in the eyes as you do. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 202215 min

On clinging

How can "non-attachment" be compatible with care? We need to distinguish between caring and clinging. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 202218 min

Thoughts on being mortal

You can't keep any of it. The only thing to do is to give it away on purpose. Text version here . Edited for Joe Carlsmith by TYPE III AUDIO .

Oct 05, 202213 min
Hosted on Buzzsprout
For the best experience, listen in Metacast app for iOS or Android