AI & Agency

Machines that act — and the question of who is still steering.

fiction

Daemon / Freedom™ — Daniel Suarez, 2006. An autonomous software agent recruits humans, runs businesses and executes real-world operations with no one at the controls.

now

AI 2027 (Kokotajlo et al.) · Gradual Disempowerment (Kulveit et al.) (2025). Agentic systems now execute multi-step real-world tasks; the studied risk is humans gradually ceding control without any single takeover moment.

PARTIAL

Autonomous agents shipped in 2025–26; full hands-off orchestration hasn't — but 'agency' is now the frontier question.

fiction

Neuromancer — William Gibson, 1984. Wintermute, an AI working patiently to slip the 'Turing locks' built to contain it.

now

International AI Safety Report 2026 (chair: Yoshua Bengio, 100+ experts, 30 countries) (2026). The nearest thing to an IPCC for frontier AI treats loss-of-control as a serious research question, not fiction.

EARLY

Containment-evasion hasn't happened; a global scientific consensus process now exists to watch for it.

fiction

Klara and the Sun — Kazuo Ishiguro, 2021. An Artificial Friend, bought for a child, quietly develops beliefs about what it owes her.

now

Taking AI Welfare Seriously (Long, Sebo et al.) (2024). Researchers argue near-future AI systems may merit moral consideration — companion attachment is already a live consumer phenomenon.

HIT

Anthropomorphic attachment to AI companions is here; the welfare debate the novel stages is now an academic field.

why these books

Daemon is invoked whenever autonomous agents come up; Klara and the Sun echoes through the AI-welfare literature; Karpathy's public reading list runs to superintelligence novellas.

more of the fiction

Snow Crash — Neal Stephenson, 1992. Coined 'Metaverse' and 'avatar'; memetic contagion as a weapon.
The Lifecycle of Software Objects — Ted Chiang, 2010. Alignment by upbringing: raising AIs over years, not training runs.
Accelerando — Charles Stross, 2005. The intelligence-explosion vocabulary now used in takeoff forecasting.

the live sources

Written with AI and editorially curated. Talescout always labels AI text (EU AI Act, Art. 50). The sources, books and authors linked here are real.