blog
Beyond the desktop metaphor: a map and a reading list
Disclaimer: the research behind this page was AI-generated: gathered and written by Claude using swamp workflows and Exa search. Check the linked sources before relying on a summary.
The desktop has hardly changed in twenty years. Files, folders, overlapping windows and apps are commodities, and they carry inertia. The open problem sits higher in the value chain: getting back into the work you were doing. Scott Jenson calls this working memory: the OS should remember what you were doing, so the user stops being the integrator of last resort.
其ノ壹
01 / 05
The map
wardley-beta title Desktop UX for knowledge work size [1100, 720] anchor Knowledge worker [0.97, 0.55] component Doing creative work [0.88, 0.55] component Resuming context [0.78, 0.12] component Finding past work [0.76, 0.42] component Apps [0.66, 0.78] (inertia) component Activity timeline [0.62, 0.22] component Spatial canvas [0.56, 0.18] component Project clipboard drawer [0.52, 0.10] component Overlapping windows [0.50, 0.93] label [-150, 4] component Desktop search [0.45, 0.80] component Files and folders [0.42, 0.90] (inertia) component Activity capture [0.36, 0.38] component Semantic metadata store [0.30, 0.16] component Local-first sync [0.26, 0.30] component Cloud storage [0.24, 0.84] component Local LLM [0.20, 0.42] component OS and hardware [0.06, 0.96] label [-125, 4] Knowledge worker -> Doing creative work Doing creative work -> Resuming context Doing creative work -> Finding past work Doing creative work -> Apps Doing creative work -> Overlapping windows Resuming context -> Activity timeline Resuming context -> Spatial canvas Resuming context -> Project clipboard drawer Finding past work -> Activity timeline Finding past work -> Desktop search Apps -> Files and folders Activity timeline -> Activity capture Activity timeline -> Semantic metadata store Desktop search -> Files and folders Activity capture -> Local LLM Semantic metadata store -> Local-first sync Files and folders -> Cloud storage Local-first sync -> OS and hardware Cloud storage -> OS and hardware Local LLM -> OS and hardware evolve Activity timeline 0.45 evolve Activity capture 0.62 evolve Local LLM 0.72 note "Lifestreams 1996 / Scopeware 2001" [0.70, 0.05] note "Windows Timeline, Zeitgeist: built then removed" [0.68, 0.30] note "Recall-style tools" [0.40, 0.48]
How to read it:
- Resuming context is in genesis. No shipping desktop does it.
- Activity timeline has been built several times: Lifestreams and Scopeware, then GNOME Zeitgeist and Windows Timeline. Each was later abandoned. It is still custom-built.
- Activity capture is moving fast because of the Recall-style tools. These tools record your activity but do not change the document model, so the timeline stays a search layer over files and folders.
- Local LLM is moving toward commodity. That makes grouping raw activity into tasks cheap, and that grouping is the hard part of a timeline.
- Files and folders and Apps carry inertia. Each new idea gets added beside them. None has replaced them.
其ノ貳
02 / 05
Scott Jenson
- Are we really going to use the same Desktop UX forever? (talk, 2026)
- Akademy 2026 recording (KDE)
- How the Desktop UX needs to evolve to keep up with Local-first (talk)
- Evolving Desktop OS, Local-First, & Agentic UX (InfoQ podcast, with transcript, 2026)
- Ubuntu Summit 25.10 session
- The Future Needs Files and The Present Needs Files (essays, 2021)
- Small is Beautiful: Why Desktop UX still has something to teach Mobile (2016)
- Old is New: Why Desktop UX still inspires (2017)
- Prototypes: FocusStream (a Lifestreams-style browsing timeline), DesktopUX0 (files and clipboard as one model), DesktopUX1 (discovering intent from history), Glance (KWin edges for ultrawide screens)
其ノ參
03 / 05
Lifestreams and its line
- Freeman & Gelernter, Lifestreams: A Storage Model for Personal Data (SIGMOD Record, 1996)
- Freeman, The Lifestreams Software Architecture (Yale PhD dissertation, 1997)
- Lifestreams: An Alternative to the Desktop Metaphor (CHI 1996)
- Fertig, Freeman & Gelernter, “Finding and Reminding” Reconsidered (SIGCHI Bulletin, 1996)
- Gelernter, Beyond Lifestreams: The Inevitable Demise of the Desktop Metaphor (MIT Press, 2007)
- Rekimoto, Time-machine computing (UIST 1999)
- Harrison, Kronosphere: A Replacement for the Ailing Desktop Metaphor (NYU MS thesis)
- Mirror Worlds and Scopeware (2001), the commercial attempt
其ノ肆
04 / 05
Implementations, shipped and abandoned
- GNOME Activity Journal / Zeitgeist
- Windows Timeline (removed in Windows 11)
- OpenRecall, Pensieve: open-source Recall-style capture
其ノ伍
05 / 05
Adjacent
- Jef Raskin’s Archy: no applications, one content space
- Ink & Switch, Malleable software (2025)