Prompts for Where Experience Goes
The human-side prompts that developed and steered the draft, in conversation order. Assistant responses, button replies, and interface metadata are omitted. The conversation began with Parts 1 and 2; see Prompts for Who Teaches the Weights? and Prompts for Learning About What You Do Not Do.
Part 3
Don’t commit yet. Draft Part 3 (ladder of stores, learned update rules, benchmarks, corrections to The Dynamics That Matter). Thanks!
Going deeper through the RL essays
Can we go deeper technically if we connect to the two prior essays on RL (four Substack articles)? notes/how-can-a-reward-train-a-neural-network.md and notes/how-does-a-policy-improve.md
Review
Go ahead, review parts 2 and 3, then commit. Thanks!
Links
Yes, add inline links to papers at first mention across all three parts, like How Does a Policy Improve?. I thought footnotes might be good but the definition-highlight-style links are better.
Compositionality of programs
“What Should a Program Inherit?” also touches on compositionality of programs, so maybe we could draw a connection to the continual learning’s desideratum of compositionality of skills?