Note about the memory effects seen when you use linear mappings as associative memory.
Prior memories can hang around for a long time, including random memories programmed in by random initialization.
That’s because storing new memories only slightly damages prior memories, then it’s just a hit count of how many new memory training examples have damaged a prior memory and by how much.
https://archive.org/details/linear-associative-memory-dynamics-and-ccslm