Hi all, I have a question about the sequence memory proposed by Subutai and Jeff. I don’t quite get why the minicolumn approach is better than
and-ing the underlying bitvectors.
for example for sequence A,B,C,D
A B C D 0100 0101 0110 0111
doing a pairwise collapsing
A & B -> 0100 B & C -> 0100 C & D -> 0110
ABC -> 0100 (AB & BC) BCD -> 0100 (BC & CD)
ABCD -> 0100 (ABC & BCD)
by sequentially collapsing the sequences wouldn’t it lead to a multi-level hierarchical sequence memory? The above encoding is obviously not the actual way one would do it, with proper encoding could this work?