I’ve been thinking for the past couple of weeks that a mini-column might be capable of representing a scalar value. Mostly I was thinking of this in the context of storing a scalar coefficient that could be used to reconstruct an input signal as a linear combination of basis functions. It occurred to me that there was sufficient resolution in even a sparse representation in a small number of bits (~100) to form effective approximations to a wide variety of input patterns if they were used to essentially scale each of the basis functions at a somewhat coarse granularity. It might even be that some mini-columns utilize a non-linear scale (e.g. logarithmic) to represent a wider range of values.
2 Likes