Sparse Distributed Representations Quiz

Science Numenta Theory
, ,
1

Useful reference: Properties of Sparse Distributed Representations

  1. What are disadvantages of SDR’s?
  2. What does the “distributed” part of SDR mean?
  3. Why is sparsity necessary? How sparse do representations need to be? Can they be too sparse?
  4. Which is better? n=1000 and w=3 or n=300 and w=15
  5. For representations with 33 active bits out of 500 total, how many unique representations are there? If we randomly generate 100 of these representations, how likely is it that two of the hundred will be identical? If we randomly generate two of these representations, how likely is it that they will share more than 5 active bits?
  6. When creating an encoder for a new data type, what makes a good SDR? How can you test that the SDRs that are produced are good?
  7. How would you encode sound as SDRs?
2 Likes
2

5 posts were split to a new topic: How to create an SDR from an image