SP activation does not have to be binary. In our experiment in pytorch we kept everything scalar. Stay tuned we just submitted this to a conference, and I’m not sure what the privacy rules are about submissions. But I’ve read the paper and it looks like exciting results to me. I promise I’ll share it as soon as we are able, but I don’t know all the details yet.