# Image recognition using local features

**URL:** <https://discourse.numenta.org/t/image-recognition-using-local-features/5907>\
**Category:** Lounge\
**Created:** [April 26, 2019, 12:56pm UTC](https://discourse.numenta.org/t/image-recognition-using-local-features/5907 "2019-04-26T12:56:28Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [April 26, 2019, 12:56pm UTC](https://discourse.numenta.org/t/image-recognition-using-local-features/5907/1 "2019-04-26T12:56:28Z")

</div>

I have been pointing out that all early image recognition uses local features as there are no map-wide local connections in the cortex. Also - that convolution is not biological plausible.  
It seems that the deep learning crowd is discovering these facts.

> **[Local Relation Networks for Image Recognition](https://arxiv.org/abs/1904.11491)**
>
> The convolution layer has been the dominant feature extractor in computer
> vision for years. However, the spatial aggregation in convolution is basically
> a pattern matching process that applies fixed filters which are inefficient at
> modeling visual...

Maybe there is something to be learned by looking at how the brain works?

---

<div class="post-metadata">

**Author:** ![MaxLee](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/maxlee/32/5546_2.png) [@MaxLee](https://discourse.numenta.org/u/MaxLee)\
**Post date:** [April 26, 2019, 4:25pm UTC](https://discourse.numenta.org/t/image-recognition-using-local-features/5907/2 "2019-04-26T16:25:06Z")

</div>

I’ve been thinking about the idea you’ve presented before about how to focus on features, with something similar to tent-poles under a circus tent. With that in mind, I happened to run into the below tutorial/documentation:

[https://docs.opencv.org/3.4.4/d2/dbd/tutorial\_distance\_transform.html](https://docs.opencv.org/3.4.4/d2/dbd/tutorial_distance_transform.html)

Feels like a combination of this approach might be useful for triggering where a system should pay attention to in the first place, then derive features based on that.

Maybe it’s something, or maybe it’s nothing at all. But using the local ‘peaks’ generated with the above method, then conducting local feature recognition on that, might be an interesting approach for object segmentation + recognition.

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [April 26, 2019, 6:27pm UTC](https://discourse.numenta.org/t/image-recognition-using-local-features/5907/3 "2019-04-26T18:27:12Z")

</div>

If you use the subcortical structures as inspiration - a small non-htm network is allowable to to do a global search for the peaks and feed that back as input to direct attention.

Are you willing to move the selected areas of activity to a central window and do temporal recognition of the hot-spots as you cycle through them? The brain moves them by moving the eye.

---

<div class="post-metadata">

**Author:** ![MaxLee](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/maxlee/32/5546_2.png) [@MaxLee](https://discourse.numenta.org/u/MaxLee)\
**Post date:** [April 26, 2019, 7:31pm UTC](https://discourse.numenta.org/t/image-recognition-using-local-features/5907/5 "2019-04-26T19:31:27Z")

</div>

> [@Bitking](#):
>
> Are you willing to move the selected areas of activity to a central window and do temporal recognition of the hot-spots as you cycle through them?

For a different, completely unrelated project, I’m doing something similar already, cycling through hotspots. For given statistical max of a matrix (image), find and extract all regions that are within a standard deviation of that (dropping the rest). I suppose it could be extended to move the next deviation down.

For my project, what I do with the high points is more statistical for the sake of CPU (tiny, embedded computing platform). Hoping to get to a stopping point in that project here in the next couple of hours as well. Ideas from that could definitely flow into an attention mechanism for HTM.
