I find that working through David Marr’s 3 levels is helpful in the evaluation phase.
I also find that going on long walks and dictating/explaining a given process into my cell phone to be helpful.
Each time I try to work up a slightly better version of the explanations and work through some of the areas I am struggling with. If you can’t explain it to yourself you don’t really understand it.
I do transcribe some of these sessions and it helps to reexamine some of the random threads and conjecture that pop up during these walks. This drives my internet searches and subsequent reading. This new reading leads to filling in some of the murky areas and a fuller picture of the whole AI landscape.
At latest count, I have about 6000 papers that I have downloaded or have links to. They are sorted by general topic. My electronics engineering, programming, neurology, and AI books fill most of a standard 6-foot high by 3-foot book shelve unit. Each book is read as it comes in. The PDP (parallel distributed processing)-David Rumelhart & James McClelland, Vision-David Marr, Gödel-Escher-Bach-Douglas Hofstadter, Neurophilosophy-Patricia Churchland, and the On Intelligence-Jeff Hawkins & Sandra Blakeslee books were some of the most influential when I encountered them. Each was a “whack on the side of the head” that caused me to think differently about what I thought I knew.
This return to the resources is a key part of the theorizing. I find it endlessly amazing that when it comes to studying the brain - people have been poking around on this for over 100 years. I have yet to ask a question and not find that someone has been studying that topic in great detail and published the results. This useful chuck of knowledge is just waiting for me find it and fit it to the question I am asking.
I think that the study of the brain is much like an earlier state of chemistry before the periodic table - everything is there just waiting for the right person to come along and rearrange the bits and bobs in a way that reveals the greater structure waiting to be discovered.
I have been doing this for most of 20 years now and some of this stuff is starting to make sense. I still have many questions about data format and processing algorithms.
If I had done one thing differently on this journey it would be to have made some sort of indexing system for interesting bits as I encountered them. I have a few things that I remember reading but I can’t remember where I read them. This was much worse before the internet when I was doing interlibrary loans and had to give the books back when I was done reading them.
 Marr’s Levels of Analysis