Notes from Ammar/Mocanu – Automatically Mapped Transfer Between Reinforcement Learning Tasks via Three-Way Restricted Boltzmann Machines

Notes from Ammar/Mocanu – Automatically Mapped Transfer Between Reinforcement Learning Tasks via Three-Way Restricted Boltzmann Machines

Annotations
Citation H. Ammar and D. Mocanu, “Automatically Mapped Transfer Between Reinforcement Learning Tasks via Three-Way Restricted Boltzmann Machines,” Mach. Learn. …, 2013. Abstract Existing reinforcement learning approaches are often hampered by learning tabula rasa.  Transfer for reinforcement learning tackles this problem by enabling the reuse of previously learned results, but may require an inter-task mapping to encode how the previously learned task and the new task are related.  This paper presents an autonomous framework for learning inter-task mappings based on an adaptation of restricted Boltzmann machines.  Both a full model and a computationally efficient factored model are introduced and shown to be effective in multiple transfer learning scenarios. Quotes & Notes Re:Random or not Unfortunately, learning in this model cannot be done with normal CD. The main reason is that if…
Read More

Cortical Arousal and Creativity

notes
This somewhat aligns with the previous note.   A group of people were given three tests: the Alternate Uses Test, the Remote Associates Test, and an intelligence test.  These tests test Creativity, a blend of Creativity and Intelligence, and Intelligence, respectively.  EEG's revealed that among two groups (highly creative and medium-to-low), the former showed more of a differential among the three tests than did the less creative subjects.  That is, those scoring high on the creativity tests had a lower state of arousal during those tests and higher activation on the intelligence test.  Those scoring lower on the creativity tests showed higher states of arousal. This suggests that the mechanisms of creativity are associated with neurophysiological states that occur during low cortical arousal.  I'd be interested to know if there…
Read More

Elements of Creativity

notes
I've created a new category for reading notes.  I need to be able to quickly put down notes, save them, and be able to recall them later.  They may make no sense whatsoever. "The stages are preparation, incubation, illumination or inspiration, and verification or elaboration." - Martindale, C. (1999) Biological Bases of Cretivity.  Cambridge, UK.  Cambridge University Press. My thoughts are: Preparation amounts to building the knowledge or store of concepts.  Incubation is the period where the unconscious cognition processes the the knowledge, and illumination is the stage where the newly formed concept becomes active enough to cross the threshold into conscious thought. There is much going on "under-the-hood" so to speak, in terms of cognition - so much outside of the perview of our mind's eye.  If you think…
Read More