| Download | - View final version: Biologically-based neural representations enable fast online shallow reinforcement learning (PDF, 398 KiB)
|
|---|
| Author | Search for: Bartlett, Madeleine; Search for: Stewart, Terrence C.1; Search for: Orchard, Jeff |
|---|
| Affiliation | - National Research Council of Canada. Digital Technologies
|
|---|
| Format | Text, Article |
|---|
| Conference | 44th Annual Meeting of the Cognitive Science Society: Cognitive Diversity, CogSci 2022, July 27-30, 2022, Toronto, ON, Canada |
|---|
| Subject | grid cells; reinforcement learning; spatial semantic pointers |
|---|
| Abstract | Biological brains learn much more quickly than standard deep neural network reinforcement learning algorithms. One reason for this is that the deep neural networks need to learn a representation that is appropriate for the task at hand, whilst biological systems already possess an appropriate representation. Here, we bypass this problem by imposing on the neural network a representation based on what is observed in biology, such as grid cells. This study explores the impact of using a biologically-inspired grid-cell representation vs. a one-hot representation, on the speed at which a Temporal Difference-based Actor-Critic network learns to solve a simple 2D gridworld reinforcement learning task. The results suggest that the use of grid cells does promote faster learning. Furthermore, the grid cells implemented here have the potential for accurately representing unbounded continuous space. Thus, their promising performance on this discrete task acts as a first step in exploring their utility for reinforcement learning in continuous space. © 2022 The Author(s). This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY) |
|---|
| Publication date | 2022-07-27 |
|---|
| Publisher | The Cognitive Science Society |
|---|
| Licence | |
|---|
| In | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | c0ffc77c-d09b-4c7a-8b11-3d2b3b0fd0c2 |
|---|
| Record created | 2023-05-15 |
|---|
| Record modified | 2023-05-16 |
|---|
