Srivastava, Rupesh Kumar and Steunebrink, Bastiaan and Schmidhuber, Juergen (2013) First experiments with PowerPlay. Neural Networks, 41. pp. 130-136. ISSN 0893-6080
Full text not available from this repository.Abstract
Like a scientist or a playing child, PowerPlay not only learns new skills to solve given problems, but also invents new interesting problems by itself. By design, it continually comes up with the fastest to find, initially novel, but eventually solvable tasks. It also continually simplifies or compresses or speeds up solutions to previous tasks. Here we describe first experiments with PowerPlay. A self-delimiting recurrent neural network SLIM RNN is used as a general computational problem solving architecture. Its connection weights can encode arbitrary, self-delimiting, halting or non-halting programs affecting both environment (through effectors) and internal states encoding abstractions of event sequences. Our PowerPlay-driven SLIM RNN learns to become an increasingly general solver of self-invented problems, continually adding new problem solving procedures to its growing skill repertoire. Extending a recent conference paper, we identify interesting, emerging, developmental stages of our open-ended system. We also show how it automatically self-modularizes, frequently re-using code for previously invented skills, always trying to invent novel tasks that can be quickly validated because they do not require too many weight changes affecting too many previous tasks.
| Item Type: | Scientific journal article, Newspaper article or Magazine article |
|---|---|
| Uncontrolled Keywords: | PowerPlay; Problem invention; Discovery; Self-delimiting recurrent neural network; Skill learning; Self-modularization |
| Subjects: | Computer sciences > Artificial intelligence > Knowledge representation Computer sciences > Artificial intelligence > Neural computing |
| Department/unit: | Dipartimento tecnologie innovative > Istituto Dalle Molle di studi sull’intelligenza artificiale USI-SUPSI |
| Depositing User: | Rupesh Kumar Srivastava |
| Date Deposited: | 14 Mar 2014 08:14 |
| Last Modified: | 23 May 2016 13:04 |
| URI: | http://repository.supsi.ch/id/eprint/4466 |
Actions (login required)
 |
View Item |