Storage capacity of a fully-connected parity machine with continuous weights
SCIE
SCOPUS
- Title
- Storage capacity of a fully-connected parity machine with continuous weights
- Authors
- Xiong, YS; Kwon, C; Oh, JH
- Date Issued
- 1998-08-28
- Publisher
- IOP PUBLISHING LTD
- Abstract
- We study a fully-connected parity machine with K hidden units for continuous weights. The geometrical structure of the weight space of this model is analysed in terms of the volumes associated with the internal representations of the training set. By examining the asymptotic behaviour of order parameters in the large K limit, we find the maximum number ru,, the storage capacity, of patterns per input unit to be K In K/ln2 up to leading order, which saturates the mathematical bound given by Mitchison and Durbin. Unlike the committee machine, the storage capacity per weight remains unchanged compared with the corresponding tree-like architecture.
- Keywords
- MULTILAYER NEURAL NETWORKS; INTERNAL REPRESENTATIONS; STATISTICAL-MECHANICS; COMMITTEE-MACHINES; SPACE STRUCTURE
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/20661
- DOI
- 10.1088/0305-4470/31/34/007
- ISSN
- 0305-4470
- Article Type
- Article
- Citation
- JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, vol. 31, no. 34, page. 7043 - 7049, 1998-08-28
- Files in This Item:
- There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.