Combining the perceptron algorithm with logarithmic simulated annealing

Albrecht, Andreas A. and Wong, C. K. (2001) Combining the perceptron algorithm with logarithmic simulated annealing. Neural Processing Letters, 14 (1) . pp. 75-83. ISSN 1370-4621 (doi:10.1023/A:1011369322571)

Abstract

We present results of computational experiments with an extension of the Perceptron algorithm by a special type of simulated annealing. The simulated annealing procedure employs a logarithmic cooling schedule c(k)=Γ/ln(k+2) , where Γ is a parameter that depends on the underlying configuration space. For sample sets S of n-dimensional vectors generated by randomly chosen polynomials w1⋅xa11+⋅⋅⋅+wn⋅xann⩾ϑ , we try to approximate the positive and negative examples by linear threshold functions. The approximations are computed by both the classical Perceptron algorithm and our extension with logarithmic cooling schedules. For n = 256,...,1024 and ai=3,...,7 , the extension outperforms the classical Perceptron algorithm by about 15% when the sample size is sufficiently large. The parameter Γ was chosen according to estimations of the maximum escape depth from local minima of the associated energy landscape. Γ

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 12407
Depositing User: Andreas Albrecht
Date Deposited: 12 Nov 2013 07:20
Last Modified: 12 Jun 2019 12:43
URI: https://eprints.mdx.ac.uk/id/eprint/12407

Actions (login required)

View Item View Item