Adaptive function modal learning neural networks

Kang, Miao (2011) Adaptive function modal learning neural networks. Doctoral thesis, London Metropolitan University.

536730.pdf - Published Version

Download (11MB) | Preview

Abstract / Description

Modal learning method is a neural network learning term that refers to a single neural network which combines with more than one mode of learning. It aims to achieve more powerful learning results than a neural network combines with only one single mode of learning. This thesis introduces a novel modal learning Adaptive Function Neural Network (ADFUNN) with the aim to overcome the linear inseparability limitation in a single weight layer supervised network. Adaptation in the function mode of learning within individual neurons is carried out in parallel with the traditional weights adaptation mode of learning between neurons; thus producing a more powerful, flexible form of learning. ADFUNN employs modifiable linear piecewise neuron activation functions and meanwhile adapts the weights using a modified delta learning rule. Experimental results show the single layer ADFUNN is highly effective at assimilating and generalising on many linearly inseparable problems, such as the Iris dataset, and a natural language phrase recognition task. A multi-layer approach, a Multi-layer ADFUNN (MADFUNN) is introduced to solve highly complex datasets. It aims to find a suitably restricted subset of neuron activation functions which has a good representational capacity and enables efficient learning for complex models with large datasets. Experiments on analytical function recognition and letter image recognition are solved by MADFUNN with high levels of recognition. In order to further explore modal learning, ADFUNN is combined with an unsupervised modal learning neural network called Snap-Drift (Palmer-Brown and Lee) to create a Snap-drift ADFUNN (SADFUNN). It is used to solve an optical and pen-based handwritten digit recognition task from the DCI machine learning repository and exhibits more powerful generalisation ability than the MLPs. An additional benefit of ADFUNN, as well as a MADFUNN and SADFUNN, is that the learned functions can support intelligent data analysis. These learned activation function curves reveal many useful information about the data.

Item Type: Thesis (Doctoral)
Additional Information:
Uncontrolled Keywords: Modal learning method; neural networks; Adaptive Function Neural Network (ADFUNN); neuron activation functions; modified delta learning rule; Iris dataset; natural language phrase recognition; analytical function recognition; letter image recognition; handwritten digit recognition; multi-layer approach; Snap-Drift
Subjects: 000 Computer science, information & general works
Department: School of Computing and Digital Media
Depositing User: Chiara Repetto
Date Deposited: 28 Apr 2022 11:04
Last Modified: 28 Apr 2022 11:04


Downloads per month over past year

Downloads each year

Actions (login required)

View Item View Item