TY - GEN
T1 - Transfer learning for image classification using hebbian plasticity principles
AU - Magotra, Arjun
AU - Kim, Juntae
N1 - Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/12/6
Y1 - 2019/12/6
N2 - Transfer learning is a deep learning technique has proved to be of great importance. However, most of the standard transfer learning algorithms are designed to repeat the same method for fine-tuning of the weights on the target domain. If we try to investigate the human brain?s mechanism of learning a new complex concept based on a simple and basic concept, we can say, it is different from just the repetition of the same method of learning on a different dataset. In this article, we have introduced a novel transfer learning algorithm referred to as HTL (Hebbian transfer learning) using synaptic plasticity. The Hebbian theory, introduced by Donald Hebb, explains the "associative learning" in which the simultaneous activation of the brain cells positively affects the increase in the synaptic connection strength between the individual cells. This particular behaviour of Hebbian learning, makes it a very viable candidate for discriminative learning for the search of the specific feature for the task of object recognition or image classification. It helps connection weights of the learned model to adapt as per task dataset using numerical methods defining plasticity principles. Learning to discriminate between instances of different classes, over a variable number of classes within the dataset space defined by the task at hand, can be the result-oriented approach for classification problem. Extensive experiments verify that HTL, using synaptic plastic behaviour in heterogeneous transfer learning task does better than the standard state of the art methods of transfer learning on the cross-domain image classification task.
AB - Transfer learning is a deep learning technique has proved to be of great importance. However, most of the standard transfer learning algorithms are designed to repeat the same method for fine-tuning of the weights on the target domain. If we try to investigate the human brain?s mechanism of learning a new complex concept based on a simple and basic concept, we can say, it is different from just the repetition of the same method of learning on a different dataset. In this article, we have introduced a novel transfer learning algorithm referred to as HTL (Hebbian transfer learning) using synaptic plasticity. The Hebbian theory, introduced by Donald Hebb, explains the "associative learning" in which the simultaneous activation of the brain cells positively affects the increase in the synaptic connection strength between the individual cells. This particular behaviour of Hebbian learning, makes it a very viable candidate for discriminative learning for the search of the specific feature for the task of object recognition or image classification. It helps connection weights of the learned model to adapt as per task dataset using numerical methods defining plasticity principles. Learning to discriminate between instances of different classes, over a variable number of classes within the dataset space defined by the task at hand, can be the result-oriented approach for classification problem. Extensive experiments verify that HTL, using synaptic plastic behaviour in heterogeneous transfer learning task does better than the standard state of the art methods of transfer learning on the cross-domain image classification task.
KW - Convolutional neural network
KW - Hebbian plasticity
KW - Transferlearning
UR - http://www.scopus.com/inward/record.url?scp=85081983968&partnerID=8YFLogxK
U2 - 10.1145/3374587.3375880
DO - 10.1145/3374587.3375880
M3 - Conference contribution
AN - SCOPUS:85081983968
T3 - ACM International Conference Proceeding Series
SP - 233
EP - 238
BT - Proceedings of 2019 3rd International Conference on Computer Science and Artificial Intelligence, CSAI 2019 - Workshop - The 11th International Conference on Information and Multimedia Technology, ICIMT 2019
PB - Association for Computing Machinery
T2 - 3rd International Conference on Computer Science and Artificial Intelligence, CSAI 2019 and its Workshop - The 11th International Conference on Information and Multimedia Technology, ICIMT 2019
Y2 - 6 December 2019 through 8 December 2019
ER -