TY - JOUR
T1 - Parameter-free basis allocation for efficient multiple metric learning
AU - Kim, Dongyeon
AU - Kan, Yejin
AU - Lee, Seungmin
AU - Yi, Gangman
N1 - Publisher Copyright:
© 2023 The Author(s). Published by IOP Publishing Ltd.
PY - 2023/12/1
Y1 - 2023/12/1
N2 - Metric learning involves learning a metric function for distance measurement, which plays an important role in improving the performance of classification or similarity-based algorithms. Multiple metric learning is essential for efficiently reflecting the local properties between instances, as single metric learning has limitations in reflecting the nonlinear structure of complex datasets. Previous research has proposed a method for learning a smooth metric matrix function through data manifold to address the challenge of independently learning multiple metrics. However, this method uses the basic distance-based clustering algorithm to set the anchor points, which are the basis for local metric learning, and the number of basis metrics is dependent on the user. We propose a new method that can assign sophisticated anchor points by iteratively partitioning to identify mixed clusters of multi-class instances and cluster the most similar class instances together. In an experiment, we demonstrate the reliability of the automatically set parameter by comparison with the distribution of error rates according to the number of basis metrics of the existing algorithm. Furthermore, we show the superior performance of the proposed method over a fixed parameter setting of existing algorithms and confirm the relative classification accuracy superiority through performance comparison with baseline algorithms.
AB - Metric learning involves learning a metric function for distance measurement, which plays an important role in improving the performance of classification or similarity-based algorithms. Multiple metric learning is essential for efficiently reflecting the local properties between instances, as single metric learning has limitations in reflecting the nonlinear structure of complex datasets. Previous research has proposed a method for learning a smooth metric matrix function through data manifold to address the challenge of independently learning multiple metrics. However, this method uses the basic distance-based clustering algorithm to set the anchor points, which are the basis for local metric learning, and the number of basis metrics is dependent on the user. We propose a new method that can assign sophisticated anchor points by iteratively partitioning to identify mixed clusters of multi-class instances and cluster the most similar class instances together. In an experiment, we demonstrate the reliability of the automatically set parameter by comparison with the distribution of error rates according to the number of basis metrics of the existing algorithm. Furthermore, we show the superior performance of the proposed method over a fixed parameter setting of existing algorithms and confirm the relative classification accuracy superiority through performance comparison with baseline algorithms.
KW - multiple metric large margin nearest neighbor
KW - multiple metric learning
KW - parametric local metric learning
KW - single metric learning
UR - http://www.scopus.com/inward/record.url?scp=85180154880&partnerID=8YFLogxK
U2 - 10.1088/2632-2153/ad113b
DO - 10.1088/2632-2153/ad113b
M3 - Article
AN - SCOPUS:85180154880
SN - 2632-2153
VL - 4
JO - Machine Learning: Science and Technology
JF - Machine Learning: Science and Technology
IS - 4
M1 - 045049
ER -