收藏切换
Online Cross-Modal Hashing with Double Structure Preserving
收藏切换
Xiao Kang1, Xingbo Liu2, *, Pengyu Lu2, Zhijie Zhao2, Xiushan Nie2, Shaohua Wang2, Yilong Yin1
Journal of Computer Research and Development | 2024, 61(11) : 2923 - 2936
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(11): 2923-2936
• Artificial Intelligence •
Online Cross-Modal Hashing with Double Structure Preserving
Full
Xiao Kang1, Xingbo Liu2, *, Pengyu Lu2, Zhijie Zhao2, Xiushan Nie2, Shaohua Wang2, Yilong Yin1
Affiliations
  • 1School of Software, Shandong University, Jinan 250101
  • 2School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101
  • born in 1997. PhD. Her main research interests include multimedia retrieval and computer vision

    born in 1995. PhD, professor. His main research interests include multimedia retrieval and computer vision

    born in 1998. PhD candidate. Her main research interests include machine learning and artificial neural network. ()

    born in 1999. Master candidate. Her main research interests include multimedia retrieval and computer vision. ()

    born in 1981. PhD, professor. His main research interests include multimedia retrieval, multimedia security, and computer vision. ()

    born in 1979. PhD, senior engineer. Member of CCF. Her main research interests include multimedia retrieval and computer vision. ()

    born in 1972. PhD, professor, PhD supervisor. His main research interests include machine learning and data mining. ()

About Author:

born in 1997. PhD. Her main research interests include multimedia retrieval and computer vision

born in 1995. PhD, professor. His main research interests include multimedia retrieval and computer vision

born in 1998. PhD candidate. Her main research interests include machine learning and artificial neural network. ()

born in 1999. Master candidate. Her main research interests include multimedia retrieval and computer vision. ()

born in 1981. PhD, professor. His main research interests include multimedia retrieval, multimedia security, and computer vision. ()

born in 1979. PhD, senior engineer. Member of CCF. Her main research interests include multimedia retrieval and computer vision. ()

born in 1972. PhD, professor, PhD supervisor. His main research interests include machine learning and data mining. ()

Published: 2024-11-01 doi: 10.7544/issn1000-1239.202330433
Outline
收藏切换

Online cross-modal hashing has received increasing attention due to its efficiency and effectiveness in handling cross-modal streaming data retrieval. Despite promising progress, most existing methods rely on accurate and clear supervised information. There are only a few online cross-modal hashing studies concentrating on unsupervised learning mode, and numerous challenges still need to be tackled. For example, streaming data usually suffer from the unbalanced distribution problem due to the limited volume of data in each chunk. Most existing methods neglect this problem, resulting in heightened sensitivity to outlier samples and compromised robustness. Moreover, existing models typically exploit global data distribution, while ignoring local neighborhood information that can promote hash learning. To solve these problems, we propose an unsupervised online cross-modal hashing method with double structure-preserving, called SPOCH(structure preserving online cross-modal hashing). It simultaneously explores the global structure and local structure to generate the corresponding common representation; thereafter, the learned common representation can be used to guide the hash learning process. In terms of global structure-preserving, we design the loss function based on $ {L}_{2,1} $ norm, which can alleviate the sensitivity of outlier samples. In terms of local structure-preserving, we reconstruct sample representation based on neighbor relations that integrates the multi-modality information. In addition, to alleviate the forgetting problem, we propose joint optimization on streaming data, and design the corresponding update strategy to improve the training efficiency. We conduct experiments on two widely-used cross-modal retrieval datasets. Compared with the existing state-of-the-art unsupervised online cross-modal hashing methods, SPOCH achieves superior retrieval accuracy within a comparable or even shorter training time, validating the effectiveness of the proposed approach.

cross-modal retrieval  /  unsupervised learning  /  online hashing  /  double structure preserving  /  robustness
康潇, 刘兴波, 卢鹏宇, 赵志杰, 聂秀山, 王少华, 尹义龙. 双重结构保持的在线跨模态哈希. 计算机研究与发展, 2024 , 61 (11) : 2923 -2936 . DOI: 10.7544/issn1000-1239.202330433
Xiao Kang, Xingbo Liu, Pengyu Lu, Zhijie Zhao, Xiushan Nie, Shaohua Wang, Yilong Yin. Online Cross-Modal Hashing with Double Structure Preserving[J]. Journal of Computer Research and Development, 2024 , 61 (11) : 2923 -2936 . DOI: 10.7544/issn1000-1239.202330433
Year 2024 volume 61 Issue 11
77
37
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330433
  • Receive Date:2023-06-05
  • Online Date:2026-11-17
  • Published:2024-11-01
Article Data
Affiliations
History
  • Received:2023-06-05
  • Revised:2023-12-19
Affiliations
    1School of Software, Shandong University, Jinan 250101
    2School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330433
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT