Article(id=1322594233769373788, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1322594153020641347, articleNumber=null, orderNo=null, doi=10.20104/j.cnki.1674-6546.20260127, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=null, receivedDateStr=null, revisedDate=1782403200000, revisedDateStr=2026-06-26, acceptedDate=null, acceptedDateStr=null, onlineDate=1793260637943, onlineDateStr=2026-10-29, pubDate=1791993600000, pubDateStr=2026-10-15, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1793260637943, onlineIssueDateStr=2026-10-29, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1793260637943, creator=13701087609, updateTime=1793260637943, updator=13701087609, issue=Issue{id=1322594153020641347, tenantId=1146029695717560320, journalId=1189918454225211397, year='2026', volume='', issue='10', pageStart='1', pageEnd='48', issueExtLink='null', onlineDate='null', pubDate='1791993600000', pubDateStr='2026-10-15', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=1, specialIssue=null, createTime=1793260618691, creator='13701087609', updateTime=1793261887162, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1322599473793060887, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1322594153020641347, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1322599473793060888, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1322594153020641347, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=26, endPage=33, ext={EN=ArticleExt(id=1322594235933634658, articleId=1322594233769373788, tenantId=1146029695717560320, journalId=1189918454225211397, language=EN, title=An Intelligent Recognition Method for In-Vehicle Points of Interest Fusing Audio-Visual-Gesture Multimodal Spatiotemporal Localization, columnId=1322594154186657860, journalTitle=Automotive Engineer, columnName=Selected Papers of SAECCE 2026, runingTitle=null, highlight=null, articleAbstract=

To address the issues of noise sensitivity, ambiguous intent, and missing directional information in single-modality voice interaction for in-vehicle scenarios, the paper proposes a multimodal Point-of-Interest (POI) intelligent recognition method that fuses speech, vision, and gesture. The method establishes a four-layer system architecture comprising data collection, preprocessing, core algorithm, and interaction output. For speech intent recognition, Low-Rank Adaptation (LoRA) fine-tuned Qwen-7B is employed to generate structured intent output. For spatiotemporal localization, a fan-shaped region-based multi-strategy retrieval mechanism is designed, which integrates speech directional words with gaze direction, gesture pointing or navigation route, reducing the candidate POI scale by 74.47%. For comprehensive prediction, Qwen-VL is utilized to achieve cross-modal attention fusion for POI ranking. Experimental results on a self-built in-vehicle multimodal dataset demonstrate that the proposed method achieves an accuracy of 85.4% and an F1-score of 84.3%, improving by 8.6 and 7.7 percentage points respectively over the best baseline. Under 0 dB SNR conditions, the accuracy remains at 70.1%, confirming the robust effectiveness of multimodal fusion in vehicular noise environments.

, authors=Zhenlong Li, Honglei Wang, Wanshun Qiao, Zelei Gao, Yao Zhang, authorsList=Zhenlong Li, Honglei Wang, Wanshun Qiao, Zelei Gao, Yao Zhang, authorCompany=null, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1322594240039858278, articleId=1322594233769373788, tenantId=1146029695717560320, journalId=1189918454225211397, language=CN, title=融合语音-视觉-手势多模态时空定位的车载兴趣点智能识别方法, columnId=1322594154534785094, journalTitle=汽车工程师, columnName=2026中国汽车工程学会年会优秀论文(选登), runingTitle=null, highlight=null, articleAbstract=

针对车载场景下单一语音交互模式存在的噪声敏感、意图模糊和方向信息缺失等问题,提出一种融合语音、视觉与手势的多模态车载兴趣点(POI)智能识别方法。构建了包含数据采集、预处理、核心算法与交互输出的系统架构:在语音意图识别环节,采用低秩适应(LoRA)方法微调通义千问-7B(Qwen-7B)模型,实现结构化意图输出;在时空定位环节,设计基于扇形区域的多策略检索机制,将语音方向词与视线方向、手势指向或导航路线相融合,使候选POI规模缩减74.47%;在综合预测环节,利用通义千问-VL(Qwen-VL)实现跨模态注意力融合,完成POI排序推荐。在自建车载多模态数据集上的试验结果表明,所提出方法的准确率达85.4%,F1值达84.3%,较最优基线方法分别提升8.6百分点和7.7百分点,且在信噪比0 dB条件下仍保持70.1%的准确率,验证了多模态融合对车载噪声环境的鲁棒性。

, authors=李振龙, 王洪磊, 乔万顺, 高泽磊, 张耀, authorsList=李振龙, 王洪磊, 乔万顺, 高泽磊, 张耀, authorCompany=null, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=q9JujZkfAuGwVFY9o1rhng==, magXml=bHUP2gw/A2+9K8P1RNYL6w==, pdfUrl=null, pdf=hPf5oAr0dnFBApLt3SzsQA==, pdfFileSize=1982536, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=LlZDRMKt1W8fKgWSbNlU7A==, mapNumber=null, fund=null)}, authors=[Author(id=1322594245538590831, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594245953826929, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594245538590831, language=EN, stringName=Zhenlong Li, firstName=Zhenlong, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594246754938996, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594245538590831, language=CN, stringName=李振龙, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594247593799799, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594248063561850, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594247593799799, language=EN, stringName=Honglei Wang, firstName=Honglei, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594248512352379, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594247593799799, language=CN, stringName=王洪磊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594250194268285, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594251024740480, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594250194268285, language=EN, stringName=Wanshun Qiao, firstName=Wanshun, middleName=null, lastName=Qiao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594251817463937, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594250194268285, language=CN, stringName=乔万顺, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594253046395012, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594254363406470, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594253046395012, language=EN, stringName=Zelei Gao, firstName=Zelei, middleName=null, lastName=Gao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594255646863498, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594253046395012, language=CN, stringName=高泽磊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594256045322380, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594256888377486, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594256045322380, language=EN, stringName=Yao Zhang, firstName=Yao, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594259342045328, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594256045322380, language=CN, stringName=张耀, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])])], keywords=[Keyword(id=1322594260256403601, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=EN, orderNo=1, keyword=Multimodal fusion), Keyword(id=1322594261074292882, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=EN, orderNo=2, keyword=In-vehicle interaction), Keyword(id=1322594261460168851, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=EN, orderNo=3, keyword=POI recognition), Keyword(id=1322594261527277716, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=EN, orderNo=4, keyword=Large language model), Keyword(id=1322594263574098069, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=EN, orderNo=5, keyword=Spatiotemporal localization), Keyword(id=1322594264048054422, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=CN, orderNo=1, keyword=多模态融合), Keyword(id=1322594264815612055, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=CN, orderNo=2, keyword=车载交互), Keyword(id=1322594265251819672, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=CN, orderNo=3, keyword=兴趣点识别), Keyword(id=1322594265692221594, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=CN, orderNo=4, keyword=大语言模型), Keyword(id=1322594266094874779, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, language=CN, orderNo=5, keyword=时空定位)], refs=[Reference(id=1322594268166860956, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=ZHANG Z X, LI Y, REN W, et al. A Secure and Robust Multimodal Framework for In-Vehicle Voice Control: Integrating Bilingual Wake-up, Speaker Verification, and Fuzzy Command Understanding[J]. Eng, 2025, 6(11)., articleTitle=null, refAbstract=null), Reference(id=1322594268607262877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[2], rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=KUNST K, HOFFMANN D, ERKAN A, et al. Analyzing Gaze During Driving: Should Eye Tracking Be Used to Design Automotive Lighting Functions? [J]. Journal of Eye Movement Research, 2025, 18(2)., articleTitle=null, refAbstract=null), Reference(id=1322594269072830622, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=陈启博,闫坤,陈杰伟,等.基于Kinect和改进DTW的交通指挥手势识别方法[J].桂林电子科技大学学报,2026,46(1):59-66., articleTitle=null, refAbstract=null), Reference(id=1322594269504843935, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=CHEN Q B, YAN K, CHEN J W, et al. Traffic Command Gesture Recognition Method Based on Kinect and Improved DTW[J]. Journal of Guilin University of Electronic Technology, 2026, 46(1): 59-66., articleTitle=null, refAbstract=null), Reference(id=1322594270238847136, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[4], rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=DARAPISUT S, AMPHAWAN K, LEELATHAKUL N, et al. A Hybrid POI Recommendation System Combining Link Analysis and Collaborative Filtering Based on Various Visiting Behaviors[J]. ISPRS International Journal of Geo-Information, 2023, 12(10)., articleTitle=null, refAbstract=null), Reference(id=1322594270687637665, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=陈勇,周宇翔,王秀毅,等.一种基于BERT预训练语言模型的语音指令识别方法:CN119479646A[P].2025-02-18., articleTitle=null, refAbstract=null), Reference(id=1322594272365359266, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=CHEN Y, ZHOU Y X, WANG X Y, et al. A Speech Command Recognition Method Based on BERT Pre-Trained Language Model: CN119479646A[P]. 2025-02-18., articleTitle=null, refAbstract=null), Reference(id=1322594272780595363, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=DONG H M, WANG W B, JIANG D L, et al. PC-LLMRec: Large Language Model for Personalized Interaction Recommendations in Intelligent Cockpit[J]. IET Intelligent Transport Systems, 2026, 20(1)., articleTitle=null, refAbstract=null), Reference(id=1322594273611067556, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[7], rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=LI K, XU L, ZHU C, et al. A Multimodal Graph Recommendation Method Based on Cross-Attention Fusion[J]. Mathematics, 2024, 12(15)., articleTitle=null, refAbstract=null), Reference(id=1322594274022109349, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[8], rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=ZHANG Q, ZENG S Z, CHEN Y R, et al. Adaptive Fusion of Dual-Scale Preference Disentanglement for Next POI Recommendation[J]. IEEE Access, 2026, 14: 5855-5868. DOI: 10.1109/ACCESS.2025.3647754., articleTitle=null, refAbstract=null), Reference(id=1322594274747723942, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[9], rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=YE M, YIN P F, LEE W C, et al. Exploiting Geographical Influence for Collaborative Point-of-Interest Recommendation[C]// Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. Beijing China: Association for Computing Machinery, 2011: 325-334., articleTitle=null, refAbstract=null), Reference(id=1322594274890330280, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=KIM Y. Convolutional Neural Networks for Sentence Classification[C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computational Linguistics, 2014: 1746-1751., articleTitle=null, refAbstract=null)], funds=null, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])], figs=null, attaches=null, journal=Journal(id=1189918244568731652, delFlag=0, nameCn=汽车工程师, nameEn=Automotive Engineer, nameHistory1=null, nameHistory2=null, issn=1674-6546, eissn=null, cn=22-1432/U, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=+bJsKkKt/pjz9u6EwhnksQ==, journalPrice=null, startedYear=null, abbrevIsoEn=null, journalRemark=null, publicationField=null, createdTime=1761628217121, updatedTime=1784016483331, createdBy=18614031015, updatedBy=13041195026, firstLetterCn=Q, firstLetterEn=Q, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=+bJsKkKt/pjz9u6EwhnksQ==, picEn=O3Sn3tnYYrh/jm6emnnMWA==, jcr=null, cjcr=null, exts=[JournalExt(id=1283821440269004922, language=CN, name=汽车工程师, nameHistory1=null, nameHistory2=null, managedBy=中国第一汽车集团有限公司, sponsoredBy=中国第一汽车集团有限公司, publishedBy=中国第一汽车集团有限公司, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1784016483609, updatedTime=1784016483609, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1283821440319336571, language=EN, name=Automotive Engineer, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1784016483621, updatedTime=1784016483621, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1189918454225211397, websiteList=[Website(id=1189918982430847716, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189918454225211397, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcgcs/CN, language=CN, createTime=1761628393037, createBy=18614031015, updateTime=1761628422913, updateBy=18614031015, name=汽车工程师-中文, tplId=1146099689490845704, title=汽车工程师, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189919800185917791, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=articleTextType, value=kx, createTime=1761628588005, updateTime=1761628588005, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800164946268, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=banner, value=null, createTime=1761628588000, updateTime=1761628588000, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800211083618, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=grayFlag, value=0, createTime=1761628588011, updateTime=1761628588011, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800156557659, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=logo, value=https://castjournals.cast.org.cn/joweb/qcgcs/CN/file/pic?fileId=yiZ96RYoYcnGnRMuWdmkWA==, createTime=1761628587998, updateTime=1761628587998, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800223666532, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=minRunFlag, value=0, createTime=1761628588014, updateTime=1761628588014, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800181723486, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcgcs/CN/file/pic, createTime=1761628588004, updateTime=1761628588004, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800215277923, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=silenceFlag, value=0, createTime=1761628588012, updateTime=1761628588012, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800173334877, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1761628588002, updateTime=1761628588002, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800194306400, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=themeColor, value=null, createTime=1761628588007, updateTime=1761628588007, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800202695009, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=themeStyle, value=null, createTime=1761628588009, updateTime=1761628588009, creator=18614031015, updator=18614031015)]), Website(id=1189918982527316711, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189918454225211397, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcgcs/EN, language=EN, createTime=1761628393061, createBy=18614031015, updateTime=1761628543075, updateBy=18614031015, name=汽车工程师-英文, tplId=1146101810881728533, title=Automotive Engineer, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189919837561352952, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=articleTextType, value=kx, createTime=1761628596916, updateTime=1761628596916, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837540381429, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=banner, value=null, createTime=1761628596911, updateTime=1761628596911, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837582324475, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=grayFlag, value=0, createTime=1761628596921, updateTime=1761628596921, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837527798516, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=logo, value=https://castjournals.cast.org.cn/joweb/qcgcs/EN/file/pic?fileId=yiZ96RYoYcnGnRMuWdmkWA==, createTime=1761628596908, updateTime=1761628596908, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837594907389, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=minRunFlag, value=0, createTime=1761628596924, updateTime=1761628596924, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837557158647, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcgcs/EN/file/pic, createTime=1761628596915, updateTime=1761628596915, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837586518780, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=silenceFlag, value=0, createTime=1761628596922, updateTime=1761628596922, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837548770038, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1761628596913, updateTime=1761628596913, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837569741561, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=themeColor, value=null, createTime=1761628596918, updateTime=1761628596918, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837573935866, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=themeStyle, value=null, createTime=1761628596919, updateTime=1761628596919, creator=18614031015, updator=18614031015)])], journalTitle=汽车工程师, weixinUrl=null, journalUrl=https://tjqc.cbpt.cnki.net/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Automotive Engineer, journalPhotoCn=+bJsKkKt/pjz9u6EwhnksQ==, journalPhotoEn=O3Sn3tnYYrh/jm6emnnMWA==, journalFirstLetter=Q, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/qcgcs/CN/10.20104/j.cnki.1674-6546.20260127, detailUrlEn=https://castjournals.cast.org.cn/joweb/qcgcs/EN/10.20104/j.cnki.1674-6546.20260127, pdfUrlCn=https://castjournals.cast.org.cn/joweb/qcgcs/CN/PDF/10.20104/j.cnki.1674-6546.20260127, pdfUrlEn=https://castjournals.cast.org.cn/joweb/qcgcs/EN/PDF/10.20104/j.cnki.1674-6546.20260127, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1791993600000, fullTextJson=null, articleText=null, reference=null)
收藏切换
融合语音-视觉-手势多模态时空定位的车载兴趣点智能识别方法
收藏切换
PDF下载
李振龙 , 王洪磊 , 乔万顺 , 高泽磊 , 张耀
汽车工程师 | 2026中国汽车工程学会年会优秀论文(选登) 2026,(10): 26-33
收起
收藏切换
汽车工程师 |2026中国汽车工程学会年会优秀论文(选登) 2026 , (10) : 26 -33
融合语音-视觉-手势多模态时空定位的车载兴趣点智能识别方法
全屏
[Author(id=1322594245538590831, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594245953826929, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594245538590831, language=EN, stringName=Zhenlong Li, firstName=Zhenlong, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594246754938996, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594245538590831, language=CN, stringName=李振龙, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594247593799799, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594248063561850, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594247593799799, language=EN, stringName=Honglei Wang, firstName=Honglei, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594248512352379, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594247593799799, language=CN, stringName=王洪磊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594250194268285, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594251024740480, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594250194268285, language=EN, stringName=Wanshun Qiao, firstName=Wanshun, middleName=null, lastName=Qiao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594251817463937, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594250194268285, language=CN, stringName=乔万顺, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594253046395012, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594254363406470, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594253046395012, language=EN, stringName=Zelei Gao, firstName=Zelei, middleName=null, lastName=Gao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594255646863498, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594253046395012, language=CN, stringName=高泽磊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])]), Author(id=1322594256045322380, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322594256888377486, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594256045322380, language=EN, stringName=Yao Zhang, firstName=Yao, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=FAW Car Co., Ltd., Changchun 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322594259342045328, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, authorId=1322594256045322380, language=CN, stringName=张耀, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=一汽奔腾汽车股份有限公司,长春 130012, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322594243848286315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, xref=null, ext=[AuthorCompanyExt(id=1322594243873452140, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=FAW Car Co., Ltd., Changchun 130012), AuthorCompanyExt(id=1322594243911200877, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1322594233769373788, companyId=1322594243848286315, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=一汽奔腾汽车股份有限公司,长春 130012)])])]
李振龙, 王洪磊, 乔万顺, 高泽磊, 张耀
作者信息
  • 一汽奔腾汽车股份有限公司,长春 130012
An Intelligent Recognition Method for In-Vehicle Points of Interest Fusing Audio-Visual-Gesture Multimodal Spatiotemporal Localization
Zhenlong Li, Honglei Wang, Wanshun Qiao, Zelei Gao, Yao Zhang
Affiliations
  • FAW Car Co., Ltd., Changchun 130012
出版时间: 2026-10-15 doi: 10.20104/j.cnki.1674-6546.20260127
文章导航
收藏切换

针对车载场景下单一语音交互模式存在的噪声敏感、意图模糊和方向信息缺失等问题,提出一种融合语音、视觉与手势的多模态车载兴趣点(POI)智能识别方法。构建了包含数据采集、预处理、核心算法与交互输出的系统架构:在语音意图识别环节,采用低秩适应(LoRA)方法微调通义千问-7B(Qwen-7B)模型,实现结构化意图输出;在时空定位环节,设计基于扇形区域的多策略检索机制,将语音方向词与视线方向、手势指向或导航路线相融合,使候选POI规模缩减74.47%;在综合预测环节,利用通义千问-VL(Qwen-VL)实现跨模态注意力融合,完成POI排序推荐。在自建车载多模态数据集上的试验结果表明,所提出方法的准确率达85.4%,F1值达84.3%,较最优基线方法分别提升8.6百分点和7.7百分点,且在信噪比0 dB条件下仍保持70.1%的准确率,验证了多模态融合对车载噪声环境的鲁棒性。

多模态融合  /  车载交互  /  兴趣点识别  /  大语言模型  /  时空定位

To address the issues of noise sensitivity, ambiguous intent, and missing directional information in single-modality voice interaction for in-vehicle scenarios, the paper proposes a multimodal Point-of-Interest (POI) intelligent recognition method that fuses speech, vision, and gesture. The method establishes a four-layer system architecture comprising data collection, preprocessing, core algorithm, and interaction output. For speech intent recognition, Low-Rank Adaptation (LoRA) fine-tuned Qwen-7B is employed to generate structured intent output. For spatiotemporal localization, a fan-shaped region-based multi-strategy retrieval mechanism is designed, which integrates speech directional words with gaze direction, gesture pointing or navigation route, reducing the candidate POI scale by 74.47%. For comprehensive prediction, Qwen-VL is utilized to achieve cross-modal attention fusion for POI ranking. Experimental results on a self-built in-vehicle multimodal dataset demonstrate that the proposed method achieves an accuracy of 85.4% and an F1-score of 84.3%, improving by 8.6 and 7.7 percentage points respectively over the best baseline. Under 0 dB SNR conditions, the accuracy remains at 70.1%, confirming the robust effectiveness of multimodal fusion in vehicular noise environments.

Multimodal fusion  /  In-vehicle interaction  /  POI recognition  /  Large language model  /  Spatiotemporal localization
李振龙, 王洪磊, 乔万顺, 高泽磊, 张耀. 融合语音-视觉-手势多模态时空定位的车载兴趣点智能识别方法. 汽车工程师, 2026 , (10) : 26 -33 . DOI: 10.20104/j.cnki.1674-6546.20260127
Zhenlong Li, Honglei Wang, Wanshun Qiao, Zelei Gao, Yao Zhang. An Intelligent Recognition Method for In-Vehicle Points of Interest Fusing Audio-Visual-Gesture Multimodal Spatiotemporal Localization[J]. Automotive Engineer, 2026 , (10) : 26 -33 . DOI: 10.20104/j.cnki.1674-6546.20260127

参考文献 引证文献
排序方式:
[1]
ZHANG Z X, LI Y, REN W, et al. A Secure and Robust Multimodal Framework for In-Vehicle Voice Control: Integrating Bilingual Wake-up, Speaker Verification, and Fuzzy Command Understanding[J]. Eng, 2025, 6(11).
[2]
KUNST K, HOFFMANN D, ERKAN A, et al. Analyzing Gaze During Driving: Should Eye Tracking Be Used to Design Automotive Lighting Functions? [J]. Journal of Eye Movement Research, 2025, 18(2).
[3]
陈启博,闫坤,陈杰伟,等.基于Kinect和改进DTW的交通指挥手势识别方法[J].桂林电子科技大学学报,2026,46(1):59-66.
CHEN Q B, YAN K, CHEN J W, et al. Traffic Command Gesture Recognition Method Based on Kinect and Improved DTW[J]. Journal of Guilin University of Electronic Technology, 2026, 46(1): 59-66.
[4]
DARAPISUT S, AMPHAWAN K, LEELATHAKUL N, et al. A Hybrid POI Recommendation System Combining Link Analysis and Collaborative Filtering Based on Various Visiting Behaviors[J]. ISPRS International Journal of Geo-Information, 2023, 12(10).
[5]
陈勇,周宇翔,王秀毅,等.一种基于BERT预训练语言模型的语音指令识别方法:CN119479646A[P].2025-02-18.
CHEN Y, ZHOU Y X, WANG X Y, et al. A Speech Command Recognition Method Based on BERT Pre-Trained Language Model: CN119479646A[P]. 2025-02-18.
[6]
DONG H M, WANG W B, JIANG D L, et al. PC-LLMRec: Large Language Model for Personalized Interaction Recommendations in Intelligent Cockpit[J]. IET Intelligent Transport Systems, 2026, 20(1).
[7]
LI K, XU L, ZHU C, et al. A Multimodal Graph Recommendation Method Based on Cross-Attention Fusion[J]. Mathematics, 2024, 12(15).
[8]
ZHANG Q, ZENG S Z, CHEN Y R, et al. Adaptive Fusion of Dual-Scale Preference Disentanglement for Next POI Recommendation[J]. IEEE Access, 2026, 14: 5855-5868. DOI: 10.1109/ACCESS.2025.3647754.
[9]
YE M, YIN P F, LEE W C, et al. Exploiting Geographical Influence for Collaborative Point-of-Interest Recommendation[C]// Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. Beijing China: Association for Computing Machinery, 2011: 325-334.
[10]
KIM Y. Convolutional Neural Networks for Sentence Classification[C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computational Linguistics, 2014: 1746-1751.
2026年第卷第10期
PDF下载
20
2
引用本文
BibTeX
文章信息
doi: 10.20104/j.cnki.1674-6546.20260127
  • 首发时间:2026-10-29
  • 出版时间:2026-10-15
补充材料
相关文章
文章信息
作者
出版历史
  • 修回日期:2026-06-26
基金
作者信息
    一汽奔腾汽车股份有限公司,长春 130012
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/qcgcs/CN/10.20104/j.cnki.1674-6546.20260127
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏