Article(id=1242132941371941004, tenantId=1146029695717560320, journalId=1146031591421210625, issueId=1242132909226799308, articleNumber=null, orderNo=20, doi=10.3981/j.issn.1000-7857.2014.36.018, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1413907200000, receivedDateStr=2014-10-22, revisedDate=1416412800000, revisedDateStr=2014-11-20, acceptedDate=null, acceptedDateStr=null, onlineDate=1420771758047, onlineDateStr=2015-01-09, pubDate=1419696000000, pubDateStr=2014-12-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1420771758047, onlineIssueDateStr=2015-01-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1774077170933, creator=sys-migrate, updateTime=1774077170933, updator=sys-migrate, issue=Issue{id=1242132909226799308, tenantId=1146029695717560320, journalId=1146031591421210625, year='2014', volume='32', issue='36', pageStart='1', pageEnd='128', issueExtLink='null', onlineDate='null', pubDate='1419696000000', pubDateStr='2014-12-28', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=null, issueType=-1, specialIssue=null, createTime=1774077163269, creator='sys-migrate', updateTime=1774077163269, updator='sys-migrate', preIssue=null, nextIssue=null, articleTotal=null, ext=null, issueFiles=null, downloadFileDto=null}, startPage=110, endPage=116, ext={EN=ArticleExt(id=1242132951362773159, articleId=1242132941371941004, tenantId=1146029695717560320, journalId=1146031591421210625, language=EN, title=Log Mining and Personalization Improvement for Mobile Search System of Government Websites, columnId=null, journalTitle=Science & Technology Review, columnName=null, runingTitle=null, highlight=null, articleAbstract=By taking full advantage of the characteristics of mobile search and government website, a log mining and customization system, which makes use of the advantages of Hadoop in large data processing, is designed and developed. First, it uses Flume and HDFS to realize the collection and storage of massive log and to provide source data and program interface of log mining. Second, the system uses MapReduce to efficiently analyze the log by taking advantage of labels and navigation bar of search result pages. Thus, the vector space model of search result pages and user interest model are established. Third, based on user interest model and combined with MapReduce again, the K-means algorithm which is for cluster analysis is used. Then, users are divided into different interest groups depending on their interests. Finally, by calculating the distance between search result page and the user's interest group, whether the user is interested in this page is determined, then the system adjusts the order of search results and pushes a new page to this user accordingly. Therefore, the personalized search and push function are implemented., authors=YE Xiaorong1, SHAO Qing2, authorsList=YE Xiaorong, SHAO Qing, authorCompany=1. Institute of Scientific and Technical Information of China, Beijing 100038, China;
2. KNET Co., Ltd., Beijing 100190, China, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=ZYT7GoEsFS0fi01MzMmu0A==, pdfFileSize=2612202, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1242132948858773665, articleId=1242132941371941004, tenantId=1146029695717560320, journalId=1146031591421210625, language=CN, title=政府网站移动搜索的日志挖掘和个性化改进, columnId=1146540929516700224, journalTitle=科技导报, columnName=研究论文, runingTitle=null, highlight=null, articleAbstract=为充分利用移动搜索和政府网站的特点, 发挥Hadoop 处理大数据的优势, 设计开发了日志挖掘和个性化定制系统。利用Flume 和HDFS 实现了海量日志的汇总和存储, 为日志挖掘提供了数据源和调用接口;采用MapReduce 实现了对日志的高效分析, 利用搜索结果网页的标签和导航, 建立了网页向量空间模型和用户兴趣模型;根据用户兴趣模型, 使用聚类分析中的K-means算法将有相似兴趣的用户组成兴趣组;通过计算搜索结果网页到用户所在兴趣组的距离, 判断用户对该网页是否感兴趣, 据此调整搜索结果的排序, 实现个性化搜索和推送功能。, authors=叶小榕1, 邵晴2, authorsList=叶小榕, 邵晴, authorCompany=1. 中国科学技术信息研究所, 北京100038;
2. 北龙中网(北京)科技有限责任公司, 北京100190, correspAuthors=null, authorNote=叶小榕, 高级工程师, 研究方向为计算机软件、数字图书馆, 电子信箱:yeelfine@sina.com, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=6s4Q1gtrgkjoblK/+2A+oA==, pdfFileSize=2612202, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null)}, authors=null, keywords=[Keyword(id=1242132948477091996, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=CN, orderNo=1, keyword=个性化搜索), Keyword(id=1242132948552589470, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=CN, orderNo=1, keyword=个性化推荐), Keyword(id=1242132948628086943, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=CN, orderNo=1, keyword=聚类分析), Keyword(id=1242132948711973024, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=CN, orderNo=1, keyword=MapReduce), Keyword(id=1242132949601165475, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=EN, orderNo=1, keyword=personalized search), Keyword(id=1242132949697634468, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=EN, orderNo=1, keyword=personalized recommendations), Keyword(id=1242132949785714853, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=EN, orderNo=1, keyword=cluster analysis), Keyword(id=1242132951270498470, tenantId=1146029695717560320, journalId=1146031591421210625, articleId=1242132941371941004, language=EN, orderNo=1, keyword=MapReduce)], refs=null, funds=null, companyList=null, figs=null, attaches=null, journal=Journal(id=1125356956822126595, delFlag=0, nameCn=科技导报, nameEn=Science & Technology Review, nameHistory1=null, nameHistory2=null, issn=1000-7857, eissn=, cn=11-1421/N, coden=null, periodic=3, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=wfghvu3bhh/dKxuZ+ucVHA==, journalPrice=null, startedYear=null, abbrevIsoEn=Sci Technol Rev, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1784015846012, createdBy=null, updatedBy=13041195026, firstLetterCn=K, firstLetterEn=K, subjectCode=Natural Sciences, subjectName=自然科学, subjectCodeEn=Natural Sciences, subjectNameEn=null, picCn=wfghvu3bhh/dKxuZ+ucVHA==, picEn=yjSfclmpNm7ihn9NbTZ69g==, jcr=null, cjcr=null, exts=[JournalExt(id=1283818766098219763, language=CN, name=科技导报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国科学技术协会, publishedBy=科技导报社, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.kjdb.org/CN/home, createdTime=1784015846037, updatedTime=1784015846037, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.kjdb.org/CN/column/column7.shtml, submissionAuthorUrl=https://kjdbauthor.cast.org.cn/webm, submissionEditorUrl=https://kjdbeditor.cast.org.cn/webm/, submissionReviewUrl=https://kjdbauthor.cast.org.cn/webm, submissionCeEditorUrl=https://kjdbeditor.cast.org.cn/webm/, submissionAeEditorUrl=https://kjdbeditor.cast.org.cn/webm/, option={"copyright":""}), JournalExt(id=1283818766144357108, language=EN, name=Science & Technology Review, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.kjdb.org/EN/home, createdTime=1784015846048, updatedTime=1784015846048, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.kjdb.org/EN/column/column7.shtml, submissionAuthorUrl=https://kjdbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://kjdbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://kjdbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://kjdbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://kjdbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031591421210625, websiteList=[Website(id=1146104741081231361, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031591421210625, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/kjdb/CN, language=CN, createTime=1751182263881, createBy=18614031015, updateTime=1751778001962, updateBy=18614031015, name=科技导报, tplId=1146099689490845704, title=科技导报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148021146403992296, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146104741081231361, code=articleTextType, value=kx, createTime=1751639170504, updateTime=1751639170504, creator=18614031015, updator=18614031015), WebsiteProps(id=1148021146378826469, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146104741081231361, code=banner, value=null, createTime=1751639170498, updateTime=1751639170498, creator=18614031015, updator=18614031015), WebsiteProps(id=1148021146366243556, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146104741081231361, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=9GHSf7eGlIPH0Tv/OOdstA==, createTime=1751639170495, updateTime=1751639170495, creator=18614031015, updator=18614031015), WebsiteProps(id=1148021146395603687, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146104741081231361, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751639170502, updateTime=1751639170502, creator=18614031015, updator=18614031015), WebsiteProps(id=1148021146387215078, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146104741081231361, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751639170500, updateTime=1751639170500, creator=18614031015, updator=18614031015)]), Website(id=1146105254833139715, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031591421210625, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/kjdb/EN, language=EN, createTime=1751182386363, createBy=18614031015, updateTime=1753500121937, updateBy=18614031015, name=科技导报, tplId=1146101810881728533, title=Science & Technology Review, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155838567709528217, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146105254833139715, code=articleTextType, value=kx, createTime=1753502988984, updateTime=1753502988984, creator=18614031015, updator=18614031015), WebsiteProps(id=1155838567692750998, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146105254833139715, code=banner, value=null, createTime=1753502988980, updateTime=1753502988980, creator=18614031015, updator=18614031015), WebsiteProps(id=1155838567688556693, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146105254833139715, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/EN/file/pic?fileId=9GHSf7eGlIPH0Tv/OOdstA==, createTime=1753502988979, updateTime=1753502988979, creator=18614031015, updator=18614031015), WebsiteProps(id=1155838567705333912, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146105254833139715, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/EN/file/pic, createTime=1753502988983, updateTime=1753502988983, creator=18614031015, updator=18614031015), WebsiteProps(id=1155838567701139607, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1146105254833139715, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1753502988982, updateTime=1753502988982, creator=18614031015, updator=18614031015)])], journalTitle=科技导报, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=Science & Technology Review, journalPhotoCn=wfghvu3bhh/dKxuZ+ucVHA==, journalPhotoEn=yjSfclmpNm7ihn9NbTZ69g==, journalFirstLetter=K, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=0.91, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/kjdb/CN/10.3981/j.issn.1000-7857.2014.36.018, detailUrlEn=https://castjournals.cast.org.cn/joweb/kjdb/EN/10.3981/j.issn.1000-7857.2014.36.018, pdfUrlCn=https://castjournals.cast.org.cn/joweb/kjdb/CN/PDF/10.3981/j.issn.1000-7857.2014.36.018, pdfUrlEn=https://castjournals.cast.org.cn/joweb/kjdb/EN/PDF/10.3981/j.issn.1000-7857.2014.36.018, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1419696000000, fullTextJson=null, articleText=null, reference=null)
收藏切换
政府网站移动搜索的日志挖掘和个性化改进
收藏切换
PDF下载
科技导报 | 研究论文 2014,32(36): 110-116
收起
收藏切换
科技导报 |研究论文 2014 , 32 (36) : 110 -116
政府网站移动搜索的日志挖掘和个性化改进
全屏
叶小榕1, 邵晴2
作者信息
    1. 中国科学技术信息研究所, 北京100038;
    2. 北龙中网(北京)科技有限责任公司, 北京100190
作者简介:
叶小榕, 高级工程师, 研究方向为计算机软件、数字图书馆, 电子信箱:yeelfine@sina.com
Log Mining and Personalization Improvement for Mobile Search System of Government Websites
  • YE Xiaorong1, SHAO Qing2
  • Affiliations
      1. Institute of Scientific and Technical Information of China, Beijing 100038, China;
      2. KNET Co., Ltd., Beijing 100190, China
    出版时间: 2014-12-28 doi: 10.3981/j.issn.1000-7857.2014.36.018
    文章导航
    收藏切换
    为充分利用移动搜索和政府网站的特点, 发挥Hadoop 处理大数据的优势, 设计开发了日志挖掘和个性化定制系统。利用Flume 和HDFS 实现了海量日志的汇总和存储, 为日志挖掘提供了数据源和调用接口;采用MapReduce 实现了对日志的高效分析, 利用搜索结果网页的标签和导航, 建立了网页向量空间模型和用户兴趣模型;根据用户兴趣模型, 使用聚类分析中的K-means算法将有相似兴趣的用户组成兴趣组;通过计算搜索结果网页到用户所在兴趣组的距离, 判断用户对该网页是否感兴趣, 据此调整搜索结果的排序, 实现个性化搜索和推送功能。
    个性化搜索  /  个性化推荐  /  聚类分析  /  MapReduce
    By taking full advantage of the characteristics of mobile search and government website, a log mining and customization system, which makes use of the advantages of Hadoop in large data processing, is designed and developed. First, it uses Flume and HDFS to realize the collection and storage of massive log and to provide source data and program interface of log mining. Second, the system uses MapReduce to efficiently analyze the log by taking advantage of labels and navigation bar of search result pages. Thus, the vector space model of search result pages and user interest model are established. Third, based on user interest model and combined with MapReduce again, the K-means algorithm which is for cluster analysis is used. Then, users are divided into different interest groups depending on their interests. Finally, by calculating the distance between search result page and the user's interest group, whether the user is interested in this page is determined, then the system adjusts the order of search results and pushes a new page to this user accordingly. Therefore, the personalized search and push function are implemented.
    personalized search  /  personalized recommendations  /  cluster analysis  /  MapReduce
    叶小榕, 邵晴. 政府网站移动搜索的日志挖掘和个性化改进. 科技导报, 2014 , 32 (36) : 110 -116 . DOI: 10.3981/j.issn.1000-7857.2014.36.018
    YE Xiaorong, SHAO Qing. Log Mining and Personalization Improvement for Mobile Search System of Government Websites[J]. Science & Technology Review, 2014 , 32 (36) : 110 -116 . DOI: 10.3981/j.issn.1000-7857.2014.36.018

    参考文献 引证文献
    排序方式:
    2014年第32卷第36期
    PDF下载
    327
    118
    引用本文
    BibTeX
    文章信息
    doi: 10.3981/j.issn.1000-7857.2014.36.018
    • 接收时间:2014-10-22
    • 首发时间:2015-01-09
    • 出版时间:2014-12-28
    补充材料
    相关文章
    文章信息
    作者
    出版历史
    • 收稿日期:2014-10-22
    • 修回日期:2014-11-20
    基金
    作者信息
    参考文献
    分享链接
    https://castjournals.cast.org.cn/joweb/kjdb/CN/10.3981/j.issn.1000-7857.2014.36.018
    分享至
    全文二维码

    扫描看全文

    引用本文
    BibTeX
    本文的引用情况
    2种不同金属材料的力学参数

    Family
    属数
    Number of
    genus
    种数
    Number of
    species
    占总种数比例
    Percentage of
    total species (%)

    Genus
    种数
    Number of
    species
    占总种数比例
    Percentage of total
    species (%)
    鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
    小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
    多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
    红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
    小菇属 Mycena 11 5.26
    光柄菇属 Pluteus 5 2.39
    红菇属 Russula 17 8.13
    栓菌属 Trametes 5 2.39
    关闭全屏