Journal of Scientific Information Research
Keywords
Altmetrics; scientific and technical evaluation; theoretical framework; two dimensional evaluation
Abstract
[Purpose/significance] Altmetrics has been widely applied in scientific and technical evaluation. To find its theoretical basis, systematically review existing research literature, clarify its value, summarize its existing problems and shortcomings, it is helpful to construct a scientific and technical evaluation system that integrates Altmetrics. [Method/process] Find theoretical basis to demonstrate the rationality and feasibility of using Altmetrics for scientific and technical evaluation. Based on a systematic literature review method, this paper summarizes the progress of Altmetrics method technology in evaluating academic achievements,scholars, institutions, disciplinary fields, countries, and other emerging scenarios. It points out that there are many shortcomings in current evaluation application research in data availability verification, data source identification, authoritative evaluation index discovery,data platform construction,theoretical and methodological system construction, etc. It looks forward to the path and methods of integrating Altmetrics into Chinese technology evaluation. [Result/conclusion] Altmetrics methods and techniques provide new ideas and methods for econometrics,and integrating Altmetrics into scientific and technical evaluation can make the evaluation results more comprehensive.We should accelerate the construction of Chinese Altmetrics data infrastructure,establish an integrated evaluation method system, strengthen theoretical research,and enhance the evaluation discourse power of Chinese Altmetrics data.
First Page
34
Last Page
44
Submission Date
February 2025
Revision Date
April 2025
Acceptance Date
April 2025
Publication Date
January 2026
Digital Object Identifier (DOI)
ꎺ 10.19809/j.cnki.kjqbyj.2026.01.004
Recommended Citation
LI, Jiachen and HAN, Yi
(2026)
"Research Progress on the Application of Altmetrics in Scientific and Technical Evaluation,"
Journal of Scientific Information Research: Vol. 8:
Iss.
1, Article 4.
DOI: ꎺ 10.19809/j.cnki.kjqbyj.2026.01.004
Available at:
https://eng.kjqbyj.com/journal/vol8/iss1/4
Reference
[1] PRIEM J,TARABORELLI D,GROTH P,et al.Altmetrics:A manifesto[EB/OL].(2011-09-28)[2025-12-11].https://digitalcommons.unl.edu/scholcom/185/.
[2] 韩毅.非正式交流回归语境下科技评价的融合路径取向[J].中国图书馆学报,2016,42(4):64-74.
[3] PRIEM J,PIWOWAR H A,HEMMINGER B M.Altmetrics in the wild:Using social media to explore scholarly impact[C]//Proceedings of the 12th ACM/IEEE-CS Joint Conference on Digital Libraries.2012:arXiv:1203.4745.
[4] ORTEGA J.L.Influence of academic reputation on the altmetric performance of scholarly papers[J].Scientometrics,2017,113(2):1075-1090.
[5] 余厚强,李龙飞,杨思洛.中文学术论文的微信提及数据特征分析研究[J].情报学报,2024,43(9):1080-1093.
[6] 刘春丽.Altmetrics指标在科研评价与管理方面的应用:争议、评论和评估[J].科学学与科学技术管理,2016,37(6):13-22.
[7] 余厚强,别克扎提·木拉提.从ISSI 2019会议解读替代计量学研究新进展[J].情报理论与实践,2020,43(7):157-164.
[8] 张洋,庞进京,母丹.Altmetrics的形成与演进:理论假说、发展阶段及学科关系[J].图书情报工作,2020,64(23):141-150.
[9] 刘晓娟,王晨琳.用户动机视角下的Altmetrics指标研究[J].图书情报知识,2020(3):63-70,96.
[10] DAVENPORT T H,BECK J C.The Attention Economy:Understanding the New Currency of Business[M].Boston:Harvard Business Review Press,2001:272.
[11] 任忠忠,胡德华.最省力原则视角下的移动搜索行为研究[J].情报科学,2016,34(1):96-103.
[12] 刘洪冰.克里斯·安德森的长尾理论[J].企业改革与管理,2008(4):68-69.
[13] HAUSTEIN S,PETERS I,SUGIMOTO C R,et al.Tweeting biomedicine:An analysis of tweets and citations in the biomedical literature[J].Journal of the American Society for Information Science and Technology,2014,65(4):656-669.
[14] 宋丽萍,王建芳,付婕,等.Altmetrics对研究的社会影响力评价效果研究[J].信息资源管理学报,2022,12(5):123-129.
[15] 余厚强.基于大规模数据的微博替代计量指标分布规律研究[D].武汉:武汉大学,2017.
[16] HELENE R,FIONA W,TONI Z,et al.Cross-sectional analysis of bibliometrics and altmetrics:comparing the impact of qualitative and quantitative articles in the British Medical Journal[J].BMJ Open,2020,10(10):e040950
[17] DELLI K,LIVAS C,SPIJKERVET F K L,et al.Measuring the social impact of dental research:An insight into the most influential articles on the Web[J].Oral diseases,2017,23(8):1155-1161.
[18] 刘晓娟,孙镘莉,谢瑞婷,等.基于Altmetrics的中国新冠疫情学术成果传播力研究[J].图书情报知识,2022,39(3):60-71.
[19] MELERO R.Revalidation of the applicability of Altmetrics indicators in article-level evaluation:An empirical analysis of papers of different types of citation trajectories[J].Journal of Informetrics,2024,17(1):1-12.
[20] 陈慧琪.Altmertrics视角下期刊影响力二维评价方法研究:以国际图书情报学期刊为例[J].情报探索,2018(1):42-48.
[21] 李鑫,任俊霞.基于引文指标和Altmetrics指标的期刊影响力综合评价研究:以国际图书情报学期刊为例[J].情报杂志,2020,39(1):146-153.
[22] WEI M,CHAKOLI A N.Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention[J].Scientometrics,2020,125(3):2401-2420.
[23] NABAVI M.Coverage of the research documents with top altmetric attention scores in online news[J].Online Information Review,2025,49(1):1-14.
[24] 彭秋茹,何贝,黄水清.中文人文社会科学学术图书的影响力评价:以图书馆情报与文献学为例[J].图书情报工作,2021,65(21):108-117.
[25] 李明,李江,陈铭,等.中文学术图书引文量与Altmetrics指标探索性分析及其启示[J].情报学报,2019,38(6):557-567.
[26] BORNMANN L,HAUNSCHILD R.T-actor:A metric for measuring impact on Twitter[J].Computer Science,2015,55(4):415-425.
[27] YU M C,WU Y C J,ALHALABI W,et al.ResearchGate:An effective altmetric indicator for active researchers?[J].Computers in Human Behavior,2016,55:1001-1006.
[28] DAGIENĖ,E.The challenge of assessing academic books:The UK and Lithuanian cases through the ISBN lens[J].Quantitative Science Studies,2024,5(1):98-127.
[29] 郭颖,肖仙桃.国内学者影响力评价Altmetrics指标研究[J].情报理论与实践,2019,42(4):64-70.
[30] DAGIENĖ E.Prestige of scholarly book publishers:an investigation into criteria,processes,and practices across countries[J].Research Evaluation,2023,32(2):356-370.
[31] 赵晏强,WILLIAM N,李印结,等.Altmetric在科研机构成果产出影响力评价中的应用研究[J].情报杂志,2016,35(6):144-150,182.
[32] YANG S,FAN Q.Do proceedings papers in science fields have higher impacts than those in the field of social science and humanities?[J].Library Hi Tech,2021,39(1):284-307.
[33] 徐永乐,陈媛媛.基于Altmetrics的中美智库对比研究[J].情报杂志,2021,40(12):87-94,162.
[34] DEHDARIRAD T,DIDEGAH F,DIDEGAH A.Social media visibility of open access versus non-open access articles:A case study of Life Sciences & Biomedicine[C]//Proceedings of the 17th International Conference on Scientometrics and Informetrics,Rome,Italy,2019:762-769.
[35] 王菲菲,刘明.Altmetrics视角下的交叉学科研究前沿探测:以医学信息学领域为例[J].情报学报,2020,39(10):1011-1020.
[36] COSTAS R,ZAHEDI Z,ALPERIN J P.Global country-level patterns of Mendeley readership performance compared to citation performance:does Mendeley provide a different picture on the impact of scientific publications across countries?[C]//Proceedings of the 17th International Conference on Scientometrics and Informetrics,Rome,Italy,2019:1195-1200.
[37] 余厚强,曹雪婷.Mendeley阅读指标视角下的中美国际论文影响力比较研究[J].信息资源管理学报,2021,11(3):77-87.
[38] 方志超,王贤文.科学论文首条推特的积累速度与用户类型分析[J].图书情报知识,2019(2):28-38.
[39] 赵蓉英,陈文欣,朱伟杰.从Altmetrics到社交媒体计量学:社交媒体时代计量学的新发展[J].图书情报工作,2023,67(16):3-12.
[40] 陈莉玥,丁洁兰,刘细文.科研众筹项目的特征与影响力研究:基于Experiment平台的实证分析[J].图书情报工作,2019,63(2):120-131.
[41] 胡文倩,石进,南霞.基于替代计量学的世界大学排行榜影响力评价研究[J].现代情报,2022,42(9):132-142.
[42] 王超,马铭,李思思,等.Altmetrics视角下颠覆性技术的社会影响力探测研究[J].情报理论与实践,2022,45(1):93-104.
[43] 李龙飞,余厚强,尹梓涵,等.替代计量学视角下科学数据集价值的定量测度研究[J].情报理论与实践,2020,43(9):47-52,71.
[44] 肖其师,吴春莹,孙志庆.基于Altmetrics的科技项目立项社会影响力评价框架研究及实证分析[J].图书馆杂志,2019,38(5):79-87.
[45] HTOO T H H,JIN-CHEON N.Who are Tweeting Research Articles and Why?[J].Journal of Information Science Theory and Practice,2017,5(3):48-60.
[46] HAUSTEIN S,PETERS I,BAR-ILAN J,et al.Coverage and adoption of altmetrics sources in the bibliometric community[J].Scientometrics,2014,101(2):1145-1163.
[47] 刘晓娟,宋婉姿.基于PLOS ALM的altmetrics指标可用性分析[J].图书情报工作,2016,60(4):93-101.
[48] 汪舒,韩毅.开放科学语境下Altmetrics数据可用性研究评述[J].情报理论与实践,2023,46(11):182-188.
[49] 韩毅,赵昕,汪舒.国内学术期刊的Altmetrics数据提及语境与数据可用性研究:以B站Altmetrics数据为例[J].情报理论与实践,2023,46(5):66-74.
[50] 余厚强,李佳桐.作为替代计量数据源的中国新闻平台特点研究[J].现代情报,2022,42(6):138-147,159.
[51] 郭倩影,赵丹群.基于Altmetrics的学术论文评价研究评述[J].情报理论与实践,2021,44(9):190-197.
[52] BHASKAR M,SINIŠA S,KUMAR A C.And now for something completely different:the congruence of the Altmetric Attention Score's structure between different article groups[J].Scientometrics,2018,114(1):253-275.
[53] 索传军,牌艳欣.基于融合指标与作者贡献度的z指数优化研究[J].情报理论与实践,2022,45(5):28-36.
[54] 吴胜男,赵蓉英.Altmetrics应用工具的发展现状及趋势之分析[J].图书情报知识,2016(1):84-93.
[55] 刘春丽.Altmetrics工具与机构知识库的整合与效果:以PlumX为例[J].图书情报工作,2015,59(24):39-46.
[56] 陈铭,叶继元.中文Altmetrics数据整合分析平台的建立研究[J].大学图书馆学报,2022,40(4):110-119.
[57] THELWALL M,TSOUA,WEINGART S,et al.Tweeting links to academic articles[J].Cybermetrics,2013,17(1):1-8.
[58] HAUSTEIN S.Grand challenges in altmetrics:heterogeneity,data quality and dependencies[J].Scientometrics,2016,108(1):413-423.
[59] 刘晓娟,潘银蓉,韦娱.全文引文分析方法在Altmetrics中的衍化与应用:以博文为例[J].信息资源管理学报,2021,11(3):67-76.
[60] 杨思洛,聂颖.结合全文本分析的论文影响力评价模型研究[J].现代情报,2022,42(3):133-146.
[61] 杨岳,王贤文.Altmetrics十年发展综述[J].情报杂志,2021,40(11):136-146.
[62] 张雪蕾,邵晶,尹飞,等.替代计量视角下学术成果影响力评估:NISO AMMP项目剖析[J].图书情报工作,2020,64(2):94-104.
[63] 曾燕,杨晓,吴京晶.替代计量指标的应用、问题和反思:基于发达国家科技评价政策和实践的调查[J].情报理论与实践,2022,45(6):74-83,97.
[64] 耿海英.欧盟项目ACUMEN的研究人员评价方法及启示[J].现代情报,2016,36(7):34-40.
[65] 余厚强.替代计量学的理论框架研究[J].情报学报,2022,41(8):775-785.