期刊文献+
任意字段
题名或关键词
题名
关键词
摘要
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息
共找到1篇文章
< 1 >
每页显示 20 50 100
已选0条
引用分析
参考文献
引证文献
 统计分析
检索结果
已选文献
显示方式：
Can ChatGPT be a Good Follower of Academic Paradigms?Research Quality Evaluations in Conflicting Areas of Sociology 认领 引用
1
作者 Mike Thelwall Ralph Schroeder Meena Dhanda 《Journal of Data and Information Science》 CSCD 2026年第2期154-164,共11页
Purpose:It has become increasingly likely that Large Language Models(LLMs)will be used to score the quality of academic publications to support research assessment goals in the future.This may cause problems for field... Purpose:It has become increasingly likely that Large Language Models(LLMs)will be used to score the quality of academic publications to support research assessment goals in the future.This may cause problems for fields with competing paradigms since there is a risk that one may be favoured,causing long term harm to the reputation of the other.Design/methodology/approach:To test whether paradigm favouritism is plausible,study 1 uses ChatGPT to evaluate up to 100 journal articles from each of eight pairs of competing sociology paradigms(1,490 altogether).Each article was assessed by prompting ChatGPT to take one of five roles:paradigm follower,opponent,antagonistic follower,antagonistic opponent,or neutral.Study 2 involved five pairs of more tightly defined paradigms.Findings:Articles were scored highest by ChatGPT when it followed the aligning paradigm,and lowest when it was told to devalue it and to follow the opposing paradigm.Broadly similar patterns occurred for most of the paradigm pairs.Follower ChatGPTs displayed only a small amount of favouritism compared to neutral ChatGPTs,but articles evaluated by an opposing paradigm ChatGPT had a substantial disadvantage in some cases.Research limitations:The data covers a single field and LLM.Practical implications:The results confirm that LLM instructions for research evaluation should be carefully designed to ensure that they are paradigm-neutral to avoid accidentally resolving conflicts between paradigms on a technicality by devaluing one side’s contributions.Originality/value:This is the first demonstration that LLMs can be prompted to show a partiality for academic paradigms. 展开更多
关键词 paradigms research evaluation Large Language Models sociology research methods
暂未订购 下载PDF
已选0条
引用分析
参考文献
引证文献
 统计分析
检索结果
已选文献
上一页 1 下一页 到第 页
在线咨询 使用帮助 返回顶部 意见反馈