海报设计:陆澜
直播观看方式:
直接扫描海报上二维码
方法的夏天(第五季):AI 时代下的社会科学研究方法
第1讲 Can ChatGPT or Other AI Support Research Assessment?
主讲人:Mike Thelwall(谢菲尔德大学信息学院 教授)
对谈人:李江(南京大学信息管理学院 教授)
2024/08/19(周一)19:30-21:00
内容简介
Research assessment is a labour-intensive part of the job of most academics, including for peer reviewing journal submissions or evaluating the quality of research produced by job applicants. As a result of the enormous amount of expert time consumed by this activity, there have been calls to automate as much of it as possible using artificial intelligence (AI). This talk reports a large scale experiment to assess whether traditional machine learning techniques could assess the quality of published journal articles with an acceptable degree of accuracy at the article and departmental levels. It also reports a short investigation into whether ChatGPT can write plausible and accurate reviewer reports on academic papers.
相关论文及成果
Thelwall M. (2024). Can ChatGPT evaluate research quality? Journal of Data and Information Science, 9(2), 1-21.
Thelwall M. (2024). Quantitative Methods in Research Evaluation: Citation Indicators, Altmetrics, and Artificial Intelligence. https://arxiv.org/abs/2407.00135 (book preprint)
Torres Salinas D, Thelwall M & Arroyo Machado W. (2024). ChatGPT for Bibliometrics: Potential applications and limitations. Working paper.
主讲人简介
Mike Thelwall is a Professor of Data Science in the Information School at the University of Sheffield in the UK. He primarily investigates quantitative methods to support research evaluation, including artificial intelligence, citation analysis and altmetrics. Mike has also developed a wide range of software and methods for gathering and analyzing social web data. His books include Quantitative Methods in Research Evaluation: Citation Indicators, Altmetrics, and Artificial Intelligence. He is an associate editor of the Journal of the Association for Information Science and Technology and sits on five other editorial boards.
https://www.sheffield.ac.uk/is/people/academic/mike-thelwall
对谈人简介
李江 南京大学信息管理学院教授,从事科学计量、网络计量与政策计量研究。在Journal of the Association for Information Science and Technology (JASIST)、Journal of Informetrics、Scientometrics等SSCI/SCI期刊上发表论文30余篇。担任Journal of Informetrics副主
编和Scientometrics编委。
插画:蒋卓成
海报:魏春丽
制版编辑:王淳洋
关注公众知识状态 / 引领学科发展潮流 Focusing on the State of Public Knowledge Leading the Development Trends of the Discipline |
学术活动 | ACM/IEEE数字图书馆联合会议(JCDL 2024)征稿启事
学术活动│2024年中国图书馆学会“新时代图书馆用户研究与服务”论文征集
学术活动 | 第18届国际知识组织大会(ISKO 2024)议程公布!
学术活动 | 第18届国际知识组织大会(ISKO 2024)注册开放
学术活动|2023年度“中国信息资源管理学界十大学术热点”评选活动开始投票啦!