小柯机器人

AI可为《英国医学杂志》圣诞研究文章生成可信、有趣和有科学价值的标题
2021-12-19 23:50

英国布里斯托尔皇家儿童医院Robin Marlow团队使用AI为《英国医学杂志》的圣诞研究文章生成标题。该研究于2021年12月15日发表在《英国医学杂志》上。

为了确定人工智能(AI)是否能为《英国医学杂志》中潜在的圣诞节研究文章生成合理且引人入胜的标题,研究组在欧洲、澳大利亚和非洲进行了一项观察研究。

参与者为1项人工智能技术(生成式预培训变换器-3,GPT-3)和25人。主要观察指标为与历史对照相比,GPT-3生成的BMJ中潜在圣诞研究文章标题的合理性、吸引力、愉悦性和教育价值。

AI生成的标题与真实对照标题相比,虽然被评为更合理(182/250(73%)对238/500(48%)),但至少与对照标题同样地令人愉快(159/250(64%)和346/500(69%))和具有吸引力(176/250(70%)对342/500(68%))。

AI生成的标题总体上被评为科学或教育价值低于实际对照组(146/250(58%)比193/500(39%));然而,当人类管理AI输出时,这种差异变得不显著(146/250(58%)与123/250(49%))。在AI生成的标题中,最可信的是“阴谋论信念与接受疫苗接种意愿之间的关联”,评分最高的是“免费美味咖啡对急诊等待时间的影响:一项观察性研究”。

研究结果表明,AI可为《英国医学杂志》上潜在的圣诞研究文章生成可信、有趣和有科学价值的标题;与其他医学领域一样,人为干预提升了表现。

附:英文原文

Title: Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study

Author: Robin Marlow, Dora Wood

Issue&Volume: 2021/12/15

Abstract:

Objective To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ.

Design Observational study.

Setting Europe, Australia, and Africa.

Participants 1 AI technology (Generative Pre-trained Transformer 3, GPT-3) and 25 humans.

Main outcome measures Plausibility, attractiveness, enjoyability, and educational value of titles for potential Christmas research articles in The BMJ generated by GPT-3 compared with historical controls.

Results AI generated titles were rated at least as enjoyable (159/250 responses (64%) v 346/500 responses (69%); odds ratio 0.9, 95% confidence interval 0.7 to 1.2) and attractive (176/250 (70%) v 342/500 (68%); 1.1, 0.8 to 1.4) as real control titles, although the real titles were rated as more plausible (182/250 (73%) v 238/500 (48%); 3.1, 2.3 to 4.1). The AI generated titles overall were rated as having less scientific or educational merit than the real controls (146/250 (58%) v 193/500 (39%); 2.0, 1.5 to 2.6); this difference, however, became non-significant when humans curated the AI output (146/250 (58%) v 123/250 (49%); 1.3, 1.0 to 1.8). Of the AI generated titles, the most plausible was “The association between belief in conspiracy theories and the willingness to receive vaccinations,” and the highest rated was “The effects of free gourmet coffee on emergency department waiting times: an observational study.”

Conclusions AI can generate plausible, entertaining, and scientifically interesting titles for potential Christmas research articles in The BMJ; as in other areas of medicine, performance was enhanced by human intervention.

DOI: 10.1136/bmj-2021-067732

Source: https://www.bmj.com/content/375/bmj-2021-067732

BMJ-British Medical Journal:《英国医学杂志》,创刊于1840年。隶属于BMJ出版集团,最新IF:93.333
官方网址:http://www.bmj.com/
投稿链接:https://mc.manuscriptcentral.com/bmj


本期文章:《英国医学杂志》:Online/在线发表

分享到:

0