Researchers study the role of AI in academic writing

Wednesday, January 29, 2025

Research from the University of 蓝莓视频 shows that Artificial Intelligence (AI) can improve academic writing and facilitate peer reviews. For researchers, particularly beginners and non-native English speakers, using AI can help them produce better manuscripts faster with more time for teaching and supervising.聽

The study, led by Hilda Hadan, a PhD Candidate from the Department of Systems Design Engineering, found that reviewers perceived AI-paraphrased abstracts in research papers as more honest and compelling than human-written ones.聽

In a blind evaluation, reviewers were asked to rate three versions of research abstracts 鈥 human-written, AI-generated, and human-written but AI paraphrased. The latter got the highest rating, but overall reviewers prioritized valid methods, robust results and the significance of the research 鈥 its contributions to academia, society and industry.聽

鈥淭he findings come with important caveats,鈥 Hadan said. 鈥淭he study shows that AI can improve language and readability, but the reviewers noted that AI-generated abstracts often had 鈥済eneric statements鈥 and lacked insights born from human expertise.鈥澛

The study emphasized the need for the 鈥渉uman touch鈥 in academic writing. Using AI can help make the content clearer, but researchers must have the final say 鈥 reliance on AI will reduce the validity of their work and the arguments they present.聽

The study also provides helpful suggestions to publishers and journal editors on how to create rules and make sure everyone is open and honest about using AI in research publications. Specifically, to educate reviewers on biases in human and algorithmic AI detection methods and emphasize evaluating manuscripts based on scientific quality, because neither method can reliably detect AI use in manuscripts. And to establish clear ethical guidelines for AI use in research and mandate detailed AI disclosures, including AI prompts, example outcomes and specific sections where AI was used.聽

鈥淭he future of research writing isn鈥檛 about choosing between human or AI,鈥 Hadan said. 鈥淚t鈥檚 about finding the right balance where technology enhances rather than replaces human expertise.鈥澛

The , recently published in the Journal of Computers in Human Behavior: Artificial Humans, was funded by the and explores views gathered from peer-reviewers at HCI conferences.聽

The research team discusses the study and its results in this .听听

Researchers in the photo, from left to right:聽Hilda Hadan;聽Dr. Eugene Kukshinov;聽Lydia (Lili) Choong;聽Dr. Lennart Nacke (supervisor);聽Federica Gini;聽Joseph Tu;聽Sabrina Sgandurra;聽Dr. Reza Hadi Mogavi;聽Dr. Sebastian Cmentowski.

Photo credit:聽Derrick Wang.

University of 蓝莓视频 research team - the HCI Games Group

Hilda Hadan (far left), a PhD candidate in the Department of Systems design Engineering, with her fellow researchers.