Loading...
Accurately detecting AI text when ChatGPT is told to write like a chemist
Hua, David
Hua, David
Abstract
Large language models like ChatGPT can generate authentic-seeming text at lightning speed, but many journal publishers reject language models as authors on manuscripts. Thus, a means to accurately distinguish human-generated from artificial intelligence (AI)-generated text is immediately needed. We recently developed an accurate AI text detector for scientific journals and, herein, test its ability in a variety of challenging situations, including on human text from a wide variety of chemistry journals, on AI text from the most advanced publicly available language model (GPT-4), and, most important, on AI text generated using prompts designed to obfuscate AI use. In all cases, AI and human text was assigned with high accuracy. ChatGPT-generated text can be readily detected in chemistry journals; this advance is a fundamental prerequisite for understanding how automated text generation will impact scientific publishing from now into the future.
Description
Date
2023-11-11
Journal Title
Journal ISSN
Volume Title
Publisher
US Department of Health and Human Services
Research Projects
Organizational Units
Journal Issue
Keywords
Citation
Desaire H, Chua AE, Kim MG, Hua D. Accurately detecting AI text when ChatGPT is told to write like a chemist. Cell Rep Phys Sci. 2023 Nov;4(11):101672. doi: 10.1016/j.xcrp.2023.101672. Epub 2023 Nov 6. PMID: 38078148; PMCID: PMC10704924