How ChatGPT shapes a new reality of writing: Is there a place for humans in an artificial world?
DOI:
https://doi.org/10.34142/2709-7986.2025.30.1.09Keywords:
AI-generated text, ChatGPT, authorship recognition, digital literacy, artificial intelligence in education, human-AI collaboration, writing assessmentAbstract
Aim. This study explores the impact of Artificial Intelligence (AI) -driven text generation on authorship recognition and its implications for education. Specifically, it examines how individuals with varying levels of experience using ChatGPT perceive AI-generated texts and whether editing affects their ability to distinguish between human and AI-authored content. The study aims to inform strategies for integrating AI literacy into education while addressing challenges in authorship attribution.
Methodology. A quantitative study was conducted with 85 participants, categorized based on their ChatGPT usage: no experience (n=22), occasional use (n=31), and daily use (n=32). Participants evaluated texts across five stylistic genres (literary, journalistic, scientific, philosophical, and promotional) and attempted to determine authorship (human, AI-generated, or AI-edited). The data were analyzed using statistical methods, including the Kruskal-Wallis test, ANOVA, and Pearson’s correlation analysis.
Results. The findings indicate that participants struggled to differentiate between human and AI-generated texts, with an average accuracy of 5.48 out of 15. The ability to identify authorship varied by genre, with philosophical texts being the easiest to recognize and journalistic texts posing the greatest challenge. Experience with ChatGPT did not significantly improve recognition accuracy. Editing AI-generated texts further blurred the distinction between human and machine authorship.
Conclusions. The results highlight the need for educational approaches that enhance critical literacy and awareness of AI-generated content. AI tools can serve as collaborative writing aids, but their integration into learning requires ethical considerations and adapted assessment strategies. Future research should expand the sample size and investigate the effects of long-term AI exposure on writing perception.
Downloads
References
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT '21) (pp. 610–623). Association for Computing Machinery. https://doi.org/10.1145/3442188.3445922
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., … Amodei, D. (2020). Language Models are Few-Shot Learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://doi.org/10.48550/arXiv.2005.14165
Brynjolfsson, E., & McAfee, A. (2014). The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies. W.W. Norton. https://psycnet.apa.org/record/2014-07087-000
Chesney, R., & Citron, D. K. (2019). Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security. California Law Review, 107(6), 1753–1820. https://doi.org/10.15779/Z38RV0D15J
Chetveryk, V., & Veretiuk, T. (2024). The potential of artificial intelligence tools in foreign language teaching and learning. In Modern Challenges and Achievements of the Scientific Community of the 21st Century: Proceedings of the XLIII International Scientific and Practical Conference (pp. 139–142). Narva, Estonia. https://dspace.hnpu.edu.ua/handle/123456789/16526
Csikszentmihalyi, M. (1996). Creativity: Flow and the Psychology of Discovery and Invention. HarperCollins.
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171–4186). Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423
DiResta, R. (2018). Computational Propaganda: If You Make It Trend, You Make It True. The Yale Review, 106(4), 12–29. https://doi.org/10.1353/tyr.2018.0030
Floridi, L., & Chiriatti, M. (2020). GPT-3: Its Nature, Scope, Limits, and Consequences. Minds and Machines, 30(4), 681–694. https://doi.org/10.1007/s11023-020-09548-1
Floridi, L., & Cowls, J. (2019). A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review, 1(1). https://doi.org/10.1162/99608f92.8cd550d1
GlobalLogic (2020, November 12). Media Support TechTalk in Lviv. DOU. https://dou.ua/calendar/34915/
Jurafsky, D., & Martin, J. H. (2019). Logistic Regression. In Speech and Language Processing (3rd ed.). Draft. Stanford University. https://web.stanford.edu/~jurafsky/slp3/slides/5_LR_Apr_7_2021.pdf
Kapustin, O. (2021, May 8). Pandemichna uhoda. Shans dlia svitu ta Ukrainy [Pandemic Agreement: A Chance for the World and Ukraine]. Ukrayinska Pravda. https://www.pravda.com.ua/columns/2021/05/8/7292793/ [in Ukrainian].
Kidruk, M. (2017). Ne ozyraysya i movchy [Don't Look Back and Be Silent]. Kharkiv, Ukraine: Knyzhkovyi Klub “Klub Simeinoho Dozvillia” [in Ukrainian].
Kostikova, I., Holubnycha, L., Besarab, T., Moshynska, O., Moroz, T., & Shamaieva, I. (2024). Chat GPT for Professional English Course Development. International Journal of Interactive Mobile Technologies (iJIM), 18(02), pp. 68–81. https://doi.org/10.3991/ijim.v18i02.46623
Marcus, G., & Davis, E. (2019). Rebooting AI: Building Artificial Intelligence We Can Trust. Pantheon.
Mateescu, A., & Elish, M. C. (2019). AI in Context: The Labor of Integrating New Systems and Maintaining Old Ones. New York: Data & Society Research Institute. https://datasociety.net/wp-content/uploads/2019/01/DataandSociety_AIinContext.pdf
Nalyvaiko, O. O. (2023). Perspektyvy vykorystannia neiromerezh u vyshchii osviti Ukrainy [Prospects of using neural networks in higher education of Ukraine]. Information Technologies and Learning Tools, 97(5), 1–17. https://doi.org/10.33407/itlt.v97i5.5322 [in Ukrainian].
Nalyvaiko, O. O., & Chornous, N. A. (2017). Vyznachennia suti poniattia «mobilnoho navchannia» [Determination essence of the concept «mobile learning»]. Scientific Notes of the Pedagogical Department, 40, 118–124. https://periodicals.karazin.ua/pedagogy/article/view/14863 [in Ukrainian].
OpenAI. (2022, November 30). ChatGPT: Optimizing Language Models for Dialogue. https://openai.com/blog/chatgpt
OpenAI. (2023, March 14). GPT-4 Technical Report. https://openai.com/research/gpt-4
Pascal, B. (1901). The thoughts of Blaise Pascal (C. Kegan Paul, Trans.). George Bell and Sons.
Rezvan, O., & Krokhmal, A. (2022). Peculiarities of Pedagogical Internship Organization for Future Specialists of Foreign Philology in Blended Learning. Educational Challenges, 27(2), 169–184. https://doi.org/10.34142/2709-7986.2022.27.2.12
Roozafzai, Z. S. (2024). Artificial Intelligence Assistance and Cognitive Abilities: Harnessing AI-Assisted Heuristic Methods for Transitioning from Critical to Creative Thinking in English Language Learning. Educational Challenges, 29(2), 339–361. https://doi.org/10.34142/2709-7986.2024.29.2.23
Shah, D. S., Schwartz, H. A., & Hovy, D. (2020). Predictive biases in natural language processing models: A conceptual framework and overview. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 5248–5264). Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.468
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Veronika Yurchenko, Oleksii Nalyvaiko
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
_logo_late_2025.svg.png){kind=logo}
