Effectiveness of ChatGPT in simplifying information for Polish patients on cervical cancer screening using advanced prompting
ChatGPT can generate reliable medical information in gynaecology and obstetrics,but the content is often difficult to understand for patients with lower educational levels. The aim of the study is to evaluate the impact of Audience Persona Prompting on the simplification and readability of ChatGPT-generated medical information on cervical cancer screening (MICC_GPT) in Polish. 392 MICC_GPT were analyzed, with 196 generated using Zero-Shot Prompting (STANDARD) and 196 generated using Audience Persona Prompting (EASY). The Audience Persona prompts included instructions to simplify the content: 'Explain as if to an average Polish woman with only primary education' (8 years of formal schooling). Readability was assessed using 24 objective linguistic indicators available at Jasnopis.pl. Statistica 13 (StatSoft, Poliand), the Brunner-Munzel test, p < 0.05. The average difficulty level of STANDARD output was 5.32 (at least 15 years of formal education), while EASY output averaged 4.15 (12 years of formal education). Of the 24 indicators, 21 showed statistically significant improvements in the simplification of EASY output (p < 0.05). While ChatGPT significantly simplified MICC_GPT, the readability levels remained too high for patients with only primary education. ChatGPT shows promise in tailoring medical information on cervical cancer (CC) screening for the needs of Polish patients with varying educational backgrounds, with the use of advanced prompt engineering techniques. However, further research is required to refine prompt engineering methods and develop effective strategies for generating information on cervical cancer screening that is accessible to individuals with only primary education.