A hybrid large language model (LLM)–based application, optimized by combining LLM feature classification with deterministic elements, accurately assigned Ovarian-Adnexal Reporting and Data System MRI scores from adnexal lesion descriptions and outperformed originally reporting radiologists.