Paper accepted at ACL Main

We are going to ACL 2025 !

Our long paper “Evaluating LLMs for Portuguese Sentence Simplification with Linguistic Insights” has been accepted to the main conference of ACL 2025, and we are very excited to share this work with the community. This publication represents an important milestone in our ongoing research efforts and contributes to international discussions in Natural Language Processing in Portuguese.

In this study, we evaluated 26 advanced AI language models to see how well they simplify sentences in Portuguese. We also compared them with two models specially trained for this task, one proposed by us in the ACL 2024 paper. To do this, we used three different collections of texts, including a new dataset we created with real sentences from Brazilian government agencies.

We analyzed the results using automatic measures and detailed linguistic evaluation, and also manually reviewed some examples. Our main finding is that although open-source AI models perform very well, commercial (closed-source) models still achieve the best results when simplifying Portuguese texts. But all of them still have a gap in linguistic features when compared to human evaluation.

We look forward to presenting the paper at ACL and engaging with the community around its ideas and findings!