Computation of sentence similarity score through hybrid deep learning with a special focus on negation sentence – Scientific Reports

1. UNESCO Global. Report on Teachers: What You Need to Know (UNESCO, 2025).

   Google Scholar 

2. OECD. Class Size and Student-Teacher Ratios (OECD Publishing, 2024).

   Google Scholar 

3. OECD. How much Time Do Teachers Spend on Teaching and Non-teaching Activities? (OECD Publishing, 2015).

   Google Scholar 

4. Education Week Research Center. How Teachers Spend Their Time, Bethesda, MD, USA: Editorial Projects in Education, 2022.

   Google Scholar 

5. Zhou, K. et al. Rethinking Word Similarity: Semantic Similarity through Classification Confusion. In Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 5803–5817 (Albuquerque, NM, USA, 2025).

6. Liu, W. et al. Contrastive learning with hard negatives for sentence embeddings. Appl. Soft Comput. 184, 113685 (2025).

   Google Scholar 

7. Wu, G. FNCSE: Contrastive Learning for Unsupervised Sentence Embedding with False Negative Samples. In Proceedings of SPIE 12719, Second International Conference on Electronic Information Technology (EIT 2023) vol. 15, p. 127194R https://doi.org/10.1117/12.2685528 (2023)

8. Qiu, Z. et al. A Hybrid Semantic Representation Method Based on Fusion Conceptual Knowledge and Weighted Word Embeddings for English texts. Information 15(11), 708. https://doi.org/10.3390/info15110708 (2024).

   Google Scholar 

9. Ijebu, F. F., Liu, Y., Sun, C. & Usip, P. U. Soft cosine and extended cosine adaptation for pre-trained language model semantic vector analysis. Appl. Soft Comput. https://doi.org/10.1016/j.asoc.2024.112551 (2025).

   Google Scholar 

10. Li, X. & Li, J. AoE: Angle-optimized Embeddings for Semantic Textual Similarity. In Proceedings of 62nd Annual Meeting of the Association for Computational Linguistics (ACL), Bangkok, Thailand 1825–1839 (2024)

11. Anschütz, M., Lozano, D. M. & Groh, G. This is not correct! Negation-aware Evaluation of Language Generation Systems, in Proceedings of 16th International Natural Language Generation Conference (INLG), Prague, Czechia 163–175 (2023)

12. Okpala, I., Rodriguez, G. R., Tapia, A., Halse, S. & Kropczynski, J. A semantic approach to negation detection and word disambiguation with natural language processing. In Proceedings of 2022 6th International Conference on Natural Language Processing and Information Retrieval (NLPIR ’22), New York, NY, USA 36–43 https://doi.org/10.1145/3582768.3582789 . (2023)

13. Laverghetta Jr., A. & Licato, J. Developmental Negation Processing in Transformer Language Models. In Proceedings of 60th Annual Meeting of the Association for Computational Linguistics (ACL), Vol. 2: Short Papers, Dublin, Ireland 545–551 (2022)

14. Winaya, F. & Girsang, A. S. Negation handling on XLNet using dependency parser for sentiment analysis. In Proceedings of 2024 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), Bali, Indonesia 251–256 https://doi.org/10.1109/ICICYTA64807.2024.10913246 (2024).

15. Lal, U. & Kamath, P. Effective Negation Handling Approach for Sentiment Classification using synsets in the WordNet lexical database. In Proceedings of 2022 First International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT), Trichy, India 01–07 (2022) https://doi.org/10.1109/ICEEICT53079.2022.9768641.

16. Biradar, S., Raju, G. T. & Divakar, K. M. Negation Handling and Domain Generalization in Sentiment Analysis using Machine Learning Models. In Proceedings of 2024 International Conference on Knowledge Engineering and Communication Systems (ICKECS), Chikkaballapur, India 1–4 (2024) https://doi.org/10.1109/ICKECS61492.2024.10616885

17. Alnajem, N. A., Binkhonain, M. & Hossain, M. S. Siamese Neural Networks Method for Semantic Requirements Similarity Detection. IEEE Access 12, 140932–140947. https://doi.org/10.1109/ACCESS.2024.3469636 (2024).

    Google Scholar 

18. Chen, F. et al. Research on the Similarity Calculation of short text in the Terminology Domain Based on Siamese BERT Model. Sci. Rep. 15, 36954. https://doi.org/10.1038/s41598-025-20908-8 (2025).

    Google Scholar 

19. Sumanathilaka, T. G. D. K., Selvarai, V., Raj, U., Raiu, V. P. & Prakash, J. Emotion Detection using Bi-directional LSTM with an Effective text Pre-Processing Method. In Proceedings 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kharagpur, India 1–4 (2021) https://doi.org/10.1109/ICCCNT51525.2021.9579844.

20. Lam, P., Pham, L., Tang, H., Seidl, M., Andresel, M. & Schindler, A. LSTM-based Deep Neural Network With a Focus on Sentence Representation for Sequential Sentence Classification in Medical Scientific Abstracts 219–224 (2024) https://doi.org/10.15439/2024F5872.

21. Mohebbi, M., Razavi, S. N. & Balafar, M. A. Computing Semantic Similarity of texts Based on Deep Graph Learning with Ability to use Semantic Role Label Information. Sci. Rep. 12, 14777. https://doi.org/10.1038/s41598-022-19259-5 (2022).

    Google Scholar 

22. Devlin, J., Chang, M.-W., Lee, K & Toutanova, K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of 2019 Conference North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), Minneapolis, MN, USA (2019) 4171–4186 https://doi.org/10.18653/V1/N19-1423

23. Reimers, N. & Gurevych, I. Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2019)

24. Wolf, T. et al. Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP): System Demonstrations 38–45 (2020)

25. Cer, D., Diab, M., Agirre, E., Lopez-Gazpio, I. & Specia, L. SemEval-2017 Task 1: Semantic Textual Similarity—Multilingual and Cross-Lingual Focused Evaluation. In Proceedings of 11th International Workshop on Semantic Evaluation (SemEval-2017), Vancouver, BC, Canada 1–14 (2017)

26. Mikolov, T., Chen, K., Corrado, G. S. & Dean, J. Efficient Estimation of Word Representations in Vector Space. In Proceedings of Workshop at ICLR (2013).

Download references