Machine Learning Based Finding of Similar Sentences from French Clinical Notes
DIALLO, Abdourahmane Gayo![](/themes/Mirage2//images/PERSO.svg)
Statistics In System biology and Translational Medicine [SISTM]
Bordeaux population health [BPH]
![cc](/themes/Mirage2//images/orcid_icon.png)
Statistics In System biology and Translational Medicine [SISTM]
Bordeaux population health [BPH]
DIALLO, Abdourahmane Gayo![](/themes/Mirage2//images/PERSO.svg)
Statistics In System biology and Translational Medicine [SISTM]
Bordeaux population health [BPH]
< Leer menos
![cc](/themes/Mirage2//images/orcid_icon.png)
Statistics In System biology and Translational Medicine [SISTM]
Bordeaux population health [BPH]
Idioma
EN
Communication dans un congrès avec actes
Este ítem está publicado en
Lecture Notes in Business Information Processing, International Conference on Web Information Systems and Technologies, 2021-10-26, Virtual. 2023-01-18, vol. 469, p. 26-42
Springer, Cham
Resumen en inglés
Finding similar sentences or paragraphs is a key issue when dealing with text redundancy. This is particularly the case in the clinical domain where redundancy in clinical notes makes their secondary use limited. Due to ...Leer más >
Finding similar sentences or paragraphs is a key issue when dealing with text redundancy. This is particularly the case in the clinical domain where redundancy in clinical notes makes their secondary use limited. Due to lack of resources, this task is a key challenge for French clinical documents. In this paper, we introduce a semantic similarity computing approach between French clinical sentences based on supervised machine learning algorithms. The proposed approach is implemented in a system called CONCORDIA, for COmputing semaNtic sentenCes for fRench Clinical Documents sImilArity. After briefly reviewing various semantic textual similarity measures reported in the literature, we describe the approach, which relies on Random Forest (RF), Multilayer Perceptron (MLP) and Linear Regression (LR) algorithms to build different supervised models. These models are thereafter used to determine the degrees of semantic similarity between clinical sentences. CONCORDIA is evaluated using traditional evaluation metrics, EDRM (Accuracy in relative distance to the average solution) and Spearman correlation, on standard benchmarks provided in the context of the DEFT 2020 challenge. According to the official results of this challenge, our MLP based model ranked first out of the 15 submitted systems with an EDRM of 0.8217 and a Spearman correlation coefficient of 0.7691. The post-challenge development of CONCORDIA and the experiments performed after the DEFT 2020 edition showed a significant improvement of the performance of the different implemented models. In particular, the new MLP based model achieves a Spearman correlation coefficient of 0.80. On the other hand, the LR one, which combines the output of the MLP model with word embedding similarity scores, obtains the higher Spearman correlation coefficient with a score of 0.8030. Therefore, the experiments show the effectiveness and the relevance of the proposed approach for finding similar sentences on French clinical notes.< Leer menos
Palabras clave en inglés
Sentence similarity
Machine learning
Random forest
Multilayer perceptron
French clinical notes
Centros de investigación