MALLICK, Rupayan; BENOIS PINEAU, Jenny; ZEMMARI, Akka; GUERDA, Kamel; MANSENCAL, Boris; AMIEVA, Helene; MIDDLETON, Laura

doi:10.1007/s11042-024-18687-x

Metadatos

Mostrar el registro completo del ítem

Licencia de uso del documento

MALLICK, Rupayan
Laboratoire Bordelais de Recherche en Informatique [LaBRI]

BENOIS PINEAU, Jenny

Laboratoire Bordelais de Recherche en Informatique [LaBRI]

ZEMMARI, Akka

Laboratoire Bordelais de Recherche en Informatique [LaBRI]

Idioma

Article de revue

Este ítem está publicado en

Multimedia Tools and Applications. 2024-03-11

Resumen en inglés

Multimedia approaches are strongly required in multi-modal data processing for the detection and recognition of specific events in the data. Hybrid architectures with time series and image/video inputs in the framework of twin CNNs have shown increased performances compared to mono-modal approaches. Pre-trained models have been used in transfer learning to fine-tune the last few layers in the network. This often leads to distribution shifts in the domain. In a real-world scenario, the distribution shifts between the source and target domains can yield poor classification results. With interpretable techniques used in deep neural networks, important features can be highlighted not only for trained models but also reinforced in the training process. Hence the initialization of the target domain model can be performed with improved weights. During data transfer between datasets, the dimensions of the data are also different. We propose a method for model transfer with the adaptation of data dimension and improved initialization with interpretability approaches.< Leer menos

URI

https://oskar-bordeaux.fr/handle/20.500.12278/200607

DOI

http://dx.doi.org/10.1007/s11042-024-18687-x

Metadatos

Licencia de uso del documento

A hybrid transformer with domain adaptation using interpretability techniques for the application to the detection of risk situations

Idioma

Este ítem está publicado en

Resumen en inglés

URI

DOI

Centros de investigación

Metadatos

Compartir este ítem

Licencia de uso del documento

A hybrid transformer with domain adaptation using interpretability techniques for the application to the detection of risk situations

Idioma

Este ítem está publicado en

Resumen en inglés

URI

DOI

Centros de investigación