Methodology to Adapt Neural Network on Constrained Device at Topology level
| dc.rights.license | open | en_US |
| dc.contributor.author | SAINT-GERMAIN, Logan | |
| hal.structure.identifier | Laboratoire de l'intégration, du matériau au système [IMS] | |
| dc.contributor.author | LE GAL, Bertrand | |
| hal.structure.identifier | Laboratoire Bordelais de Recherche en Informatique [LaBRI] | |
| dc.contributor.author | BALDACCI, Fabien
IDREF: 142618446 | |
| hal.structure.identifier | Laboratoire de l'intégration, du matériau au système [IMS] | |
| dc.contributor.author | CRENNE, Jeremie | |
| hal.structure.identifier | Laboratoire de l'intégration, du matériau au système [IMS] | |
| dc.contributor.author | JEGO, Christophe | |
| dc.contributor.author | LOTY, Sebastien | |
| dc.date.accessioned | 2024-01-09T09:16:36Z | |
| dc.date.available | 2024-01-09T09:16:36Z | |
| dc.date.issued | 2022-10-25 | |
| dc.date.conference | 2022-11-02 | |
| dc.identifier.issn | 2473-2001 | en_US |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/186969 | |
| dc.description.abstractEn | Artificial Intelligence is now ubiquitous as nearly every application domain has found some use for it. The high computational complexity involved in its deployment has led to strong research activity in optimizing its integration in embedded systems. Research works on efficient implementations of CNNs on resource-constrained devices (eg. CPU, FPGA) largely focus on hardware based optimizations such as pruning, quantization or hardware accelerator. However, most performance improvements leading to efficient solutions in terms of memory, complexity and energy are located at the NN topology level, prior to any implementation step. This paper introduces a methodology called ANN2T (Artificial Neural Network to Target) which adapts a pre-trained deep neural network to a designated device with given optimization constraints. ANN2T leverages its included simplifications and/or transformations to progressively modify the deep neural network layers in order to meet the optimization target. Experiment results obtained on microcontroller device show ANN2T produces valuable trade-offs. It achieved up to 33% MACC and 37% memory footprint reductions with no accuracy loss on ResNet-18 topology over the CIFAR-10 dataset. This fully-automated methodology could be generalized to targets such as CPUs, GPUs or FPGAs. | |
| dc.language.iso | EN | en_US |
| dc.subject | Performance evaluation | |
| dc.subject | Deep learning | |
| dc.subject | Quantization (signal) | |
| dc.subject | Network topology | |
| dc.subject | Microcontrollers | |
| dc.subject | Signal processing algorithms | |
| dc.subject | Artificial neural networks | |
| dc.subject | DNN | |
| dc.subject | Machine Learning | |
| dc.subject | Edge AI | |
| dc.subject | TinyML | |
| dc.subject | Embedded Systems | |
| dc.subject | Low Power Devices | |
| dc.title.en | Methodology to Adapt Neural Network on Constrained Device at Topology level | |
| dc.type | Communication dans un congrès | en_US |
| dc.identifier.doi | 10.1109/SiPS55645.2022.9919244 | en_US |
| dc.subject.hal | Sciences de l'ingénieur [physics] | en_US |
| bordeaux.page | 1-6 | en_US |
| bordeaux.hal.laboratories | IMS : Laboratoire de l'Intégration du Matériau au Système - UMR 5218 | en_US |
| bordeaux.institution | Université de Bordeaux | en_US |
| bordeaux.institution | Bordeaux INP | en_US |
| bordeaux.institution | CNRS | en_US |
| bordeaux.conference.title | 2022 IEEE Workshop on Signal Processing Systems (SiPS) | en_US |
| bordeaux.country | fr | en_US |
| bordeaux.title.proceeding | 2022 IEEE Workshop on Signal Processing Systems (SiPS) | en_US |
| bordeaux.team | CIRCUIT DESIGN-CSN | en_US |
| bordeaux.conference.city | Rennes | en_US |
| hal.identifier | hal-04381562 | |
| hal.version | 1 | |
| hal.date.transferred | 2024-01-09T09:16:38Z | |
| hal.invited | oui | en_US |
| hal.proceedings | oui | en_US |
| hal.conference.end | 2022-11-04 | |
| hal.popular | non | en_US |
| hal.audience | Internationale | en_US |
| hal.export | true | |
| dc.rights.cc | Pas de Licence CC | en_US |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.date=2022-10-25&rft.spage=1-6&rft.epage=1-6&rft.eissn=2473-2001&rft.issn=2473-2001&rft.au=SAINT-GERMAIN,%20Logan&LE%20GAL,%20Bertrand&BALDACCI,%20Fabien&CRENNE,%20Jeremie&JEGO,%20Christophe&rft.genre=unknown |
Fichier(s) constituant ce document
| Fichiers | Taille | Format | Vue |
|---|---|---|---|
|
Il n'y a pas de fichiers associés à ce document. |
|||