Grouped Pointwise Convolutions Reduce Parameters in Convolutional Neural Networks
dc.contributor.author | Schwarz Schuler, Joao Paulo | |
dc.contributor.author | Romani, Santiago | |
dc.contributor.author | Abdel-Nasser, Mohamed | |
dc.contributor.author | Rashwan, Hatem | |
dc.contributor.author | Puig, Domenec | |
dc.coverage.issue | 1 | cs |
dc.coverage.volume | 28 | cs |
dc.date.accessioned | 2022-06-30T07:01:57Z | |
dc.date.available | 2022-06-30T07:01:57Z | |
dc.date.issued | 2022-06-30 | cs |
dc.description.abstract | In DCNNs, the number of parameters in pointwise convolutions rapidly grows due to the multiplication of the number of filters by the number of input channels that come from the previous layer. Our proposal makes pointwise convolutions parameter efficient via grouping filters into parallel branches or groups, where each branch processes a fraction of the input channels. However, by doing so, the learning capability of the DCNN is degraded. To avoid this effect, we suggest interleaving the output of filters from different branches at intermediate layers of consecutive pointwise convolutions. We applied our improvement to the EfficientNet, DenseNet-BC L100, MobileNet and MobileNet V3 Large architectures. We trained these architectures with the CIFAR-10, CIFAR-100, Cropped-PlantDoc and The Oxford-IIIT Pet datasets. When training from scratch, we obtained similar test accuracies to the original EfficientNet and MobileNet V3 Large architectures while saving up to 90% of the parameters and 63% of the flops. | en |
dc.format | text | cs |
dc.format.extent | 23-31 | cs |
dc.format.mimetype | application/pdf | en |
dc.identifier.citation | Mendel. 2022 vol. 28, č. 2, s. 23-31. ISSN 1803-3814 | cs |
dc.identifier.doi | 10.13164/mendel.2022.1.023 | en |
dc.identifier.issn | 2571-3701 | |
dc.identifier.issn | 1803-3814 | |
dc.identifier.uri | http://hdl.handle.net/11012/208126 | |
dc.language.iso | en | cs |
dc.publisher | Institute of Automation and Computer Science, Brno University of Technology | cs |
dc.relation.ispartof | Mendel | cs |
dc.relation.uri | https://mendel-journal.org/index.php/mendel/article/view/169 | cs |
dc.rights | Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license | en |
dc.rights.access | openAccess | en |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-sa/4.0 | en |
dc.subject | EfficientNet | en |
dc.subject | Deep Learning | en |
dc.subject | Computer Vision | en |
dc.subject | CNN | en |
dc.subject | DCNN | en |
dc.title | Grouped Pointwise Convolutions Reduce Parameters in Convolutional Neural Networks | en |
dc.type.driver | article | en |
dc.type.status | Peer-reviewed | en |
dc.type.version | publishedVersion | en |
eprints.affiliatedInstitution.faculty | Fakulta strojního inženýrství | cs |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- 169-Article Text-408-2-10-20220629.pdf
- Size:
- 2.68 MB
- Format:
- Adobe Portable Document Format
- Description: