Konumsal Bilgi Evrisimsel Sinir Aglarini Nasil Etkiler?

Translated title of the contribution: How Positional Information Affect Convolutional Neural Networks?

Erdi Saritas, Hazim Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The success of Transformers, including in the field of image processing, has recently attracted the attention of researchers. Some of the researchers tried to design Transformer- based or Convolutional Neural Network-based models separately, while others tried to combine them to produce hybrid models. A significant amount of hybrid model studies have examined the sub-model design and/or the applicability of self-attention in Convolutional Neural Networks. However, position embedding, another contribution from Transformers, has received much less attention. In this study, the effect of position information on Convolutional Neural Networks was analyzed. As a result of the experiments, it has been observed that the use of position information affects performance. In the AgeDB-30, CALFW, and LFW test sets, models with different position information usage have been able to surpass the performance of the model without position information by achieving 95.12%, 93.95%, and 99.52% accuracy, respectively.

Translated title of the contributionHow Positional Information Affect Convolutional Neural Networks?
Original languageUndefined
Title of host publicationUBMK 2023 - Proceedings
Subtitle of host publication8th International Conference on Computer Science and Engineering
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages526-531
Number of pages6
ISBN (Electronic)9798350340815
DOIs
StatePublished - 2023
Event8th International Conference on Computer Science and Engineering, UBMK 2023 - Burdur, Turkey
Duration: Sep 13 2023Sep 15 2023

Publication series

NameUBMK 2023 - Proceedings: 8th International Conference on Computer Science and Engineering

Conference

Conference8th International Conference on Computer Science and Engineering, UBMK 2023
Country/TerritoryTurkey
CityBurdur
Period9/13/239/15/23

Keywords

  • Convolutional Neural Network
  • Transformers

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Engineering (miscellaneous)
  • Safety, Risk, Reliability and Quality
  • Control and Optimization
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'How Positional Information Affect Convolutional Neural Networks?'. Together they form a unique fingerprint.

Cite this