SIA OpenIR  > 机器人学研究室
Switch Unit (SU): A Novel Type of Unit for the Activation Function
Yang XY(杨秀义)1,2; Han Z(韩志)1; Tang YD(唐延东)1; Han JD(韩建达)1
Department机器人学研究室
Conference Name2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems
Conference DateJuly 19-23, 2018
Conference PlaceTianjin, China
Author of SourceIEEE Robotics & Automation Society
Source PublicationProceedings of 2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems
PublisherIEEE
Publication PlaceNew York
2018
Pages154-157
Indexed ByEI ; CPCI(ISTP)
EI Accession number20191806865755
WOS IDWOS:000468941800027
Contribution Rank1
ISSN2379-7711
ISBN978-1-5386-7056-9
KeywordSwitch unit Neural networks CIFAR10/100
AbstractThe paper presents a novel unit - switch unit (SU). This unit represents a conditional include function, which is able to map the input from one dimensional space to two dimensional spaces depending on whether the input is positive or not. In the traditional neural networks, there always exist one of derivatives of two entries from output that refers to input as one and the other as zero. The proposed unit is able to cope with the vanishing gradient issues induced by the factor of activation function such as ReLUs (rectified linear units). In the experiments, different neural networks are trained based on the proposed units and tested on CIFAR-10 and CIFAR-100 datasets, which yielded the comparable results to ReLUs based neural networks using the same parameters.
Language英语
Citation statistics
Cited Times:1[WOS]   [WOS Record]     [Related Records in WOS]
Document Type会议论文
Identifierhttp://ir.sia.cn/handle/173321/23860
Collection机器人学研究室
Corresponding AuthorHan JD(韩建达)
Affiliation1.State Key Laboratory of Robotics,Shenyang Institute of Automation,Chinese Academy of Sciences, Shenyang 110016, China
2.University of Chinese Academy of Sciences, Beijing 100049, China
Recommended Citation
GB/T 7714
Yang XY,Han Z,Tang YD,et al. Switch Unit (SU): A Novel Type of Unit for the Activation Function[C]//IEEE Robotics & Automation Society. New York:IEEE,2018:154-157.
Files in This Item: Download All
File Name/Size DocType Version Access License
Switch Unit (SU) A N(2932KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang XY(杨秀义)]'s Articles
[Han Z(韩志)]'s Articles
[Tang YD(唐延东)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang XY(杨秀义)]'s Articles
[Han Z(韩志)]'s Articles
[Tang YD(唐延东)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang XY(杨秀义)]'s Articles
[Han Z(韩志)]'s Articles
[Tang YD(唐延东)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Switch Unit (SU) A Novel Type of Unit for the Activation Function.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.