SIA OpenIR  > 机器人学研究室
Scalable gastroscopic video summarization via similar-inhibition dictionary selection
Wang S(王帅); Cong Y(丛杨); Cao, Jun; Yang YS(杨云生); Tang YD(唐延东); Zhao HC(赵怀慈); Yu HB(于海斌)
作者部门机器人学研究室
关键词Video Summarization Key Frame Similar-inhibition Dictionary Selection Image Attention Prior Gastroscopic Video
发表期刊ARTIFICIAL INTELLIGENCE IN MEDICINE
ISSN0933-3657
2016
卷号66页码:1-13
收录类别SCI ; EI
EI收录号20153701272071
WOS记录号WOS:000371368900001
产权排序1
资助机构National Science and Technology Support Program [2012BAI14B03] ; NSFC [61105013, 61375014, 61533015] ; Foundation of Chinese Scholarship Council
摘要Objective: This paper aims at developing an automated gastroscopic video summarization algorithm to assist clinicians to more effectively go through the abnormal contents of the video. Methods and materials: To select the most representative frames from the original video sequence, we formulate the problem of gastroscopic video summarization as a dictionary selection issue. Different from the traditional dictionary selection methods, which take into account only the number and reconstruction ability of selected key frames, our model introduces the similar-inhibition constraint to reinforce the diversity of selected key frames. We calculate the attention cost by merging both gaze and content change into a prior cue to help select the frames with more high-level semantic information. Moreover, we adopt an image quality evaluation process to eliminate the interference of the poor quality images and a segmentation process to reduce the computational complexity. Results: For experiments, we build a new gastroscopic video dataset captured from 30 volunteers with more than 400k images and compare our method with the state-of-the-arts using the content consistency, index consistency and content-index consistency with the ground truth. Compared with all competitors, our method obtains the best results in 23 of 30 videos evaluated based on content consistency, 24 of 30 videos evaluated based on index consistency and all videos evaluated based on content-index consistency. Conclusions: For gastroscopic video summarization, we propose an automated annotation method via similar-inhibition dictionary selection. Our model can achieve better performance compared with other state-of-the-art models and supplies more suitable key frames for diagnosis. The developed algorithm can be automatically adapted to various real applications, such as the training of young clinicians, computer aided diagnosis or medical report generation. (C) 2015 Elsevier B.V. All rights reserved.
语种英语
WOS标题词Science & Technology ; Technology ; Life Sciences & Biomedicine
WOS类目Computer Science, Artificial Intelligence ; Engineering, Biomedical ; Medical Informatics
关键词[WOS]WIRELESS CAPSULE ENDOSCOPY ; SHOT-BOUNDARY DETECTION ; KEY FRAME EXTRACTION ; CLASSIFICATION ; VISUALIZATION ; ABSTRACTION ; FEATURES ; SEGMENTATION ; IMAGES
WOS研究方向Computer Science ; Engineering ; Medical Informatics
引用统计
被引频次:3[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.sia.cn/handle/173321/17733
专题机器人学研究室
通讯作者Wang S(王帅)
作者单位1.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China
2.Department of Computer Science, Arizona State University, 1711 South Rural Road, Tempe, AZ, United States
3.Key Laboratory of Image Understanding and Computer Vision, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China
4.University of Chinese Academy of Sciences, No. 19A Yuquan Road, Beijing, China
5.Department of Gastroenterology and Hepatology, Chinese PLA General Hospital, 28 Fuxing Road, Beijing, China
6.Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China
推荐引用方式
GB/T 7714
Wang S,Cong Y,Cao, Jun,et al. Scalable gastroscopic video summarization via similar-inhibition dictionary selection[J]. ARTIFICIAL INTELLIGENCE IN MEDICINE,2016,66:1-13.
APA Wang S.,Cong Y.,Cao, Jun.,Yang YS.,Tang YD.,...&Yu HB.(2016).Scalable gastroscopic video summarization via similar-inhibition dictionary selection.ARTIFICIAL INTELLIGENCE IN MEDICINE,66,1-13.
MLA Wang S,et al."Scalable gastroscopic video summarization via similar-inhibition dictionary selection".ARTIFICIAL INTELLIGENCE IN MEDICINE 66(2016):1-13.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Scalable gastroscopi(3367KB)期刊论文作者接受稿开放获取ODC PDDL浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Wang S(王帅)]的文章
[Cong Y(丛杨)]的文章
[Cao, Jun]的文章
百度学术
百度学术中相似的文章
[Wang S(王帅)]的文章
[Cong Y(丛杨)]的文章
[Cao, Jun]的文章
必应学术
必应学术中相似的文章
[Wang S(王帅)]的文章
[Cong Y(丛杨)]的文章
[Cao, Jun]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Scalable gastroscopic video summarization via similarle-inhibition dictionary selection.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。