中国科学院沈阳自动化研究所机构知识库
Advanced  
SIA OpenIR  > 机器人学研究室  > 期刊论文
题名:
Scalable gastroscopic video summarization via similar-inhibition dictionary selection
作者: Wang S(王帅); Cong Y(丛杨); Cao, Jun; Yang YS(杨云生); Tang YD(唐延东); Zhao HC(赵怀慈); Yu HB(于海斌)
作者部门: 机器人学研究室
通讯作者: 王帅
关键词: Video summarization ; Key frame ; Similar-inhibition dictionary selection ; Image attention prior ; Gastroscopic video
刊名: ARTIFICIAL INTELLIGENCE IN MEDICINE
ISSN号: 0933-3657
出版日期: 2016
卷号: 66, 页码:1-13
收录类别: SCI ; EI
EI收录号: 20153701272071
WOS记录号: WOS:000371368900001
产权排序: 1
项目资助者: National Science and Technology Support Program [2012BAI14B03] ; NSFC [61105013, 61375014, 61533015] ; Foundation of Chinese Scholarship Council
摘要: Objective: This paper aims at developing an automated gastroscopic video summarization algorithm to assist clinicians to more effectively go through the abnormal contents of the video. Methods and materials: To select the most representative frames from the original video sequence, we formulate the problem of gastroscopic video summarization as a dictionary selection issue. Different from the traditional dictionary selection methods, which take into account only the number and reconstruction ability of selected key frames, our model introduces the similar-inhibition constraint to reinforce the diversity of selected key frames. We calculate the attention cost by merging both gaze and content change into a prior cue to help select the frames with more high-level semantic information. Moreover, we adopt an image quality evaluation process to eliminate the interference of the poor quality images and a segmentation process to reduce the computational complexity. Results: For experiments, we build a new gastroscopic video dataset captured from 30 volunteers with more than 400k images and compare our method with the state-of-the-arts using the content consistency, index consistency and content-index consistency with the ground truth. Compared with all competitors, our method obtains the best results in 23 of 30 videos evaluated based on content consistency, 24 of 30 videos evaluated based on index consistency and all videos evaluated based on content-index consistency. Conclusions: For gastroscopic video summarization, we propose an automated annotation method via similar-inhibition dictionary selection. Our model can achieve better performance compared with other state-of-the-art models and supplies more suitable key frames for diagnosis. The developed algorithm can be automatically adapted to various real applications, such as the training of young clinicians, computer aided diagnosis or medical report generation. (C) 2015 Elsevier B.V. All rights reserved.
语种: 英语
WOS标题词: Science & Technology ; Technology ; Life Sciences & Biomedicine
类目[WOS]: Computer Science, Artificial Intelligence ; Engineering, Biomedical ; Medical Informatics
关键词[WOS]: WIRELESS CAPSULE ENDOSCOPY ; SHOT-BOUNDARY DETECTION ; KEY FRAME EXTRACTION ; CLASSIFICATION ; VISUALIZATION ; ABSTRACTION ; FEATURES ; SEGMENTATION ; IMAGES
研究领域[WOS]: Computer Science ; Engineering ; Medical Informatics
Citation statistics:
内容类型: 期刊论文
URI标识: http://ir.sia.cn/handle/173321/17733
Appears in Collections:机器人学研究室_期刊论文

Files in This Item:
File Name/ File Size Content Type Version Access License
Scalable gastroscopic video summarization via similarle-inhibition dictionary selection.pdf(3367KB)期刊论文作者接受稿开放获取View 联系获取全文

作者单位: 1.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China
2.Department of Computer Science, Arizona State University, 1711 South Rural Road, Tempe, AZ, United States
3.Key Laboratory of Image Understanding and Computer Vision, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China
4.University of Chinese Academy of Sciences, No. 19A Yuquan Road, Beijing, China
5.Department of Gastroenterology and Hepatology, Chinese PLA General Hospital, 28 Fuxing Road, Beijing, China
6.Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang, China

Recommended Citation:
Wang S,Cong Y,Cao, Jun,et al. Scalable gastroscopic video summarization via similar-inhibition dictionary selection[J]. ARTIFICIAL INTELLIGENCE IN MEDICINE,2016,66:1-13.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[Wang S(王帅)]'s Articles
[Cong Y(丛杨)]'s Articles
[Cao, Jun]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[Wang S(王帅)]‘s Articles
[Cong Y(丛杨)]‘s Articles
[Cao, Jun]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
文件名: Scalable gastroscopic video summarization via similarle-inhibition dictionary selection.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2018  中国科学院沈阳自动化研究所 - Feedback
Powered by CSpace