SIA OpenIR  > 光电信息技术研究室
生成对抗网络及其在图像生成中的应用研究综述
Alternative TitleA Survey About Image Generation with Generative Adversarial Nets
陈佛计1,2,3,4; 朱枫1,2,4; 吴清潇1,2,4; 郝颖明1,2,4; 王恩德1,2,4; 崔芸阁1,2,3,4
Department光电信息技术研究室
Source Publication计算机学报
ISSN0254-4164
2021
Volume44Issue:2Pages:347-369
Indexed ByEI ; CSCD
EI Accession number20210909982058
CSCD IDCSCD:6897630
Contribution Rank1
Funding Organization国家自然科学基金(U1713216) ; 机器人学重点实验室自主课题项目(2017-Z21)资助
Keyword生成模型 生成对抗网络 图像生成 生成图像质量评估
Abstract

生成对抗网络(GAN)是无监督学习领域最近几年快速发展的一个研究方向,其主要特点是能够以一种间接的方式对一个未知分布进行建模.在计算机视觉研究领域中,生成对抗网络有着广泛的应用,特别是在图像生成方面,与其他的生成模型相比,生成对抗网络不仅可以避免复杂的计算,而且生成的图像质量也更好.因此,本文将对生成对抗网络及其在图像生成中的研究进展做一个小结和分析:本文首先从模型的架构、目标函数的设计、生成对抗网络在训练中存在的问题、以及如何处理模式崩溃问题等角度对生成对抗网络进行一个详细地总结和归纳;其次介绍生成对抗网络在图像生成中的两种方法;随后对一些典型的、用来评估生成图像质量和多样性的方法进行小结,并且对基于图像生成的应用进行详细分析;最后对生成对抗网络和图像生成进行总结,同时对其发展趋势进行一个展望.

Other Abstract

In tasks of unsupervised learning, the generative model is one of the most critical techniques. The generative model consists of probability density estimation and sampling, which can learn data distribution by looking at existing samples and generate new samples that obey the same distribution as the original samples. For complex distributions in a high dimensional space, density estimation and sample generation are often hard to realize. Since high-dimensional random vectors are generally difficult to model directly, it is necessary to simplify the model with some condition independence hypothesis. Even given a complex distribution that has been modeled, there is a lack of effective sampling methods. With the rapid development of deep neural network technology, the generative model has made great progress. In the past few years, there has been a drastic growth of research in Generative Adversarial Network (GAN) which can model an unknown distribution in an indirect way and can avoid statistical and computational challenges. At the same time, generative adversarial networks are the latest and most successful technology among generative models. Especially in terms of image generation, compared with other generation models, generative adversarial networks can not only avoid complicated calculations, but also generate better quality images. Therefore, this paper will make a summary and analysis of generative adversarial networks and its applications in image generation. Firstly, from the theoretical aspect, the basic idea and working mechanism of generative adversarial networks are explained in detail; How to design the loss function of generative adversarial networks based on F-divergence or integral probability metric is introduced, and its advantages and disadvantages are summarized; From the two aspects of convolutional neural network structure and auto-encoder neural network structure, the model structure commonly used in generating adversarial networks is summarized; At the same time, the problems and corresponding solutions in the process of training generative adversarial networks are analyzed from both theoretical and practical perspectives; Secondly, based on the direct method and the integration method as the classification criteria, current methods of generating images based on generating adversarial networks are summarized, and the basic ideas of these methods are explained in details. Then, from the three aspects of image generation based on mutual information, image generation based on attention mechanism, and image generation based on a single image, the method of directly generating images based on random noise vectors is summarized. The current methods of generating images based on image translation are explained in details from the aspects of supervised and unsupervised methods. Later, from a qualitative and quantitative point of view, the existing methods used to evaluate the quality and diversity of generated images based on generative adversarial networks are analyzed, and contrasted. Finally, the application of generative adversarial networks in the field of small samples, data category imbalance, target detection and tracking, image attribute editing, and medical images processing is introduced in details. And some problems in theory and practice of generative adversarial networks and image generation are analyzed; The development trend of generative adversarial networks and the development trend of image generation are summarized and prospected.

Language中文
Citation statistics
Document Type期刊论文
Identifierhttp://ir.sia.cn/handle/173321/28326
Collection光电信息技术研究室
Corresponding Author朱枫
Affiliation1.中国科学院沈阳自动化研究所
2.中国科学院机器人与智能制造创新研究院
3.中国科学院大学
4.中国科学院光电信息处理重点实验室
Recommended Citation
GB/T 7714
陈佛计,朱枫,吴清潇,等. 生成对抗网络及其在图像生成中的应用研究综述[J]. 计算机学报,2021,44(2):347-369.
APA 陈佛计,朱枫,吴清潇,郝颖明,王恩德,&崔芸阁.(2021).生成对抗网络及其在图像生成中的应用研究综述.计算机学报,44(2),347-369.
MLA 陈佛计,et al."生成对抗网络及其在图像生成中的应用研究综述".计算机学报 44.2(2021):347-369.
Files in This Item:
File Name/Size DocType Version Access License
生成对抗网络及其在图像生成中的应用研究综(4373KB)期刊论文出版稿开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Baidu academic
Similar articles in Baidu academic
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 生成对抗网络及其在图像生成中的应用研究综述.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.