arXiv · 1902.08949
Training GANs with Centripetal Acceleration
Abstract
Training generative adversarial networks (GANs) often suffers from cyclic behaviors of iterates. Based on a simple intuition that the direction of centripetal acceleration of an object moving in uniform circular motion is toward the center of the circle, we present the Simultaneous Centripetal Acceleration (SCA) method and the Alternating Centripetal Acceleration (ACA) method to alleviate the cyclic behaviors. Under suitable conditions, gradient descent methods with either SCA or ACA are shown to be linearly convergent for bilinear games. Numerical experiments are conducted by applying ACA to existing gradient-based algorithms in a GAN setup scenario, which demonstrate the superiority of ACA.
Explore related subjects
Keep this discovery
Wei Peng, Yuhong Dai, Hui Zhang, Lizhi Cheng. 2019-02-24. Training GANs with Centripetal Acceleration. https://doi.org/10.1080/10556788.2020.1754414
Cite the original work for its findings. Save a collection to share your selection of sources.