Opto-Electronic Engineering, Volume. 36, Issue 9, 104(2009)
Framework of Gradient Descent Algorithms for ICA
To design more effective algorithms for Independent Component Analysis (ICA), a general framework of Gradient Descent Algorithms (GDAs) for ICA was proposed, which covers many popular algorithms such as Infomax, Minimization of Mutual Information (MMI), Maximum Likelihood Estimation (MLE) and so on. This framework was derived from a new theory of the contrast functions for ICA based on the superadditive (or subadditive) function of class II. For better performances, the Equivariant Adaptive Separation via Independence (EASI) form was generalized and used as the updating rule. An example of using the framework was also shown based on the quadratic entropy. Furthermore, a fast method of computing the gradient in the example was proposed and the simulation proved its validity. The results demonstrate that this framework is a useful tool to discover more effective algorithms for ICA.
Get Citation
Copy Citation Text
LUO Yi-han, FU Cheng-yu, SHU Qin. Framework of Gradient Descent Algorithms for ICA[J]. Opto-Electronic Engineering, 2009, 36(9): 104
Category:
Received: Mar. 2, 2009
Accepted: --
Published Online: Jan. 31, 2010
The Author Email: Yi-han LUO (luo_yihan@yahoo.com.cn)