# Non-linear principal component analysis (approximation by a second-order Taylor series)

 dc.contributor.advisor Zaino, Nicholas dc.contributor.author Viggiano, John dc.date.accessioned 2009-07-27T22:19:18Z dc.date.available 2009-07-27T22:19:18Z dc.date.issued 1984-11 dc.identifier.uri http://hdl.handle.net/1850/10331 dc.description.abstract Linear Principal Component Analysis (LPCA) has been applied in multivariate analysis because of its many optimality properties. However, en_US when applied to locate singularities in a set of data, LPCA is only able to locate linear singularities. If the problem being considered tends to produce variables with non-linear relationships, such as with non-linear regression, LPCA is necessarily of limited utility in identifying singularities. Non-linear generalizations of PCA have been suggested in the literature. Essentially, these involve augmenting the data with higher-order terms, in particular square and cross product terms, and running a LPCA on the augmented data set. The problem with this approach is that the fundamental property of parsimony is violated because the number of principal components is greater than the number of original variates. Further, the dimensionality of the augmented data set increases quadratically with respect to the number of original variates. This greatly increases the computational load for practical-sized problems. A new method is proposed in this thesis. It involves writing the general non-linear model as a Taylor Series and truncating after the second-order terms. The data are centered about their means, and the square and cross-product values are computed. The covariance matrix for the augmented problem is computed. The non-linear singularities (or near singularities) are obtained by running a canonical regression using the 'original" and "added" sets as partitions. The advantage here is that no more principal components may be extracted here than there are variates in the original data set, so the principle of parsimony is upheld. The results of two computational experiments are discussed. dc.language.iso en_US en_US dc.relation RIT Scholars content from RIT Digital Media Library has moved from http://ritdml.rit.edu/handle/1850/10331 to RIT Scholar Works http://scholarworks.rit.edu/theses/2787, please update your feeds & links! dc.subject Thesis en_US dc.subject Principal components analysis en_US dc.subject Non-linear en_US dc.subject Taylor series en_US dc.subject.lcc QA278.5.V549 1984 dc.subject.lcsh Principal components analysis en_US dc.title Non-linear principal component analysis (approximation by a second-order Taylor series) en_US dc.type Thesis en_US dc.description.college College of Continuing Education en_US dc.description.department Center for Quality and Applied Statistics en_US

## Files in this item

Files Size Format View
JViggianoThesis11-1984.pdf 25.93Mb PDF View/Open