Topic: https://intoli.com/blog/pca-and-svd/
hide preview

What's next? verify your email address for reply notifications!

unverified 6y, 212d ago

Hi, thanks for your post. In the equation following this sentence "This means that the variance of the dataset projected onto the first Principal", could you explain why the expression on the left is equal to the right? Thanks!

remark link
hide preview

What's next? verify your email address for reply notifications!

andre 6y, 200d ago [edited]

You can use the equation for S from the box "What Is the Covariance Matrix?" to expand the right hand side, then use

hide preview

What's next? verify your email address for reply notifications!

unverified 6y, 178d ago

Helpful

hide preview

What's next? verify your email address for reply notifications!

unverified 6y, 45d ago

Hi, thanks for your post, very insightful.

Could it be that the U matrix represents the PCA taking variables as vectors instead of observations?

remark link
hide preview

What's next? verify your email address for reply notifications!

andre 6y, 34d ago

Hi and thanks. I'm not sure what you mean about U, but I'll think about it if you clarify that for me.

hide preview

What's next? verify your email address for reply notifications!

G51p8mGy 6y, 45d ago

Hi, thanks again for your post.

Could you develop mathematically the afirmation: "By dividing out the singular avlue (and multplying it by (n-1)^(1/2) to deal with the fact that we started with the covariance) we obtain a transformed dataset which is in some sense spherical"? How do you get Y = (n-1)^(1/2)*UE^-1?

Thanks

remark link
hide preview

What's next? verify your email address for reply notifications!

andre 6y, 34d ago

A way to understand the paragraph it is to write out U in terms of its column vectors and multiply that use the definitions of \Sigma and u_i. You can also take the covariance of the transformed data set, and it should come out to be the identity matrix!

hide preview

What's next? verify your email address for reply notifications!

unverified 5y, 347d ago

Thanks for the post. There is a mistake in Fig. 3, the dimension of $Sigma$ must be $d\times d$

remark link
hide preview

What's next? verify your email address for reply notifications!

andre 5y, 304d ago

Thanks. It's actually Fig. 2, and the dimension of U is incorrect in the figure: it should be $n \times n$.

hide preview

What's next? verify your email address for reply notifications!

unverified 5y, 134d ago [edited]

Hi,

I could not figure out how did you go from

to this

(i.e. last two equations of the post) I would appreciate if you could explain.

hide preview

What's next? verify your email address for reply notifications!