Randomized block Krylov is great at low-rank approximation. But existing analysis gives good results for only large and small block sizes, even though the best block size in practice tends to be in the middle. We resolve this theory-practice gap in https://t.co/iYTshDEGXv
@TaliaRinger In (randomized) linear algebra, we have lots of examples of nice algorithms and information-theoretic lower bounds with small constants. Sometimes, even, we can get the constants to (nearly) match, say up to a factor of five https://t.co/Y0bt72sia3
For anyone who wants to learn a bit more computational linear algebra, I highly recommend Tyler Chen’s book on the Lanczos method. Filled to the brim with small delights https://t.co/rZQn7KZ8Lk
More progress by Spielman–Yu which establishes a *1/quasipolynomial lower bound* on the probability of large growth. Taken together, the Urschel/Spielman–Yu results tell an interesting story. The probability of large growth is small but not that small https://t.co/Y7tdyfb9EZ
John Urschel just showed that the growth factor for Gaussian elimination with partial pivoting is ~n^{1/2} with high probability, resolving a long-standing conjecture of Nick Trefethen! https://t.co/FraoYI6yh2
John Urschel just showed that the growth factor for Gaussian elimination with partial pivoting is ~n^{1/2} with high probability, resolving a long-standing conjecture of Nick Trefethen! https://t.co/FraoYI6yh2
A new “algorithm from the book” today from Chen–Halikias–Musco–Persson. You want a good estimate of the squared Frobenius norm? Generate some Gaussian matrices and form this expression. It gets relative error ε in 4/ε matrix–vector multiplications https://t.co/arChN1aA9A
The algorithm is called Hutch#. For those in the know, it’s basically Hutch++ but with approximate matrix multiplication instead of low-rank approximation
@angeris@damekdavis Hm. Not sure you’re on base here. I assume you’re talking about Bubeck §3.5 stuff? We study Ax=b when A is not pd. So matrix-vector products are not gradients of a convex quadratic. A similar result is known for Krylov algorithms, but we bound against arbitrary rand algorithms
New paper out with Chris Camaño, Raphael Meyer, and Joel Tropp re-examining sketching algorithms! Included: subspace injections as an alternative to subspace embeddings, the theory and practice of sparse sketching, tensor sketching, and much more! https://t.co/gq6z1CKsRW
Anyone know an easy way of proving the identity 𝔼[g₁²/(g₁²+a²g₂²)] = 1/(1+a) where g₁, g₂ are iid standard Gaussians and a > 0? Ideally, I want an approach that avoids explicitly integrating over the Gaussian/chi-square/F pdf
@PengLiangzu This is a nice solution. Somehow, still isn’t quite what I’m after. I’m really hoping for a simple direct argument that uses properties of the Gaussian distribution rather than known relations to other distributions
@mathlfs The full version of Gautschi’s bound is attained if all the locations are in a ray on the complex plane. So that shows the exponential scaling is tight. I don’t know of any lower bounds for arbitrary locations
New blog post out! Vandermonde matrices are famously ill-conditioned, but just how bad are they? In this post, I discuss Gautschi’s 1962 bound showing that Vandermonde matrices are merely exponentially ill-conditioned https://t.co/2IZNfNVrw3
Randomized block Krylov is great at low-rank approximation. But existing analysis gives good results for only large and small block sizes, even though the best block size in practice tends to be in the middle. We resolve this theory-practice gap in https://t.co/iYTshDEGXv