Exploiting Problem Structure for Faster Optimization: A Trilinear Saddle Point Approach