I've noticed slow spikes where videos don't even load or even the website takes forever to load.
Why Is Crunchyroll So Slow On My Phone / Use a speed tester, like the app from speedtest.net, to see how fast or slow your cellular connection is.