Godot 3.2 seems to have inconsistent caching issues with the web player, especially in regards to the audio. I applied a simple script that should at least make the problem less bad on certain browsers.