The issue would keep coming back over and over. I finally found a way to fix it completely. BUY a more powerful router that it can get a good enough signal from.
Before it was connected to a wifi extender, which had a good signal and the camera phone had a great signal too. However I guess the way extenders work is not made for viewing the cam from a PC. It never lagged when viewing from another android, but on PC it was just horrible for freezing a lot.
It has been hours without a single freeze since I connected it to the main router instead of the extender. Absolutely perfect.