I have 80 Mbps fibre and had buffering problems until I figured out it was dropping to around 22 Mbps between 7 and 10pm. Switched to a less congested ISP and the problem disappeared entirely. The speed number on your contract is not always what you actually get.