@Frosty et al
I finally got around to looking into the random lag spikes SOME people get and I fixed it 
Feel free to try again and report any issues you have.
The root cause seems to be down to discord being cloud based and them not being able to handle the load they get, I changed our servers region to a place with less load (this time from london to dam) and it went away instantly.
Like smidsy couldnt talk to it was perfect in seconds.