If there is useless 1 point polygon in model, it will slow down the opengl when subpatch turn on.
It's safe to clean up your model before rigging.