I would suggest confirming correct "stack height" of the rear wheel's axle and bearing assembly. A 1mm clearance does sound too tight, especially with a close-to-OEM sized tire... Manufacturer's variances.
The rear wheel has a specific pre-load requirement as you snug down the axle nut. This correctly positions the tapered wheel bearings and insures long and trouble free life. Too tight or too loose, not good.
You may want to confirm the rear wheel bearing stack, compression rings (2) and the spacer tube along with the rear axle's correct thick washer under the axle nut itself.
Over/under torquing the rear axle shortens bearing life. Sounds as if something may be missing, worn or incorrectly sized.