They call this linting meaning that small amount of fibers on the surface. On the paint its not a super big deal but on glass it is.
Best thing is buy good quality towels with stitched boarders. They last a long time so there is no reason to buy cheap