Are you sure that the shirt is not self-intersecting? Caching the sim is the only way to scrub in the timeline. Cache first then scrub. To cache set the cache folder location and hit the play button and let it sim. If it is slow check also the self collide and/or friction. There are settings to set collider faces so that will help also.