i dont knw how you done this..not that...try to keep two meshes.always try to use low mesh for cloth simulation..,,it must in very simple form...no foldings,no double layering...equal loop distance...this will help for easy and fast cloth simulation..after it...connect original mesh of cloth with lowmesh using wrap tool(keep equal distance between cloth mesh and colliding mesh...