The Discarded Fabric is discovered during the Top It Off quest, and then recovered during the Tailoring a Repair quest. Both quests are part of the Carnival quest chain.
Recovering the Discarded Fabric takes 8 hours, and requires 30 Magic Cloth, which will be removed from your Inventory.