What about the string Ben gave you to help you remember?
Oh, it is cotton not silk.
Hmm, now who in town might have some silk string?
No one there tries to be a fancy dresser, but the Pughs do.
But no need to go inside the mansion to ask them, since they wouldn't give anything to you.