If bougie clothes are your thing, own it. Yes, it may be tone-deaf. Yes, you probably will get judged on it. Yes, you could get body fluids on it. Yes, it would seem a little silly to spend lots of money on designer clothes as a presumably poor MS and resident. But if you feel better wearing nice clothes and it adds positivity to your life, just own the downsides. If you're gonna be insecure wearing nice stuff at work, don't do it.
BTW, i love being a slovenly radiologist. My work attire this week:
Day hospital shift: hospital scrubs
Day WFH shift: boxers and an undershirt
Evening call shift at an imaging center: jeans and a t-shirt with company logo.
I wear the nicer stuff when I go out. Less wear and tear.