The specialty is toast.
It should have stayed in the model where you split the ED into "medical" and "surgical" and had rotating IM docs see all the chest pains and surgeons see all the belly pains, where if you're not sick you wait 12 hours or self diurese home.
Instead we pretended that you needed "training" to work in the ED, and it morphed into the bastardization we see today that is part pill mill, part psychiatric somatization institute, part gomer day care, part disaster mitigation center, all while you are pushed to be 100% perfect every time, satisfy the "customer," and not piss off anyone.
EM suffers from the problem where you're often the smartest person in the room, but have to placate all sorts of immature childish personalities. Whether it's the nurse that doesn't want to do the right thing because "protocol," a CT tech that won't give contrast for Cr 1.5 or a medic that brings in body that's been dead for 12 hours; you have to pretend that all these fools deserve a voice, and not be immediately fired.
It should be the best specialty, and at its core it is. We are the ones people turn to when they really need a doctor. But society decided that there's more value in replacing a 90 year olds hip than saving a child's life.