Well I have about 4 of them that are very apparent. The ends are a brown/gray color (so it looks like a bunch of gnats in my field of vision), but the middles are fairly transparent. If I concentrate on them, I notice a lot more that are transparent and then it becomes irritating. I prefer natural light over flourescent lighting because of this.
I definitely understand the whole going back and forth while doing anything. And if you try looking straight at it, they run away from your focus. I genuinely meant that you'll get used to them, but obviously I shouldnt assume we have the same size/color floaters. My opinion is that your brain will adapt and get used to having these floaters there. The older I get, the less they bother me. Give it some time, see how it goes, and then maybe you can decide if the risks are worth the removal.