I've never called anyone a "physician" before to be honest. It is a word that doesn't seem to get much use up here and it is mainly only encountered in print. Probably because it gets so little use I think the word is a bit misunderstood, and people don't really know the difference between a "doctor" and a "physician". If forced to distinguish the two I think most people would assume a physician is a lesser position.
Which is why I always find the "who can use the term physician" discussions a bit amusing.