It's not rude at all, in fact I think it's considerate so that it's less time and effort for them not to have to go through an extra interview. Why would you waste your time, money, and effort interviewing if you really do not want to go there and why would they want to interview someone who doesn't want to be there--both sides win.