If they gave you an interview because they assumed you'd be rotating with them and they would get a good chance to evaluate your performance, then yes. If they offered you an interview and have no idea you will be there, then no. My office has nothing to do with external rotating students, so I would never know. But in other programs, they are linked.
Does it really matter? If you have already decided to move your rotation, then do so.