I've declined/cancelled 8 of my 20 interviews. What I told them was simple. I cannot go to all the interviews and I regret to withdraw my application. Almost all of the programs were understanding and wished me best of luck in the match. Granted, I was really nervous before cancelling my first interview. But after you do it a few times, it's easy 🙂