Trust me, I'm sympathetic to people who don't match. I've had friends who didn't match. It blows. It could happen to any of us, myself included. But, 1. If you're that worried about it, you should be on campus, in close proximity to an advisor, ready to get to work and not at "home in your pajamas" and 2. I wish it were as simple as "we pay them, therefore we deserve days off." Heck, I've missed weddings, family birthdays. I don't schedule doctors appointments when I know I'm on duty. And trust me, I know I'm not essential. They don't need me there. But until medical schools start allowing students to take "vacation days" we don't get to take days off. I wish we did. But that's life.
My overall point is that you don't need the whole day off to find out if you match. Sure, it would suck to have to be around people and talk to them immediately, but you're going to have to go to campus anyway. You're going to see your classmates. You're going to have to face your attendings. And it sucks, it makes you want to cry every time you see a new person, but it's life. And sometimes life sucks.