I canceled my telephone advising appointment 3 times due to work conflicts, and it was fine.
Did you inform them you were missing the appointment prior to?
If so, it would have been best to formally apologize to maintain a sense of professionalism, but if not I wouldn't sweat it at this point.