I think the people suggesting that it would be ridiculous for a surgery PD and/or a chair of a surgery department, who would also be the people deciding what partners to hire in the future for faculty positions, to hold a grudge against someone for sending an LOI and then going back on their word, then they don’t understand academic surgery. Or the egos of many in academic leadership. Maybe they wouldn’t hold it against OP later, but there is a very very good chance they would. When I interviewed at my first job, it was mentioned that they didn’t recall me from fellowship interviews and I was asked if “I’d given them the brush off.” I told them they’d declined to interview and suddenly no one wanted to talk about it anymore. But it means that they looked back at their records.
OP’s best option would be to formally rescind the LOI if they don’t intend to rank the program 1st. At least then it would be seen as above board and give the program a chance to change their rank list if they wanted to. OP might not get ranked in that scenario but at least they would later have a better chance of being seen as someone who sticks by their word, if they later want to try to apply for a faculty spot. Still might not be considered for it, but a better chance than if they let the LOI stand and don’t notify the program of their change of heart.
If OP is not interested in applying to that institution for anything in the future, it might not matter at all. But also consider that academic surgeons in positions of leadership often change institution in pursuit of career building promotions.