As someone who has lived in both locations (UW for undergrad; Mayo for med school), I'll comment. JPA makes some solid points regarding Madison in terms of lifestyle. It beats Rochester hands-down there. But Mayo beats UW handsdown in everything related to medicine. It really depends on what you're looking for. I have been very happy in Rochester and I'm single as well - yes the dating and nightlife scenes are nothing like Madison is, but there are plenty of bars and restaurants downtown to enjoy a night out. Particularly if you are not single, this is less of an issue for Rochester.
Don't underestimate the power of training at Mayo in terms of propelling your career. Yes, Wisco is a solid name in the Midwest, but Mayo is among the best INTERNATIONALLY. Coming from Mayo puts you in the league of Harvard, Stanford, UCSF, etc when it comes time to apply for residency. As someone who was a "state school" person at Madison before med school, this was a really powerful change when it came time to apply and interview for residency. If you are a person for evidence - 75% of my class matched to their #1 choice program this year, and 98% in their top 3. Aside from the name, the curriculum here is amazing and innovative. The selectives in the first two years allow you to explore career interests early and start building clinical skills long before you hit the wards as a 3rd year. THey are also a powerful opportunity for doing research and international work that are great ways to broaden yourself (not to mention the CV perks and interview topics that come from those). You will be learning from world-class faculty during your basic science and clerkships, as well.
I hope these few points are helpful in your decision. I think if you are considering RadOnc, this decision should be a no-brainer for Mayo because of the competitiveness of the specialty.
Best
W1