I think this is the first valid point I've seen in this thread with regards to why people are wanting for their first semester of medical school to be somewhat in-person and not completely virtual. Previously, I was telling everyone why deferring isn't the best choice. But I think you bring up a very valid point. The pandemic hit during the third of my first year of my medical school spring semester and so even though I never went to class since August, I was used to a routine in which I woke up, went to the gym, got some coffee, went to the library and another academic building that was a little less quiet than the library and I'd put in like 3-4 hours of studying there, and then I'd go to the gym again or I'd go eat lunch, and then I'd go to another building, or somewhere else to study for the rest of the night until dinner. I eventually had to get used to being in my apartment and not being as mobile. It definitely impacted significantly my efficiency and my exam scores at the end of the semester. Either way, my point is that I agree with Doodle4210's comment. It's going to be very hard to START medical school in that condition. But I think that things will be less restrictive in the fall. Meaning, you'll probably be able to go to the library, to the Starbucks, etc. You just won't have large aggregations of classes of 100+ students in one room (for obvious reasons).
You'll be fine! Trust me, they will make it as easy as they can to transition you to the rigor and pace of medical school. Whether you hear their words in person or through Zoom/Webex, it won't make a difference.
But definitely don't defer. In medicine, you'll be faced with many difficult situations. You can't just click "remind me later." You have to face it. This is your first challenge and you'll come out victorious!