Also, do you guys think it's worthwhile to go to a professor's office hours if there are two professors teaching the course together? That means I only get 5 weeks of interaction with one professor, and I don't know if that's enough time for them to get to know me well enough.
That's plenty of time. Especially if you continue going to office hours regularly. Ask good questions and get interested in the material beyond the course (randomly search google on course topic and see if course professor has anything to add). Also, my school had this awesome take your professor out to lunch program. So lunch is always a good way to get to know your prof better. If you feel awkward going one on one with the professor, bring another motivated student with you and chat about anything and everything. I took a prof out to lunch last year and we talked about my involvement in research, volunteering outside of school, ncaa basketball, his research, and his interested. Get interested in the prof, and the prof will be interested in you. At the end of our lunch he said "wow, you are the first person to take me out to lunch, I really appreciate it. If you need anything ever, let me know and I will be happy to help". since then, I've chatted with him a couple times and was able to talk about my motivations, random ecs not many profs know about, and talk about some of my worries about applying, etc. At our last meeting, I suggested we grab a beer sometime during lunch, to which the professor smiled and said "that would be awesome, let's do it before you leave for the summer". Granted, this professor was cool as F, but I think they appreciate when you are human with them and not being fake with your motivations. If you are only after a rec, cool. But if you are after a lifelong relationship and mentor who can help you beyond college and med school, then befriending professors and treating them like any other friend is exactly what you should do.
Definitely don't ask everyone to lunch (or to grab a beer for that matter). But ask professors you are genuinely interested in getting to know and it will be a rewarding experience. And don't feel intimidated, professors are people too and were once in your feet.
Take my advice with a grain of salt, I was lucky because I'm a pretty cool person (lol, is that ok to say without sounding like a d-bag?). But it worked for me and could work for you. Good luck with everything!