OP, take a class or two if you're getting bored, or do some EC stuff to shore up your resume (shadowing, volunteering, etc). I had two children while in med school (currently 2 yr & 9wks old), and I'm worried that when June 15th comes around and my surgery prelim starts I'll basically miss the entire first year of my daughter's life. But we do what we must. I'm graduating med school at 32 and while I remember being 23 and feeling like I was so far behind and going nowhere fast, when I look back on it now, I just have to laugh at myself.
Also, please do not misconstrue this as a "You can't do med school with a small child" response, because that is absolutely not what I mean, and also completely untrue. I would just refrain from rushing things if there's no real reason to do so.