Always go where you think you'd be happier. If you don't like where you are, you will not do as well--it's better to be happy and excel at a program you like, than to be uncomfortable at a program that is slightly higher ranked. No matter where you go, you will graduate with an MD. Med school is hard enough; don't add to the difficulty by choosing a program that doesn't "feel right".