I think you're in an OK position OP. Lots of room for improvement, but definitely do-able.
I finished first year with a low GPA as well (not a 2.9, but 3.2ish). For the next 3 years, I averaged about a 3.8ish per year. Had a 3.9ish average senior year. My cumulative after 4 years ended up being a 3.7, with a 3.6ish science, which brings me to about average/above average GPA-wise for medical school. If I can do it, you can totally do it.
I did find that my problem was due to time management. In the end, it just meant studying a lot more, especially evenings and weekends. Unfortunately, being in a fraternity will definitely hinder your progress. If you can fix it up, you will be fine OP. Best of luck!