It's possible...but it's tough. I, too, was ranked second in a large public school, with an average over 99%. Now my GPA is a 3.77. I have received a mix of A's and A-'s, and one B in Organic I and one B+ in Biochem lab. I may get a B in Organic II as well this semester 🙁, even though I worked very hard.
I do work very hard--some weeks I stay up past 2 AM every night, and other weeks I wake up at 5 AM every morning to study before classes. I did slack off a bit last semester and I got those two B grades. This semester I managed my time poorly before one exam (though I still studied A LOT) and managed to pull my A in Organic II down to a B.
I do go to a pretty competitive pre-med school, and the curves are tough on us because there are so many smart pre-meds in every class. But like I said, there are probably people with all A's. But I can also tell you I know no one with a 4.0 gpa. Definitely aim for it, but don't cry if you get an A-, which is most likely a 3.7 at your school. Also, don't spend your undergraduate experience in your room, studying to get all A's. Get out there and do extracurriculars, pursue your interests, realize what's important in life. I'm sure there are people who do that and have a 4.0 but I'm sure they're rarer still.