Every school you apply to will be different. Some value school's name over GPA, others vice versa. Also, a lot more is taken into consideration. I think once you hit a threshold, your GPA is no longer a huge issue. They just want to see that you can handle the work.
However, to the rest of the world, any degree at Harvard (with any GPA) will open more doors then a 4.0 at a state school. Top schools have amazing alumni connections throughout the country, rather than just regionally. Generally in the professional world, you already earned someone's respect in your ability to work once you say you went to Harvard, Yale... etc. Of course, you will have to live up to that expectation, but you generally don't have as large a hill to climb as others. And few people ask for your GPA... personally, I think it looks tacky on a resume. Like you have to prove that your degree is worth something.