The truth is there are so many applicants waiting to get that spot, if you don't take it the someone else will get it. Unless you really made the effort to being a douche/idiot to the administration or the dean, you just another applicant for them.
If you are applying to the same school that you got accepted..then it will be a problem.