Other than my immediately going "hey I remember him!", they may add a tad more weight. if a recent grad, the LOR writer knows the strengths and weakness of the program, so his/her word about you might be taken as relevant.
But if it's from, say, the Class of 1978, it's just another writer.