Worked in a basement in one place, I think 2nd floor (but still no windows, central part of building) in the other though the small morgue was in the basement. I seem to recall the Penn State Hershey (?) path residents room having a very nice windowed view from a few stories up -- can't find a picture though. At the moment I can't recall the locations/windows of other places I've visited over the years.
"Nice" is in the eye of the beholder and depends on your goals. Some well funded academic behemoths appear to have never seen a broom or mop, but have the latest digital whatchamacallits, electron microscopy, IHC options flooding down the hallway, research monkeys everywhere, etc. Then some little community joints have the nice sparkly offices, skylights, view overlooking a little park, and whatnot but god forbid you try to order anything more exotic than an iron stain. Few really have it all.
It's funny, but a few colleagues and I were sharing photos of and views from our current offices. Brazil won, with a high balcony overlooking a cityscape and not-too-distant ocean, but if I understand correctly they have to get pre-approval for every IHC ordered. Take the good with the eh.