Yeah, make sure you have him cover one of his eyes (and then switch of course) when you're doing it so you can test the individual visual fields (after all, if it's a lesion past the crossing you still got one good eye that can falsely compensate, especially if you're doing it halfass the way I do!) And since you're staring each other in the eyes, your patient should see the fingers when YOU do. If he doesn't, he may have some deficits - on the other hand if HE sees it first, either he's lying, or maybe YOU need your eyes checked...
Oh and visual acuity, test the bad eye first, go down as far as you can, then have them switch to the good eye - it saves a lot of time and doesn't give them a chance to memorize the lines when they're reading with thier good eye!