Reviewing Tests

[ArcherM2]

We recently had a "discussion" at our school regarding the practice of test review. Last year we were allowed to review exams about a week after we took a test. Recently we have not been allowed to look at exams at all.

I was wondering what the practice at other medical schools is in regards to reviewing exams. Thanks!

---

Members don't see this ad.

 

[JonnyG]

we get our exams back with which ones we got wrong and the right answers. A copy is then placed on black board for future classes.

 

[ArcherM2]

wow. thanks for the reply! Any of the other schools care to comment on their practices?

 

[tcom200901]

Here at TCOM, we have a post exam review for all the tests. During an hour period, the exams are re-distributed to the students. All the faculty who wrote the exam questions then review the questions, the correct answers, as well as why the wrong answeres were wrong.(especiallty those that were low scoring) with the class. The exams are then recollected.

There is a secure test bank, so they don't let us keep the exams, or copy them during that post exam review.

It works pretty good, and you learn where your mistakes were, and why.

TCOM200901

 

[allendo]

We recently had a "discussion" at our school regarding the practice of test review. Last year we were allowed to review exams about a week after we took a test. Recently we have not been allowed to look at exams at all.

I was wondering what the practice at other medical schools is in regards to reviewing exams. Thanks!

Our test review is run similar to the one at TCOM

 

[OnMyWayThere]

Here at TCOM, we have a post exam review for all the tests. During an hour period, the exams are re-distributed to the students. All the faculty who wrote the exam questions then review the questions, the correct answers, as well as why the wrong answeres were wrong.(especiallty those that were low scoring) with the class. The exams are then recollected.

There is a secure test bank, so they don't let us keep the exams, or copy them during that post exam review.

It works pretty good, and you learn where your mistakes were, and why.

TCOM200901

Wow that sounds GREAT and good review to make it really stick after an exam. Our school posts the exam in the admin office while someone is there so nobody copies questions. We can go and see the test with the right answers after we get our test results (1-2 days).

 

[Amy B]

At VCOM we got most exams back except the PPC(principles of primary care)/OMM ones. I cant recall getting the anatomy ones back either but it has been a while since i had anatomy

 

[beastmaster]

NYCOM = keep the test once you finish it (answers are submitted on scantron).

This provides the psychotic students a post-exam bonding opportunity, at which time they strongly argue in defense of their invariably wrong answer choices.

 

[misparas]

DMU holds the standard test review after each exam. Much like TCOM's.

 

[BusterDO]

At VCOM we got most exams back except the PPC(principles of primary care)/OMM ones. I cant recall getting the anatomy ones back either but it has been a while since i had anatomy

They just implemented a new protocol for VCOM...every exam (even PPC) is posted on blackboard after the exam grades are out. Just an aside to this post, does anyone think one method is better than the other for learning purposes. Personally, I like being able to look over exams to learn from mistakes or refresh for finals. I also think it's a good study tool for future classes. For Biochem...I would prepare for an exam and then take last years exam to gauge my performance; I wouldn't look at the exam until I felt like I was ready for the exam. I found it helpful...any thoughts?

 

[Doctor Bagel]

NYCOM = keep the test once you finish it (answers are submitted on scantron).

This provides the psychotic students a post-exam bonding opportunity, at which time they strongly argue in defense of their invariably wrong answer choices.

Yeah, I'm not sure I'd like the idea of being able to keep the test.

I think TCOM and DMU's way is the best. That way, you get to look over the test and possibly make corrections for miskeyed and poorly written questions. You also get to learn why your answer was wrong, which is useful. Also, it still protects exam security.

 

[JonnyG]

There are positives and negatives to everyway. One downside to PCOMs method is there are repeats from previous years on each test, so some people are not really learning the concept. One thing they do that i find to be very fair is determining a poorly written or poorly taught question. If a certain % of the class gets a question wrong it is reviewed. In the review, if a certain number of the highest scorers on the test got it wrong then it is thrown out. This forms a distinction between someone who studied and understood the material and someone who guessed at the answer.

We don't get cummulative test at PCOM (except anatomy), so getting the test back wouldn't help us learn the concepts for a future test. I know many who don't review their test for challenges.

 

[beastmaster]

Yeah, I'm not sure I'd like the idea of being able to keep the test ... still protects exam security

Secure from who? Once we take a test, every question is out in the open -- one way or another. So to avoid driving it underground, the questions with keys are simply posted for everyone.

Now, if the professors suffer from a lack of imagination and can't keep writing new questions, then that is 100% their fault and they need to take courses on how to do that (most need to anyway, at every med school).

 

[Doctor Bagel]

Secure from who? Once we take a test, every question is out in the open -- one way or another. So to avoid driving it underground, the questions with keys are simply posted for everyone.

Now, if the professors suffer from a lack of imagination and can't keep writing new questions, then that is 100% their fault and they need to take courses on how to do that (most need to anyway, at every med school).

Yep, probably true. That's obviously the concern at my school, though. It seems like some of our professors could also use some courses on writing questions, but that's another story.

 

[Wizard of Oz]

I think that the lack of creativity stems from the fact that the school wants to use questions that are very close to board questions that have been used. Furthermore, they don't want to have to spend their precious time writing exam items.

What I don't get is that since our question bank is likely decades old, how do we still manage to get unclear or mis-worded questions? HOW is that possible? Surely people had problems with the Q's before we saw 'em; it's not like we have some kind of genius that classes of years past didn't exhibit. What really gets me is that the prof will say, "We typically give you a few points back." Why? You've been the course director since the 1970's! 😡

Now I like the system in Kansas--computerized exams like boards. The computer can scramble the questions, and you don't have to worry about mis-gridding a scantron. Instant grading that you can suppress until later if you want to. Keep it all electronic, grades on the downlow and everything.

I don't really care much about exam review. We had a push-over prof who would more-or-less give everybody a free point if a question was bad. What good does that do? It can't alter your class rank that way. Plus what's the point of arguing over a question or two? You understand the concept? Great! You'll be ready for boards then. 👍 You're not going to not match someplace because of the five questions you felt cheated out of as an M1/M2.

 

[Doctor Bagel]

What I don't get is that since our question bank is likely decades old, how do we still manage to get unclear or mis-worded questions? HOW is that possible? Surely people had problems with the Q's before we saw 'em; it's not like we have some kind of genius that classes of years past didn't exhibit. What really gets me is that the prof will say, "We typically give you a few points back." Why? You've been the course director since the 1970's! 😡

Well, we have a certain prof now who I thought was a really nice guy but apparently refuses to recognize if anything is poorly worded and likes to end emails with rude responses if you question the wording. Major disillusioning moment for me. 👎 🙁

Anyway, I'm assuming the USMLE is written by people who are really good at writing questions with minimal ambiguity so whatever. I think the above examples of exam review at schools like TCOM are good, though, because you can actually learn from your mistakes. With no exam review, which is essentially what we have, you can't really figure out what you don't know or why your thought process was wrong.

 

[DragonWell]

At LECOM-B, we spend a couple hours going over a keyed copy of the test, after which we have an opportunity to address any ambiguous or poorly worded questions. We are on the honor system not to copy questions verbatim. Profs also do stats on all the questions and if the distribution is way off, the question will likely get tossed out.

 

[BusterDO]

I would prefer our school did computerized exams. I think it will help prepare for the style of the board exams, and I'm already sick of filling out scantrons for every exam and quiz (sometimes 4 a day). For the exams, do you take them in a computer lab or do you do it in the classroom on your laptops? I imagine cheating is a concern when people are using their own computers.

 

[Doctor Bagel]

I would prefer our school did computerized exams. I think it will help prepare for the style of the board exams, and I'm already sick of filling out scantrons for every exam and quiz (sometimes 4 a day). For the exams, do you take them in a computer lab or do you do it in the classroom on your laptops? I imagine cheating is a concern when people are using their own computers.

There is computer software that lets you take tests on your own laptop. Basically, it blocks your ability to access anything on your laptop aside from the exam, so you can't pull up your notes or look at things for cheating. We used software like this in law school for essay exams. I'm sure that they could use something similar for the exams at KU. Also, I think KU requires all students to buy the same laptop, so that would make installing the software easier.

 

[BusterDO]

Well, we have a certain prof now who I thought was a really nice guy but apparently refuses to recognize if anything is poorly worded and likes to end emails with rude responses if you question the wording. Major disillusioning moment for me. 👎 🙁

Anyway, I'm assuming the USMLE is written by people who are really good at writing questions with minimal ambiguity so whatever. I think the above examples of exam review at schools like TCOM are good, though, because you can actually learn from your mistakes. With no exam review, which is essentially what we have, you can't really figure out what you don't know or why your thought process was wrong.

Thanks for the info on the computerized exams.

I'm not really a big fan of reviews because I feel that they take too much time. I prefer to go back over my test on my own and figure out where my train of thought failed. I think that part of being a good physician is not only knowing the answer, but being able to find it when you don't...besides, isn't that why they started wikipedia

 

[Doctor Bagel]

Thanks for the info on the computerized exams.

I'm not really a big fan of reviews because I feel that they take too much time. I prefer to go back over my test on my own and figure out where my train of thought failed. I think that part of being a good physician is not only knowing the answer, but being able to find it when you don't...besides, isn't that why they started wikipedia

Yeah, I can see that, too. Going through the whole exam with the whole class would be time consuming. So I guess the just letting you review the exam yourself with the correct answers available works -- I'm assuming in this situation that your profs would be willing to answer any questions about the exam. Letting you keep the exam also works if the profs can write enough good questions. If they let you keep the exam, I think they have to make past exams publicly available to future classes, too, because otherwise well connected students might have an unfair advantage. They could either leave copies of old exams in the library or post them online for everyone.

I like wikipedia. 🙂

 

[Wizard of Oz]

Also, I think KU requires all students to buy the same laptop, so that would make installing the software easier.

As of last year, yep yep, an HP tablet PC. You had to buy it from the school. Really it was my first strike against the school, but lately I've wondered about whether I made the right decision. There's no place like home, there's no place like home...

Naw, then I'd have missed out on {Doctor Bagel} 😀

Wikipedia is awesome.

 

[ArcherM2]

Our test review is run similar to the one at TCOM

Yeah, if you're PBL...LDP gets the shaft.