Experimental questions

This forum made possible through the generous support of SDN members, donors, and sponsors. Thank you.

starstarie

Full Member
10+ Year Member
Joined
Oct 22, 2009
Messages
462
Reaction score
144
Ok, so I keep hearing people talk about these "experimental questions" that they are SURE are on their tests. Is this a real, confirmed thing, or is it just speculation? The beginning of First Aid says something like "keep in mind there may be experimental questions that don't count towards your grade." But does anyone have an actual reliable source for this??

Members don't see this ad.
 
Everyone thinks the questions they don't know the answer to is an experimental.
 
  • Like
Reactions: 2 users
If it wasn't in FA or UW they can't count it towards your score...it ju...jus...just...wa..wa..wouldn't be fairrrrr :cryi:

IMO it's 100% speculation turned internet urban legend repeated over and over again every year to the point that authors of review books are mentioning it.
 
  • Like
Reactions: 1 user
I don't think there's any sure way to know whether you'll have experimental questions or even if a particular question on your exam is experimental.

I also think that there probably is a tendency to speculate that a question one simply doesn't know is experimental.

That all being said, I can certainly imagine certain types of things happening on your exam where you have a strong suspicion the question was experimental. Obviously it would be stupid not to try on any given question on the wager that it's experimental, but it can be a justification for a testing strategy that simply does not waste time on questions that you don't know or that would take an inordinate amount of time to figure out.

The types of things I can imagine (of course I haven't taken the test) seeming experimental would be: strange new ways of interfacing with questions that you can find little or no mention of other people encountering in the past; questions about strange topics to which medical students are not routinely directly exposed (this is probably more out there than what I'm really imagining, but an example might be if a question seemed to require superficial but specific knowledge regarding comparative politics related to health care law), etc.

I don't think there's ever a way of really knowing whether you will get or have gotten an experimental question, but it's possible that people in the past have had their suspicions confirmed by later changes to the test content or structure. For instance, I bet you that within the last few years there have been people who got questions about the new "safety" stuff that they thought were kind of odd. They can probably rest assured now that those were experimental.
 
Members don't see this ad :)
They're just new questions. Like the old ones, their difficulty, which correlates to the relative weighting of your cumulative exam, is based on the percentages of students answering correctly/incorrectly. If the percentage correct is repeatedly low for a question, it probably gets reworded/replaced/thrown out; likewise for a high percentage, they probably find a new way to ask about that specific topic if the old is too easy (i.e. the previous way that it had been asked for years is now in every review book). It makes sense that new questions are introduced every year in the May-June block when scores are held for a single release date, so they can accumulate stats for the news questions and update stats for the old.
 
Top