- Joined
- Dec 13, 2001
- Messages
- 3,339
- Reaction score
- 31
Look what I found! 😀
------------------------------------------------------------------
Notes on National Board Issues
Dr Mary Foertsch (MF), Director of the Department of Testing Services at the ADA and Secretary for the Joint Commission on National Dental Examinations discussed issues of concern about the National Board examinations.
The part one exam will be available to be taken on line at Sylvan Prometric Testing Centers (www.prometric.com), like part 2 but using newer software which will have fewer clicks and delay between items or images. The process is begun now but will be available for students by fall.
Review of Part 1: The Joint Commission suggested that National Board Dental Examination (NBDE) Part I should be comprehensive and eliminate the four current subject sections. A ?Key feature item (KF)? approach for NBDE Part I is being considered. KF items have a format between testlet and case history. These require more understanding and application than recall. This is the direction being considered for NBDE Part I.
A research agenda has been established and one researcher Tom Haladyna, a testing expert, has been hired to do studies on testing methodology that may include partial credit models and factor analysis of the difference between the written and computer versions of the NDBE Part 1. A technical report and item writing guidelines will be posted on the ADA web site to meet the many requests from educators for guidelines.
ADA will eliminate ?in office? testing after March 15.
Contacts are being made with Sylvan Prometric for the use of Prime software for release national boards on the web to accommodate requests for practice tests. The practice test should match the experience at the Sylvan Prometric Technology Centers while taking the exam as closely as possible. The tests need to have a look similar to a real test experience and also give students some feedback on their performance. By the end of year ADA will sell paper versions of released exams. Part of the proceeds will be shared with American Student Dental Association which will continue to provide pencil and paper versions of the released examinations.
Q There was a question from the group about scoring methodology for the NDBE.
A The scores are no longer norm referenced because students can take the exam early in testing centers.
Q For students taking the exam early, their scores may not be included along with the rest of their class who take the test later together on paper. There was a concern that more of early takers might be better students. If better students take the exam early, and are not reflected in their class average then this could lead to a lowering of the school average score reported as the average of the students who take the test together on paper. This might be a concern to some Deans whose scores show an apparent decrease. Could the data be reported with all of the students in a particular class reported together?
A This had been discussed by the Joint Commission recently and it was concluded that the scores needed to be combined, however because students can take the test electronically at almost any time, some deadlines may be needed so that the results can be reported in a timely manner.
Q: For the new case format, i.e. little cases, how long until incorporation.
A: Key features are just beginning to be explored for NDBE Part 1 and will be researched on a 3-5 year schedule. New scoring will be required because is based on sets of items and that will take time to figure out.
Q- The composition of the Test Development Workshop Groups for developing the new questions (even part 1) seemed to be dominated by clinicians who may not reflect the point of view of basic scientists and their needs. Student may have little clinical knowledge when they start basic science classes.
A: KF items would be used in NDBE Part 1 for certain issues such as ethics which are hard to test with typical test structure. The underlying structure of the basic test will remain the same.
MF: On releasing exams: With the use of computer exams, more items are required to maintain security. In addition, there was an incident of test form theft which also reduced the pool of available questions. The board felt that it needed to increase the question bank size before it could release any questions. New item banking software is being developed to allow items to be banked faster and bring in more items faster. The board hopes to release more exams in the future.
Q Couldn't they release the versions that had been stolen? Also, there was a suggestion that rather than only relying on acquaintances of the test committee members as a sources for questions that the board could advertise for questions?
A: MF agreed , providing the sources of the questions could be properly tracked, this might work.
Q: It was suggested that the submitted questions could be used "as is" or changed by the committee, and that modification might be easier than complete development of new questions.
A: Yes, in addition, letters have been sent to Deans to request additional test items and cases.
Q How are exams scored?
A The exams are criterion referenced and the tests items are being aligned with the published competencies in dental or dental hygiene programs.
Q Will paper and pencil exams be eliminated?
A No, both paper and computer exams will continue, at least for a while. A period of time to establish equivalency format is still needed. They seem to be equivalent but additional monitoring is continuing.
Q Are you going to have actual testing from the web?
A. No, for security reasons we won't use the web tests for the actual tests, but will use the web for practice tests. The actual online test will be taken in the Sylvan Prometric Centers.
MF: The ADA is looking for better ways to deliver tests. They are exploring other vendors such as National Computer Systems Vue Testing Services in Minneapolis, (www.vue.com) who has offered to do a pilot using their systems doing the DH board exams some time this summer.
Q: The National Board of Dental Examinations has a requirement that the students should have successfully completed ("is prepared" http://www.ada.org/prof/prac/licensure/lic-natbd.html#Eligbility Requirements)) in all part II subjects, such as pharmacology, prior to taking NBDE Part II. What does the board mean by ?successfully completed their courses??
A: The National Board means that the courses should be completed and passed before the students are signed up for the National Board exam. When scheduling students to take the test, the Dean indicates whether a student has completed his requirements.
MF: We are running into more testing window issues and the board might need to establish testing windows rather than have the exams available on demand.
Q We have a student or two from years ago who have still not passed their boards. Are their scores included in the current class average?
A: Currently, there is no mechanism for separating these student's scores out.
Q: How many times can you take the board?
A: You can take the either the computerized or paper and pencil versions twice a year. More frequent access would compromise the test forms. Students can continue taking the exams as many times as they want
Q: How many times can a student take broad?
A: Students can repeat as many times as they want, some as many as 15 times.
Q: What is your policy with respect to foreign trained dentist taking the exam?
A: We let foreign trained dentists take the exam. Many times they are in US accredited programs. They need to have their training program evaluated through Education Credential Evaluators, and compared to see if there is an equivalency with US programs. Some foreign trained students are asked to take additional course work. We can track repeating students from accredited and non-accredited programs. When students repeat the exam their scores often go down.
REFERENCE: http://www.db.uth.tmc.edu/faculty/vlewis/adea/BSCWEB/BSCWEBMIN/02bscaucusminutes.htm
------------------------------------------------------------------
Notes on National Board Issues
Dr Mary Foertsch (MF), Director of the Department of Testing Services at the ADA and Secretary for the Joint Commission on National Dental Examinations discussed issues of concern about the National Board examinations.
The part one exam will be available to be taken on line at Sylvan Prometric Testing Centers (www.prometric.com), like part 2 but using newer software which will have fewer clicks and delay between items or images. The process is begun now but will be available for students by fall.
Review of Part 1: The Joint Commission suggested that National Board Dental Examination (NBDE) Part I should be comprehensive and eliminate the four current subject sections. A ?Key feature item (KF)? approach for NBDE Part I is being considered. KF items have a format between testlet and case history. These require more understanding and application than recall. This is the direction being considered for NBDE Part I.
A research agenda has been established and one researcher Tom Haladyna, a testing expert, has been hired to do studies on testing methodology that may include partial credit models and factor analysis of the difference between the written and computer versions of the NDBE Part 1. A technical report and item writing guidelines will be posted on the ADA web site to meet the many requests from educators for guidelines.
ADA will eliminate ?in office? testing after March 15.
Contacts are being made with Sylvan Prometric for the use of Prime software for release national boards on the web to accommodate requests for practice tests. The practice test should match the experience at the Sylvan Prometric Technology Centers while taking the exam as closely as possible. The tests need to have a look similar to a real test experience and also give students some feedback on their performance. By the end of year ADA will sell paper versions of released exams. Part of the proceeds will be shared with American Student Dental Association which will continue to provide pencil and paper versions of the released examinations.
Q There was a question from the group about scoring methodology for the NDBE.
A The scores are no longer norm referenced because students can take the exam early in testing centers.
Q For students taking the exam early, their scores may not be included along with the rest of their class who take the test later together on paper. There was a concern that more of early takers might be better students. If better students take the exam early, and are not reflected in their class average then this could lead to a lowering of the school average score reported as the average of the students who take the test together on paper. This might be a concern to some Deans whose scores show an apparent decrease. Could the data be reported with all of the students in a particular class reported together?
A This had been discussed by the Joint Commission recently and it was concluded that the scores needed to be combined, however because students can take the test electronically at almost any time, some deadlines may be needed so that the results can be reported in a timely manner.
Q: For the new case format, i.e. little cases, how long until incorporation.
A: Key features are just beginning to be explored for NDBE Part 1 and will be researched on a 3-5 year schedule. New scoring will be required because is based on sets of items and that will take time to figure out.
Q- The composition of the Test Development Workshop Groups for developing the new questions (even part 1) seemed to be dominated by clinicians who may not reflect the point of view of basic scientists and their needs. Student may have little clinical knowledge when they start basic science classes.
A: KF items would be used in NDBE Part 1 for certain issues such as ethics which are hard to test with typical test structure. The underlying structure of the basic test will remain the same.
MF: On releasing exams: With the use of computer exams, more items are required to maintain security. In addition, there was an incident of test form theft which also reduced the pool of available questions. The board felt that it needed to increase the question bank size before it could release any questions. New item banking software is being developed to allow items to be banked faster and bring in more items faster. The board hopes to release more exams in the future.
Q Couldn't they release the versions that had been stolen? Also, there was a suggestion that rather than only relying on acquaintances of the test committee members as a sources for questions that the board could advertise for questions?
A: MF agreed , providing the sources of the questions could be properly tracked, this might work.
Q: It was suggested that the submitted questions could be used "as is" or changed by the committee, and that modification might be easier than complete development of new questions.
A: Yes, in addition, letters have been sent to Deans to request additional test items and cases.
Q How are exams scored?
A The exams are criterion referenced and the tests items are being aligned with the published competencies in dental or dental hygiene programs.
Q Will paper and pencil exams be eliminated?
A No, both paper and computer exams will continue, at least for a while. A period of time to establish equivalency format is still needed. They seem to be equivalent but additional monitoring is continuing.
Q Are you going to have actual testing from the web?
A. No, for security reasons we won't use the web tests for the actual tests, but will use the web for practice tests. The actual online test will be taken in the Sylvan Prometric Centers.
MF: The ADA is looking for better ways to deliver tests. They are exploring other vendors such as National Computer Systems Vue Testing Services in Minneapolis, (www.vue.com) who has offered to do a pilot using their systems doing the DH board exams some time this summer.
Q: The National Board of Dental Examinations has a requirement that the students should have successfully completed ("is prepared" http://www.ada.org/prof/prac/licensure/lic-natbd.html#Eligbility Requirements)) in all part II subjects, such as pharmacology, prior to taking NBDE Part II. What does the board mean by ?successfully completed their courses??
A: The National Board means that the courses should be completed and passed before the students are signed up for the National Board exam. When scheduling students to take the test, the Dean indicates whether a student has completed his requirements.
MF: We are running into more testing window issues and the board might need to establish testing windows rather than have the exams available on demand.
Q We have a student or two from years ago who have still not passed their boards. Are their scores included in the current class average?
A: Currently, there is no mechanism for separating these student's scores out.
Q: How many times can you take the board?
A: You can take the either the computerized or paper and pencil versions twice a year. More frequent access would compromise the test forms. Students can continue taking the exams as many times as they want
Q: How many times can a student take broad?
A: Students can repeat as many times as they want, some as many as 15 times.
Q: What is your policy with respect to foreign trained dentist taking the exam?
A: We let foreign trained dentists take the exam. Many times they are in US accredited programs. They need to have their training program evaluated through Education Credential Evaluators, and compared to see if there is an equivalency with US programs. Some foreign trained students are asked to take additional course work. We can track repeating students from accredited and non-accredited programs. When students repeat the exam their scores often go down.
REFERENCE: http://www.db.uth.tmc.edu/faculty/vlewis/adea/BSCWEB/BSCWEBMIN/02bscaucusminutes.htm
