Dr. Frank Nguyen has a great article on building valid assessments at the Adobe Developer Center. He points out the dangers of relying on written tests to tell us if learners know hot do do something isntead of asking them to demonstrate that they can do it. Of course this is made easier by modern LMS’ because they tend to make multiple choice tests easier. To create valid tests he recommends:
- Identifying the instructional objectives
- Categorize the objectives (Is it a fact, a concept, a process, a procedure, or a principle)
- Select the most appropriate assessment depending on the type of objective
- Draft the assessment item
- Develop the assessment item
He recommends the appropriate assesment type depending on the type of objective.
http://sdc.shockwave.com/devnet/captivate/articles/assessment.html