-
Multiple-Choice Questions
13 Lessons -
Assessment research shows many multiple-choice questions are poorly written. Nedeau-Cayo's study of thousands of nursing certification questions, for example, found 84% (!) of the questions had a significant flaw—and many had more than one significant flaw!
Poorly written questions typically don't assess the intended knowledge and skills, leading to less valid assessments and much frustration. If you use multiple-choice assessment results to make decisions—such as who can proceed—poorly written questions can open your organization to legal risk.
Writing good multiple-choice questions is a critical skill but is rarely taught to people who design workplace or adult instruction. The bottom line is that everyone who uses multiple-choice assessments must be able to write good multiple-choice questions!
Reference: Nedeau-Cayo, R., Laughlin, D., Rus, L., & Hall, J. (2013). Assessment of item-writing flaws in multiple-choice questions. Journal for Nurses in Professional Development, 29, 52–57.
Most people think they write acceptable multiple-choice questions. I certainly did until my mistakes were pointed out to me many years ago. I was humiliated and resolved to improve my skills.
If you aren't sure of the answer to <
Writing well-written, valid multiple-choice questions that measure achievement of the learning objectives is a critical skill for people who design instruction. (The correct answer is c.) This course will teach you how to write clear and relevant multiple-choice questions that measure achievement of the learning objectives.
Take the quiz to to see what you don't yet know about writing multiple-choice questions.
The learning objectives for this course are:
- Write well-written learning objectives to inform your multiple-choice questions.
- Analyze learning objective and multiple-choice questions to identify flaws that should be fixed.
- Write relevant multiple-choice items that measure achievement of your learning objectives.
The cost for the class is US$349/person. We offer discounts for 3+ people from the same team, paid at the same time. We accept credit cards and PayPal for payment. We can also accept team enrollment payments via credit card using Stripe.
Click on Enroll. Before enrolling, make sure this is a good time to complete the course. We aim to greatly improve your multiple-choice question writing skills and you'll need time for the course and activities.
If you aren't ready to enroll right now but want to be kept up to date on the course and new courses, sign up for our email list at the top of www.pattishank.com. We don't sell anyone's contact information E V E R and don't send out a lot of email.
Self-paced means you learn whenever it fits into YOUR schedule. You can read, watch the videos, complete the assignments, and ask Patti questions at times that work for you.
Based on what participants who have completed the course tell us, the course activities and practice elements take 10-15 hours to complete. This is expected to vary, of course.
Once you register, you have immediate access to all course materials so we can't offer refunds. If you cannot attend before starting the course, you can substitute another participant in your place. If there's a problem that occurs during the course, get in touch. We have a few options for making the course available when you have time.
Course materials are copyrighted and each enrollment allows only the enrollee to access the course, materials, and activities. But we'd love to train your team! If interested, email info@pattishank.com for group discounts or to set up a workshop specifically for your team. We have discounts for 3+ team members enrolling in the course at the same time or 10+ team members enrolling into a private team course.
If you have questions, please get in touch! info@pattishank.com.
Patti’s course has been invaluable in helping me write effective, credible assessments for my online learning courses and assessments.
There is a wealth of well-researched detail about what exactly goes into writing an effective multiple-choice question and how these questions relate to the bigger picture of effective learning. I strongly recommend this course to anyone who wants to make their learning more effective as well as anyone who needs to write effective assessments.
Nick Tchan
Instructional designer, Australia
Patti provided comprehensive research to practice guides and robust practice experiences to foster the critical skill set of writing substantive multiple-choice questions to assess actual learner performance. I strongly encourage everyone involved with performance assessment to take Patti's illuminating and enriching course.
Andrew Muccio
Instructional Designer, USA
This course has an expert facilitator, top-notch resource materials, well-designed practice activities, in-depth research on the topic, and lively discussion. We explored not just the How of writing good multiple choice questions, but also the Why. Perfect timing! My new project includes a summative assessment, and I'm excited to apply what I learned.
Kim Lindsey
Lead Learning Experience Designer, USA
This training gave me insight into the many factors involved in creating effective multiple-choice questions. It has prepared me to better advise instructors on whether multiple-choice questions are the best tool, and how they can be crafted to generate reliable, valid data.
Anna Landes Benz
Program and Faculty Developer, USA
All the information includes hands-on exercises, so you immediately practice to acquire understanding. I have just finished creating five online courses to learn English for Spanish speakers and will incorporate what I learned to make the quizzes better. I highly recommend this course to anyone who wants to improve the effectiveness of their content design.
Robert Brandwayn
Language Coach and E-Learning Instructional Designer, Bogotá, Colombia
Great class!! I now have the tools I need to make question writing an easier and less painful process.
Mariann Foster
Instructional Designer, USA
Patti is going to make you confront learning objectives and the deeper purpose of assessments . She helps us abandon some of those tired learning objectives we've been using for years we've always known were kinda lame like "explain, describe, and list."
I really liked how the course emphasized key points (example: reliability and validity in assessments) as well as provide us with lovely job aids and solid, challenging practice.
Jane Gire
Director of Performance Programs, Dental Services Company USA