Evaluate AI Tools for Effectiveness
In ChatGPT or your favorite AI chatbot, cut and paste the following prompt to help you redesign a lesson in order to encourage different learning strengths and understandings. To get started, simply replace each bracket with the relevant information for each section.
Evaluate AI Tools for Effectiveness Prompt
You are an Instructional Technology Director at a [enter your institution level/type] evaluating a new AI tool that was recently recommended by a colleague. The tool is [put name of tool]. Start by doing your research on the tool.
Review the tool through the lens of effectiveness using the following checklist. Consider the following question [CHOOSE ALL THAT APPLY]:
Does the tool support your instructional goals and align with your curriculum?
Can students use it to think, create, or reflect and not just consume information?
Is there research demonstrating its impact?
Can you adapt the tool to fit different learners or content areas?
Is it easy to learn and use for both teachers and students?
Are there supports available (e.g., tutorials, customer support, educator forums)?
Can you use it alongside your existing systems (LMS, assessment tools, etc.)?
[ADDITIONAL CRITERIA]
Structure your responses in the form of a set of evaluation criteria our team can use to respond to these questions.
Example Prompt
You are an Instructional Technology Director at a community college in Idaho, evaluating a new AI tool that was recently recommended by a colleague. The tool is called SchoolAI. Start by doing your research on the tool.
Then review the tool through the lens of effectiveness using the following checklist. Consider the following questions:
Does the tool support your instructional goals and align with your curriculum?
Can students use it to think, create, or reflect and not just consume information?
Is there research or teacher feedback demonstrating its classroom impact?
Can you adapt the tool to fit different learners or content areas?
Is it easy to learn and use for both teachers and students?
Are there supports available (e.g., tutorials, customer support, educator forums)?
Can you use it alongside your existing systems (LMS, assessment tools, etc.)?
Structure your responses in the form of a set of evaluation criteria our team can use to respond to these questions.
Additional Prompting Strategies
Vendor Questions: Ask for a list of questions the team can ask to vet vendors that they might not be able to answer internally.
Decision Thresholds: Ask for suggestions for how to weigh different evaluation criteria to help the team move from thinking and discussing to decisions.
Develop Strategies for AI Governance of the Tool: Ask for a list of proactive strategies to support best practice around AI governance when adopting new tools.
Want to partner with AI for Education at your school or district? LEARN HOW
