Manhattan College Knowledge Base

Assessing Assignments: Identifying Risks and AI Opportunities

Updated on

It is important to assess how AI tools like ChatGPT might impact your existing assignments to determine the degree to which they are vulnerable to AI misuse. It is likely that you will need to make changes to your instructional approach in response to AI.  In addition, there may be opportunities for students to use AI in a useful way that contributes to learning. Consider the following questions when examining your course.

Are AI tools able to produce submissions comparable to that of a student?

Test assignment prompts to determine how well tools like ChatGPT can produce responses that emulate that of a student.

Tips

  • Keep in mind that these tools evolve over time so reviewing assignment prompts is something that needs to be done regularly.
  • ChatGPT and similar generative AI tools can do more than just answer questions and prompts. They can also follow additional instructions related to response length, style, and writing level, among others. It's beneficial to understand their capabilities and limitations. Tweaking the prompt, known as prompt engineering, can greatly influence the quality of the tool's response and its alignment with a specific assignment or task.

Additional Resources

  1. Video: How to Use ChatGPT for Beginners
  2. AI Misuse Rubric (from Turnitin) This is a tool for assessing assignments to identify AI vulnerabilities. 
  3. AI Misuse Checklist (from Turnitin) This is a tool for assessing assignments to identify AI vulnerabilities.

Are students mostly assessed on work that is completed predominantly outside the classroom?

Student work that is completed outside the classroom increases opportunities for academic dishonesty. The most reliable way to ensure that students are doing work independently is for them to complete work in the presence of the instructor. For work that is completed outside the classroom, a variety of strategies can be used to minimize opportunities for academic dishonesty. 

Can ChatGPT contribute to student learning in my course?

Although the advent of ChatGPT raises concerns about academic dishonesty, ChatGPT and other AI tools can be used by students in legitimate ways to support the learning process. In addition, AI has the potential to increase equity for students with disabilities, students whose first language is not English, and other underrepresented groups. Here are some ways educators and students can leverage generative AI for educational purposes:

  • Brainstorming and idea generation
  • Proofreading for grammar and spelling mistakes or checking code for syntax errors
  • Summarizing, paraphrasing, and clarifying complex content 
  • Providing feedback on writing style, clarity, and substance
  • Serving as a conversational partner for language learners
  • Acting as a study partner or virtual tutor

Finally, AI is increasingly being utilized in professional settings, so equipping students with the skills to navigate it is crucial. Practical applications of AI differ across fields, so exploring professional resources to understand its role in various workplaces is recommended. 

What next?

Existing assignments may need to be tweaked or redeveloped to reduce their vulnerability to unwelcome generative AI use. Assignments that require students to summarize well-established knowledge are particularly susceptible. Asking students to incorporate personal experiences, synthesize information across multiple sources, provide in-depth knowledge, and respond to local scenarios or current events, are some examples of strategies for reducing the potential for AI to be used. It is important to keep in mind that generative AI tools are able to fabricate seemingly realistic reflections in response to a prompt. 

Generative AI has strengths and limitations, but It is important to keep in mind that AI will evolve, so strategies that work now, may not work in the future. Incorporating interaction with generative AI tools into assignments makes the use of AI transparent as a tool for generating ideas, debating topics, or assisting with writing and self-expression.

Additional Resources

0 Comments

Add your comment

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Next Article Instructional Strategies for Increasing AI Awareness