Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In the LMS app, detect when a student is repeatedly pasting into annotation bodies within an assignment #1630

Open
mkdir-washington-edu opened this issue Dec 23, 2024 · 0 comments

Comments

@mkdir-washington-edu
Copy link

The problem
Low effort uses of LLMs in an LMS assignment usually end with the student copy/pasting annotation text over and over again. If instructors are aware this is happening they'll know where to put their attention to determine if the pasting is in fact use of an LLM, or if it's for a useful reason in the assignment.

This is defeatable by the student hand-copying over responses, and not every copy/paste (or even repeated copy/pastes) will be LLM usage, so we should make sure this results in a flag for the professor to look further, but not an automatic response by our platform or an alert to the student.

The solution
Making sure annotations made using copy/paste are visible, and when a particular student has most or all of their annotations in a given assignment created using copy/paste, flagging that student for a professor.

This flag might be in the client to the instructor(s) only, per annotation. There might also be a note in the client or in the Reporting Dashboard Assignment View for any individual student who surpasses a certain number of annotations made with copy/paste (say 80%).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant