{"id":1249,"date":"2023-04-17T14:08:00","date_gmt":"2023-04-17T18:08:00","guid":{"rendered":"https:\/\/ctl.cedarville.edu\/wp\/?p=1249"},"modified":"2024-07-11T21:09:48","modified_gmt":"2024-07-12T01:09:48","slug":"turnitin-adds-ai-writing-indicator-to-similarity-report","status":"publish","type":"post","link":"https:\/\/ctl.cedarville.edu\/wp\/turnitin-adds-ai-writing-indicator-to-similarity-report\/","title":{"rendered":"Turnitin Adds AI Writing Indicator to Similarity Report\u00a0"},"content":{"rendered":"Reading Time: <\/span> 3<\/span> minutes<\/span><\/span>\n

It\u2019s no secret that ChatGPT\u2019s popularity is growing. And plagiarism detecting tools are aware of that \u2013 and the need to adjust their offerings to help identify when student work may have been supplemented or entirely created by AI. Turnitin recently announced that it will now display a score to instructors within the Similarity Report to indicate what percentage of a paper is highly likely to be generated by AI. <\/p>\n\n\n\n

Turnitin is quick to say that their detection isn\u2019t foolproof and the percentage displayed \u201cshould not be used as a definitive measure of misconduct or punitive tool.\u201d The AI percentage is presented to inform instructors and give them data so they can decide how to then handle the situation. It should also be noted that this percentage is only visible to instructors \u2013 students will not be able to check their own papers for this AI score.  <\/p>\n\n\n\n

How does Turnitin\u2019s AI detection work?  <\/h2>\n\n\n\n

Turnitin can only detect AI writing in long-form paragraphed writing. It\u2019s not able to reliably identify AI influence in short-form content (bulleted lists, tables, annotated bibliographies) or non-prose writing (poetry, scripts, code). Turnitin examines each sentence in a submitted work in context \u2013 it chunks the work into about 100-word segments, then overlaps them to ensure each sentence is checked in its proper context. Each sentence is then internally labeled as AI or not-AI, and that is used to create the AI-generated percentage. <\/p>\n\n\n\n

How can I find this AI score?  <\/h2>\n\n\n\n

The AI percentage is located below the standard similarity score in the Similarity Report. The Similarity Report, however, does not show the highlighting for what sections Turnitin has identified as likely generated by AI. That can be accessed by clicking on the AI percentage and opening the AI writing report.<\/p>\n\n\n\n

\"The
Turnitin Similarity Report showing the new AI percentage<\/em><\/figcaption><\/figure>\n\n\n\n

What can I learn from the AI Writing Report? <\/h2>\n\n\n\n

The AI writing report shows the percentage of AI-created material within the paper and highlights those sections. I asked ChatGPT to write a blog post on creating clear content, and Turnitin correctly identified it as AI-generated.  <\/p>\n\n\n\n

\"The
Turnitin AI Writing Report for a paper that was fully generated by AI<\/em><\/figcaption><\/figure>\n\n\n\n

I also ran a blog post on the same topic that we\u2019ve previously published on FOCUS, and Turnitin again correctly identified it as human-written (though the similarity report was very concerned that this exactly matched the FOCUS blog post). <\/p>\n\n\n\n

\"The
Turnitin AI Writing Report for a paper that was fully written by a person<\/em><\/figcaption><\/figure>\n\n\n\n

And finally, I was curious about how Turnitin would handle a paper that started out as generated by AI and was then edited or partially rewritten. I took the ChatGPT-generated blog post on creating clear content and rewrote large sections of it, primarily rephrasing and simplifying things. If I left the numbered lists from the beginning in the post, Turnitin detected less AI influence (the AI detector focuses on prose \u2013 it doesn\u2019t work well with lists, scripts, poetry, etc). But once I reworked that list to be headings and paragraphs, Turnitin detected that 35% of the paper was generated by AI.  <\/p>\n\n\n\n

\"The
Turnitin AI Writing Report for a paper that was generated by AI and then edited\/partially rewritten by a human<\/em><\/figcaption><\/figure>\n\n\n\n

There\u2019s so much more that could be said about this new feature from Turnitin. To read their full notes and FAQ, check out Turnitin\u2019s AI Writing Detection Capabilities page<\/a>.  <\/p>\n\n\n\n

Want to never miss a post? Subscribe here!<\/h3>\n\n\n
\n\t\t
\n\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

\n\t\t\t\t\t\tSubscribe<\/a>\n\t\t\t\t\t<\/p>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>","protected":false},"excerpt":{"rendered":"

Reading Time: <\/span> 3<\/span> minutes<\/span><\/span>It\u2019s no secret that ChatGPT\u2019s popularity is growing. And plagiarism detecting tools are aware of that \u2013 and the need to adjust their offerings to help identify when student work may have been supplemented or entirely created by AI. Turnitin recently announced that it will now display a score to instructors within the Similarity Report to indicate what percentage of a paper is highly likely to be generated by AI.  Turnitin is quick to say that their detection isn\u2019t foolproof and the percentage displayed \u201cshould not be used as a definitive measure of misconduct or punitive tool.\u201d The AI percentage is presented to inform instructors and give them data so they can decide how to then handle the situation. It should also be noted that this percentage is only visible to instructors \u2013 students will not be able to check their own papers for this AI score.   How does Turnitin\u2019s AI detection work?   Turnitin can only detect AI writing in long-form paragraphed writing. It\u2019s not able to reliably identify AI influence in short-form content (bulleted lists, tables, annotated bibliographies) or non-prose writing (poetry, scripts, code). Turnitin examines each sentence in a submitted work in context \u2013 it chunks the work into about 100-word segments, then overlaps them to ensure each sentence is checked in its proper context. Each sentence is then internally labeled as AI or not-AI, and that is used to create the AI-generated percentage.  How can I find this AI score?   The AI percentage is located below the standard similarity score in the Similarity Report. The Similarity Report, however, does not show the highlighting for what sections Turnitin has identified as likely generated by AI. That can be accessed by clicking on the AI percentage and opening the AI writing report. What can I learn from the AI Writing Report?  The AI writing report shows the percentage of AI-created material within the paper and highlights those sections. I asked ChatGPT to write a blog post on creating clear content, and Turnitin correctly identified it as AI-generated.   I also ran a blog post on the same topic that we\u2019ve previously published on FOCUS, and Turnitin again correctly identified it as human-written (though the similarity report was very concerned that this exactly matched the FOCUS blog post).  And finally, I was curious about how Turnitin would handle a paper that started out as generated by AI and was then edited or partially rewritten. I took the ChatGPT-generated blog post on creating clear content and rewrote large sections of it, primarily rephrasing and simplifying things. If I left the numbered lists from the beginning in the post, Turnitin detected less AI influence (the AI detector focuses on prose \u2013 it doesn\u2019t work well with lists, scripts, poetry, etc). But once I reworked that list to be headings and paragraphs, Turnitin detected that 35% of the paper was generated by AI.   There\u2019s so much more that could be said about this new feature from Turnitin. To read their full notes and FAQ, check out Turnitin\u2019s AI Writing Detection Capabilities page.   Want to never miss a post? Subscribe here!<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[6,7,5],"tags":[83,17],"class_list":["post-1249","post","type-post","status-publish","format-standard","hentry","category-canvas","category-educational-tools","category-teaching-learning","tag-chatgpt","tag-turnitin"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/posts\/1249","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/comments?post=1249"}],"version-history":[{"count":3,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/posts\/1249\/revisions"}],"predecessor-version":[{"id":1869,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/posts\/1249\/revisions\/1869"}],"wp:attachment":[{"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/media?parent=1249"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/categories?post=1249"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ctl.cedarville.edu\/wp\/wp-json\/wp\/v2\/tags?post=1249"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}