{"id":30618,"date":"2024-01-11T10:34:55","date_gmt":"2024-01-11T09:34:55","guid":{"rendered":"https:\/\/kinit.sk\/project\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/"},"modified":"2024-06-14T10:52:10","modified_gmt":"2024-06-14T08:52:10","slug":"sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking","status":"publish","type":"project","link":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/","title":{"rendered":"SDA: Using large language models to support teachers in teaching young people about critical thinking"},"content":{"rendered":"
\n
Slovak Debate Association<\/a> (SDA) is teaching young people about debating, democracy, human rights, and openness. To scale these efforts, we help SDA with developing a generative AI based approach to automatically rate the answers of students involved in educational activities, such as Critical Thinking Olympics<\/a>. This approach will enable SDA to extend their activities and involve many more students. In the AI-powered solution, it must be assured to provide the students with truthful and trustworthy information, which is a challenge for the current generation of language models.<\/h5>\n<\/div>\n\n
\n

In this project, we provide consultation services for the Slovak Debate Association<\/a>, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement. <\/p>\n<\/div>\n\n

\n

As a part of their curriculum, they challenge their students with various tests and quizzes, asking them to use the attained skills. Critical Thinking Olympics<\/a> is one of their activities, with outreach to thousands of students. However, as the number of their students rises, the capacity to manually evaluate every student\u2019s answer is becoming difficult to manage<\/strong>.<\/p>\n<\/div>\n\n

\n

This project uses generative language models (such as infamous ChatGPT) to automatically annotate students\u2019 answers. We keep a close eye on the truthfulness of the ratings, as we need to assure that the students will be rated accurately by the AI. SDA implemented multiple counter measures to identify and correct the hallucinations of the GPT models. <\/p>\n<\/div>\n\n

\n

Firstly, the difficult task of grading open-ended answers was broken to smaller independent problems which were less likely to cause hallucinations. Secondly, each prompt needs to go through multiple rounds of iterations where the prompt is tested, evaluated and adjusted by humans on a small sample. Thirdly, methods such as ensembles of GPTs<\/em> (where multiple GPTs vote on the grading) and self-validation <\/em>(where the model is asked to check its answers) were used. Fourthly, anomaly detection is performed on the grading and the outlier answers are graded by either a stronger model or by humans. Lastly, a small sample from each grading category is validated by humans which ensures that the grading was done rigorously. <\/em>This is a nice example of how we can use state-of-the-art NLP technologies to help educate young people<\/strong>.<\/p>\n<\/div>\n\n

\n\t
\n\t\t
\n\t\t\t
\n \t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n<\/div>\n\n
\n
\n\t
\n\t\t
\n\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Project team<\/h2><\/div>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Mat\u00fa\u0161 Pikuliak<\/h5>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Research Consultant<\/div>\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Michal Gregor<\/h5>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Researcher<\/div>\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section> \n<\/div>\n\n
\n

This project was funded by Nad\u00e1cia Pontis.<\/p>\n<\/div>","protected":false},"featured_media":30601,"template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[142,412],"class_list":["post-30618","project","type-project","status-publish","has-post-thumbnail","hentry","category-2023-sk","category-common-good-project-sk"],"acf":[],"yoast_head":"\nSDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT<\/title>\n<meta name=\"description\" content=\"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/\" \/>\n<meta property=\"og:locale\" content=\"sk_SK\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT\" \/>\n<meta property=\"og:description\" content=\"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/\" \/>\n<meta property=\"og:site_name\" content=\"KInIT\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-14T08:52:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/202312_web_project_debatna_asociacia_feature.png\" \/>\n\t<meta property=\"og:image:width\" content=\"10801\" \/>\n\t<meta property=\"og:image:height\" content=\"5653\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@kinit\" \/>\n<meta name=\"twitter:label1\" content=\"Predpokladan\u00fd \u010das \u010d\u00edtania\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 min\u00faty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/\",\"url\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/\",\"name\":\"SDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/202312_web_project_debatna_asociacia_feature-scaled.png\",\"datePublished\":\"2024-01-11T09:34:55+00:00\",\"dateModified\":\"2024-06-14T08:52:10+00:00\",\"description\":\"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/#breadcrumb\"},\"inLanguage\":\"sk-SK\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"sk-SK\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/#primaryimage\",\"url\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/202312_web_project_debatna_asociacia_feature-scaled.png\",\"contentUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/202312_web_project_debatna_asociacia_feature-scaled.png\",\"width\":2560,\"height\":1340},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Common good project\",\"item\":\"https:\\\/\\\/kinit.sk\\\/category\\\/common-good-project\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"SDA: Using large language models to support teachers in teaching young people about critical thinking\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\",\"url\":\"https:\\\/\\\/kinit.sk\\\/\",\"name\":\"KInIT\",\"description\":\"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/kinit.sk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"sk-SK\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT","description":"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/","og_locale":"sk_SK","og_type":"article","og_title":"SDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT","og_description":"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0","og_url":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/","og_site_name":"KInIT","article_modified_time":"2024-06-14T08:52:10+00:00","og_image":[{"width":10801,"height":5653,"url":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/202312_web_project_debatna_asociacia_feature.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@kinit","twitter_misc":{"Predpokladan\u00fd \u010das \u010d\u00edtania":"2 min\u00faty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/","url":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/","name":"SDA: Using large language models to support teachers in teaching young people about critical thinking - KInIT","isPartOf":{"@id":"https:\/\/kinit.sk\/#website"},"primaryImageOfPage":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/#primaryimage"},"image":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/#primaryimage"},"thumbnailUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/202312_web_project_debatna_asociacia_feature-scaled.png","datePublished":"2024-01-11T09:34:55+00:00","dateModified":"2024-06-14T08:52:10+00:00","description":"In this project, we provide consultation services for the Slovak Debate Association, a non-profit organization that teaches young people to debate, develops their critical thinking, and supports democracy, human rights, and social engagement.\u00a0","breadcrumb":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/#breadcrumb"},"inLanguage":"sk-SK","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/"]}]},{"@type":"ImageObject","inLanguage":"sk-SK","@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/#primaryimage","url":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/202312_web_project_debatna_asociacia_feature-scaled.png","contentUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/202312_web_project_debatna_asociacia_feature-scaled.png","width":2560,"height":1340},{"@type":"BreadcrumbList","@id":"https:\/\/kinit.sk\/sk\/projekt\/sda-using-large-language-models-to-support-teachers-in-teaching-young-people-about-critical-thinking\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kinit.sk\/sk\/"},{"@type":"ListItem","position":2,"name":"Common good project","item":"https:\/\/kinit.sk\/category\/common-good-project\/"},{"@type":"ListItem","position":3,"name":"SDA: Using large language models to support teachers in teaching young people about critical thinking"}]},{"@type":"WebSite","@id":"https:\/\/kinit.sk\/#website","url":"https:\/\/kinit.sk\/","name":"KInIT","description":"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kinit.sk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"sk-SK"}]}},"_links":{"self":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/30618","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project"}],"about":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/types\/project"}],"version-history":[{"count":2,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/30618\/revisions"}],"predecessor-version":[{"id":32351,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/30618\/revisions\/32351"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media\/30601"}],"wp:attachment":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media?parent=30618"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/categories?post=30618"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}