{"id":28619,"date":"2022-10-24T09:13:52","date_gmt":"2022-10-24T07:13:52","guid":{"rendered":"https:\/\/kinit.sk\/publication\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/"},"modified":"2026-04-23T14:55:38","modified_gmt":"2026-04-23T12:55:38","slug":"auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles","status":"publish","type":"publication","link":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/","title":{"rendered":"Auditing YouTube&#8217;s Recommendation Algorithm for Misinformation Filter Bubbles"},"content":{"rendered":"<div id=\"\" class=\"element core-paragraph\">\n<p><strong>Srba, I., Moro, R.,<\/strong> <strong>Tomlein, M., Pecher, B., Simko, J., Stefancova, E., Kompan, M., Hrckova, A., Podrouzek, J., Gavornik, A., Bielikova, M.<\/strong><\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>In this paper, we present results of an auditing study performed over YouTube aimed at investigating how fast a user can get into a misinformation filter bubble, but also what it takes to &#8222;burst the bubble&#8220;, i.e., revert the bubble enclosure. We employ a sock puppet audit methodology, in which pre-programmed agents (acting as YouTube users) delve into misinformation filter bubbles by watching misinformation promoting content. Then they try to burst the bubbles and reach more balanced recommendations by watching misinformation debunking content. We record search results, home page results, and recommendations for the watched videos. Overall, we recorded 17,405 unique videos, out of which we manually annotated 2,914 for the presence of misinformation. The labeled data was used to train a machine learning model classifying videos into three classes (promoting, debunking, neutral) with the accuracy of 0.82. We use the trained model to classify the remaining videos that would not be feasible to annotate manually.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>Using both the manually and automatically annotated data, we observe the misinformation bubble dynamics for a range of audited topics. Our key finding is that even though filter bubbles do not appear in some situations, when they do, it is possible to burst them by watching misinformation debunking content (albeit it manifests differently from topic to topic). We also observe a sudden decrease of misinformation filter bubble effect when misinformation debunking videos are watched after misinformation promoting videos, suggesting a strong contextuality of recommendations. Finally, when comparing our results with a previous similar study, we do not observe significant improvements in the overall quantity of recommended misinformation content.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>Cite:  Srba, I., Moro, R., Tomlein, M., Pecher, B., Simko, J.,  Stefancova, E., Kompan, M., Hrckova, A., Podrouzek, J., Gavornik, A., Bielikova, M. Auditing YouTube&#8217;s Recommendation Algorithm for Misinformation Filter Bubbles. <em>ACM Transactions on Recommender Systems<\/em>. 1, 1, Article 6 (March 2023), 33 pages.. DOI: <a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3568392?cid=81474695895\" target=\"_blank\" rel=\"noreferrer noopener\">10.1145\/3568392<\/a><\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>Related blog: <a href=\"https:\/\/kinit.sk\/sk\/algoritmy-velkych-platforiem-potrebuju-nezavisly-dohlad\/\">Large platform algorithms need independent oversight<\/a><\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-separator\">\n<hr class=\"wp-block-separator has-css-opacity\"\/>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p class=\"has-text-align-center\"><\/p>\n<\/div>","protected":false},"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[78,80,142,236],"class_list":["post-28619","publication","type-publication","status-publish","hentry","category-web-user-data-processing-sk","category-ethics-and-human-values-in-technology-sk","category-2023-sk","category-bielikovam-sk"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Auditing YouTube&#039;s Recommendation Algorithm for Misinformation Filter Bubbles - KInIT<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/\" \/>\n<meta property=\"og:locale\" content=\"sk_SK\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Auditing YouTube&#039;s Recommendation Algorithm for Misinformation Filter Bubbles - KInIT\" \/>\n<meta property=\"og:description\" content=\"Srba, I., Moro, R., Tomlein, M., Pecher, B., Simko, J., Stefancova, E., Kompan, M., Hrckova, A., Podrouzek, J., Gavornik, A., Bielikova, M. In this paper, we present results of an...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/\" \/>\n<meta property=\"og:site_name\" content=\"KInIT\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-23T12:55:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/03\/KINIT_Sharepic.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@kinit\" \/>\n<meta name=\"twitter:label1\" content=\"Predpokladan\u00fd \u010das \u010d\u00edtania\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 min\u00faty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\\\/\",\"url\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\\\/\",\"name\":\"Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles - KInIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\"},\"datePublished\":\"2022-10-24T07:13:52+00:00\",\"dateModified\":\"2026-04-23T12:55:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\\\/#breadcrumb\"},\"inLanguage\":\"sk-SK\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Web and User Data Processing\",\"item\":\"https:\\\/\\\/kinit.sk\\\/category\\\/web-user-data-processing\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Auditing YouTube&#8217;s Recommendation Algorithm for Misinformation Filter Bubbles\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\",\"url\":\"https:\\\/\\\/kinit.sk\\\/\",\"name\":\"KInIT\",\"description\":\"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/kinit.sk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"sk-SK\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles - KInIT","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/","og_locale":"sk_SK","og_type":"article","og_title":"Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles - KInIT","og_description":"Srba, I., Moro, R., Tomlein, M., Pecher, B., Simko, J., Stefancova, E., Kompan, M., Hrckova, A., Podrouzek, J., Gavornik, A., Bielikova, M. In this paper, we present results of an...","og_url":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/","og_site_name":"KInIT","article_modified_time":"2026-04-23T12:55:38+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/03\/KINIT_Sharepic.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@kinit","twitter_misc":{"Predpokladan\u00fd \u010das \u010d\u00edtania":"2 min\u00faty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/","url":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/","name":"Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles - KInIT","isPartOf":{"@id":"https:\/\/kinit.sk\/#website"},"datePublished":"2022-10-24T07:13:52+00:00","dateModified":"2026-04-23T12:55:38+00:00","breadcrumb":{"@id":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/#breadcrumb"},"inLanguage":"sk-SK","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/kinit.sk\/sk\/publikacia\/auditing-youtubes-recommendation-algorithm-for-misinformation-filter-bubbles\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kinit.sk\/sk\/"},{"@type":"ListItem","position":2,"name":"Web and User Data Processing","item":"https:\/\/kinit.sk\/category\/web-user-data-processing\/"},{"@type":"ListItem","position":3,"name":"Auditing YouTube&#8217;s Recommendation Algorithm for Misinformation Filter Bubbles"}]},{"@type":"WebSite","@id":"https:\/\/kinit.sk\/#website","url":"https:\/\/kinit.sk\/","name":"KInIT","description":"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kinit.sk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"sk-SK"}]}},"_links":{"self":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/28619","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/types\/publication"}],"version-history":[{"count":1,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/28619\/revisions"}],"predecessor-version":[{"id":30108,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/28619\/revisions\/30108"}],"wp:attachment":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media?parent=28619"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/categories?post=28619"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}