{"id":22412,"date":"2022-10-19T11:52:00","date_gmt":"2022-10-19T09:52:00","guid":{"rendered":"https:\/\/kinit.sk\/project\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/"},"modified":"2022-10-19T11:53:54","modified_gmt":"2022-10-19T09:53:54","slug":"diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs","status":"publish","type":"project","link":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/","title":{"rendered":"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs"},"content":{"rendered":"
\n
One of the minor Natural Language Processing (NLP)<\/a> tasks is the restoration of diacritics. This topic is not widely discussed as it is not an issue for major languages, such as English. However, we are significantly affected by this problem in Slovakia.<\/h5>\n<\/div>\n\n
\n

In the Slovak language, one word with different diacritics can have completely different meanings (e.g. z\u00e1stavka = a small flag, zast\u00e1vka = a pause or a bus stop). The need for grammatically correct and professionally looking documents is strong but people often do not have enough time to type all the words with complicated diacritics properly. <\/p>\n<\/div>\n\n

\n

At KInIT, we are exploring how to continuously improve NLP<\/a>, while focusing on different tasks such as sentiment analysis, determining semantic similarity of texts or language modelling. We wanted to make using Slovak diacritics faster and more efficient, so we created a practical tool<\/a> that is useful for anyone who creates Google Docs in Slovak language<\/strong>.\u00a0<\/p>\n<\/div>\n\n

\n

The task of automatic diacritic restoration is basically a task of predicting the next character based on the previous (sometimes the following) words or characters (context). We have built a diacritics restoration tool based on a bidirectional two-layer recurrent neural network model, which we had trained on a large number of Slovak texts [1]. Our model learned to add and remove diacritics by „reading“ them. <\/p>\n<\/div>\n\n

\n

Automated diacritics recovery can also be used as a part of text pre-processing and analysis<\/strong>. The presence of diacritics in text can significantly affect the meaning of the text, so restoring diacritics could facilitate better understanding in other language processing tasks.<\/p>\n<\/div>\n\n

\n

Diacritics Restorer<\/a> is a Google Docs add-on for fast and automated addition and removal of diacritics in Slovak online documents. You will find all the necessary information about this handy assistant here: diakritikovac.kinit.sk<\/a> (website in Slovak only).<\/p>\n<\/div>\n\n

\n

The Diacritics Restorer<\/a> tool is completely free and available to everyone. Installation is fast and we also paid special attention to privacy and ethical considerations. On top of that, our method of diacritics addition uses a compact model that is environmentally friendlier than other available solutions based on large neural language models (their energy consumption is higher due to the higher computational and memory complexity).<\/p>\n<\/div>\n\n

\n

<\/p>\n<\/div>\n\n

\n

[1] N\u00e1plava, Jakub; Straka, Milan; Haji\u010d, Jan and Stra\u0148\u00e1k, Pavel, 2018, Corpus for training and evaluating diacritics restoration systems, LINDAT\/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (\u00daFAL), Faculty of Mathematics and Physics, Charles University, http:\/\/hdl.handle.net\/11234\/1-2607.<\/p>\n<\/div>\n\n

\n
\n\t
\n\t\t
\n\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Project team<\/h2><\/div>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Martin Kon\u00f4pka<\/h5>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Researcher 10\/2020-12\/2021<\/div>\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Mari\u00e1n \u0160imko<\/h5>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Lead and Researcher<\/div>\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Miroslav Bl\u0161t\u00e1k<\/h5>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
AI Specialist<\/div>\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section> \n<\/div>\n\n
\n\t
\n\t\t
\n\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

News<\/h2><\/div>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t

Automatick\u00fd diakritikova\u010d pre online dokumenty<\/h3>\n \t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tokt 19. 2022\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Nechcete sami vo vetre? Vyhnite sa trapasom bez diakritiky! Kv\u00f4li pand\u00e9mii sa v\u00fdrazne ur\u00fdchlil presun kancel\u00e1rskej pr\u00e1ce do virtu\u00e1lneho priestoru. Pre zlep\u0161enie efektivity sme zvyknut\u00ed pracova\u0165 kolaborat\u00edvne a online….<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t<\/a>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/article>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n<\/div>","protected":false},"featured_media":22371,"template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[76,349,414],"class_list":["post-22412","project","type-project","status-publish","has-post-thumbnail","hentry","category-natural-language-processing-sk","category-2022-sk","category-tools-and-models-sk"],"acf":[],"yoast_head":"\nDiacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/\" \/>\n<meta property=\"og:locale\" content=\"sk_SK\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT\" \/>\n<meta property=\"og:description\" content=\"One of the minor Natural Language Processing (NLP) tasks is the restoration of diacritics. This topic is not widely discussed as it is not an issue for major languages, such...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/\" \/>\n<meta property=\"og:site_name\" content=\"KInIT\" \/>\n<meta property=\"article:modified_time\" content=\"2022-10-19T09:53:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kinit.sk\/wp-content\/uploads\/2022\/10\/202209_web_news_diakritikovac_feature.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"788\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@kinit\" \/>\n<meta name=\"twitter:label1\" content=\"Predpokladan\u00fd \u010das \u010d\u00edtania\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 min\u00faty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/\",\"url\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/\",\"name\":\"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2022\\\/10\\\/202209_web_news_diakritikovac_feature.png\",\"datePublished\":\"2022-10-19T09:52:00+00:00\",\"dateModified\":\"2022-10-19T09:53:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/#breadcrumb\"},\"inLanguage\":\"sk-SK\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"sk-SK\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/#primaryimage\",\"url\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2022\\\/10\\\/202209_web_news_diakritikovac_feature.png\",\"contentUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2022\\\/10\\\/202209_web_news_diakritikovac_feature.png\",\"width\":1500,\"height\":788},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/projekt\\\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/uvod\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Natural Language Processing\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/category\\\/natural-language-processing-sk\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\",\"url\":\"https:\\\/\\\/kinit.sk\\\/\",\"name\":\"KInIT\",\"description\":\"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/kinit.sk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"sk-SK\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/","og_locale":"sk_SK","og_type":"article","og_title":"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT","og_description":"One of the minor Natural Language Processing (NLP) tasks is the restoration of diacritics. This topic is not widely discussed as it is not an issue for major languages, such...","og_url":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/","og_site_name":"KInIT","article_modified_time":"2022-10-19T09:53:54+00:00","og_image":[{"width":1500,"height":788,"url":"https:\/\/kinit.sk\/wp-content\/uploads\/2022\/10\/202209_web_news_diakritikovac_feature.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@kinit","twitter_misc":{"Predpokladan\u00fd \u010das \u010d\u00edtania":"2 min\u00faty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/","url":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/","name":"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs - KInIT","isPartOf":{"@id":"https:\/\/kinit.sk\/#website"},"primaryImageOfPage":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/#primaryimage"},"image":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/#primaryimage"},"thumbnailUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2022\/10\/202209_web_news_diakritikovac_feature.png","datePublished":"2022-10-19T09:52:00+00:00","dateModified":"2022-10-19T09:53:54+00:00","breadcrumb":{"@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/#breadcrumb"},"inLanguage":"sk-SK","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/"]}]},{"@type":"ImageObject","inLanguage":"sk-SK","@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/#primaryimage","url":"https:\/\/kinit.sk\/wp-content\/uploads\/2022\/10\/202209_web_news_diakritikovac_feature.png","contentUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2022\/10\/202209_web_news_diakritikovac_feature.png","width":1500,"height":788},{"@type":"BreadcrumbList","@id":"https:\/\/kinit.sk\/sk\/projekt\/diacritics-restorer-automatic-diacritics-restoration-for-slovak-google-docs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kinit.sk\/sk\/uvod\/"},{"@type":"ListItem","position":2,"name":"Natural Language Processing","item":"https:\/\/kinit.sk\/sk\/category\/natural-language-processing-sk\/"},{"@type":"ListItem","position":3,"name":"Diacritics Restorer: Automatic diacritics restoration for Slovak Google Docs"}]},{"@type":"WebSite","@id":"https:\/\/kinit.sk\/#website","url":"https:\/\/kinit.sk\/","name":"KInIT","description":"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kinit.sk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"sk-SK"}]}},"_links":{"self":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/22412","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project"}],"about":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/types\/project"}],"version-history":[{"count":2,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/22412\/revisions"}],"predecessor-version":[{"id":22416,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/project\/22412\/revisions\/22416"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media\/22371"}],"wp:attachment":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media?parent=22412"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/categories?post=22412"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}