{"id":30662,"date":"2024-01-11T12:50:19","date_gmt":"2024-01-11T11:50:19","guid":{"rendered":"https:\/\/kinit.sk\/phd-themes-2024-measuring-output-quality-of-large-language-models\/"},"modified":"2024-01-15T14:17:16","modified_gmt":"2024-01-15T13:17:16","slug":"phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov","status":"publish","type":"post","link":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/","title":{"rendered":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov"},"content":{"rendered":"<div id=\"\" class=\"element core-paragraph\">\n<p><strong>\u0160kolite\u013e:<\/strong> <a href=\"http:\/\/kinit.sk\/member\/jakub-simko\/\">Jakub \u0160imko <\/a>(UPGM \u00dastav po\u010d\u00edta\u010dov\u00e9 grafiky a multim\u00e9di\u00ed)<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne? ako dobre sa daj\u00fa generovan\u00e9 pr\u00edklady pou\u017ei\u0165 na tr\u00e9novanie mal\u00e9ho modelu na konkr\u00e9tnu \u00falohu?). In\u00e9 techniky s\u00fa v\u0161eobecnej\u0161ie (napr. ak\u00e1 je rozmanitos\u0165 parafr\u00e1z generovan\u00fdch LLM? ako jednoduch\u00e9 je detegova\u0165, \u017ee je obsah generovan\u00fd?).<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>Prostredn\u00edctvom replika\u010dn\u00fdch \u0161t\u00fadi\u00ed, porovn\u00e1vac\u00edch experimentov, n\u00e1vrhov metr\u00edk, kon\u0161trukcie vstupov a in\u00fdch pr\u00edstupov, doktorand\/ka posunie poznanie v met\u00f3dach a experiment\u00e1lnych metodol\u00f3gi\u00e1ch vyhodnocovania v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov. Za pozornos\u0165 pritom stoja dva v\u0161eobecn\u00e9 scen\u00e1re:<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-list\">\n<ol class=\"wp-block-list\"><div id=\"\" class=\"element core-list-item\">\n<li>Generovanie a\/alebo augment\u00e1cia datasetov, kedy sa LLM podnecuj\u00fa relat\u00edvne mal\u00fdmi vzorkami pr\u00edkladov, aby vytvorili ove\u013ea rozsiahlej\u0161ie s\u00fabory. Tento pr\u00edstup je u\u017eito\u010dn\u00fd najm\u00e4 v dom\u00e9nach a \u00faloh\u00e1ch s mal\u00fdm mno\u017estvom dostupn\u00fdch origin\u00e1lnych (ozna\u010dkovan\u00fdch) tr\u00e9novac\u00edch d\u00e1t (napr. dom\u00e9na detekcie dezinform\u00e1ci\u00ed).<\/li>\n<\/div>\n\n<div id=\"\" class=\"element core-list-item\">\n<li>Detekcia generovan\u00e9ho obsahu, kde sa vyu\u017e\u00edvaj\u00fa stylometrick\u00e9, \u0161tatistick\u00e9, hlboko-u\u010den\u00e9 \u010di hybridn\u00e9 met\u00f3dy na ur\u010dovanie, \u010di bol pr\u00edklad obsahu generovan\u00fd alebo modifikovan\u00fd strojovo. Schopnos\u0165 detekcie generovan\u00e9ho obsahu je k\u013e\u00fa\u010dov\u00e1 pre mnoho scen\u00e1rov z re\u00e1lneho sveta (napr. detekcia dezinform\u00e1ci\u00ed alebo podvodov), ale prispieva aj do v\u00fdskumn\u00fdch postupov (napr. pri zis\u0165ovan\u00ed pr\u00edtomnosti generovan\u00e9ho obsahu v publikovan\u00fdch datasetoch \u010di vo vzork\u00e1ch poch\u00e1dzaj\u00facich z crowdsourcingu).<\/li>\n<\/div><\/ol>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>Doktorand\/ka si vyberie jeden z uveden\u00fdch scen\u00e1rov (no nebude n\u00edm obmedzen\u00fd\/\u00e1) a \u010falej ho rozpracuje a primerane z\u00fa\u017ei na \u0161pecifick\u00e9 v\u00fdskumn\u00e9 ot\u00e1zky, ktor\u00e9 experiment\u00e1lne over\u00ed.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>S\u00favisiace publik\u00e1cie:<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-list\">\n<ul class=\"wp-block-list\"><div id=\"\" class=\"element core-list-item\">\n<li>Cegin, J., Simko, J. and Brusilovsky, P., 2023. ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing <a href=\"https:\/\/arxiv.org\/pdf\/2305.12947.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/arxiv.org\/pdf\/2305.12947.pdf<\/a>&nbsp;<\/li>\n<\/div>\n\n<div id=\"\" class=\"element core-list-item\">\n<li>Macko, D., Moro, R., Uchendu, A., Lucas, J.S., Yamashita, M., Pikuliak, M., Srba, I., Le, T., Lee, D., Simko, J. and Bielikova, M., 2023. MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing <a href=\"https:\/\/arxiv.org\/pdf\/2310.13606.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/arxiv.org\/pdf\/2310.13606.pdf<\/a>&nbsp;<\/li>\n<\/div><\/ul>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p>V\u00fdskum bude doktorand vykon\u00e1va\u0165 v r\u00e1mci Kempelenovho in\u0161tit\u00fatu inteligentn\u00fdch technol\u00f3gi\u00ed (KInIT, <a href=\"https:\/\/kinit.sk\/\">https:\/\/kinit.sk<\/a>) v Bratislave v spolupr\u00e1ci s priemyseln\u00fdmi partnermi alebo v\u00fdskumn\u00edkmi zo svetovo uzn\u00e1van\u00fdch v\u00fdskumn\u00fdch skup\u00edn. Predpoklad\u00e1 sa kombinovan\u00e1 (extern\u00e1) forma \u0161t\u00fadia a pracovn\u00fd pomer na pln\u00fd \u00fav\u00e4zok v KInIT.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-buttons\">\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-16018d1d wp-block-buttons-is-layout-flex\"><div id=\"\" class=\"element core-button\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/kinit.sk\/sk\/education-training\/doctoral-studies\/phd-kinit-expression-of-interest-form\/\"><em>Apply now<\/em><\/a><\/div>\n<\/div>\n\n<div id=\"\" class=\"element core-button\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/kinit.sk\/sk\/education-training\/doctoral-studies\/\"><em>Learn more about PhD at KInIT<\/em><\/a><\/div>\n<\/div><\/div>\n<\/div>\n\n<div id=\"supervising-team\" class=\"element acf-mentors-popup\">\n<section id=\"supervising-team\" class=\"block-mentors mentors-popup \" >\n\t<div class=\"wrapper-out\">\n\t\t<div class=\"wrapper-in\">\n\t\t\t<div class=\"in cf\">\n\t\t\t\t<div class=\"element-inner\">\n\t\t\t\t\t<div class=\"headline\"><h2>T\u00edm \u0161kolite\u013eov<\/h2><\/div>                    <div class=\"mentors-wrap\">\n                        \t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n                                <div class=\"mentor\">\n\t\t\t\t\t\t\t\t\t<a href=\"#\">\n\t\t\t\t\t\t\t\t\t\t \n                                                    <div class=\"picture\">\n                                                        <img decoding=\"async\" data-src=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/10\/simko-jakub-web_51330185419_o-255x341.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 255px; --smush-placeholder-aspect-ratio: 255\/341;\">\n                                                                                                            <\/div>\n                                                \t\t\t\t\t\t\t\t\t\t<span class=\"title\">Jakub \u0160imko<\/span>\t\t\t\t\t\t\t\t\t\t<span class=\"position\">Lead researcher, KInIT<\/span>\t\t\t\t\t\t\t\t\t\t<span class=\"more\">Viac info<\/span>\n\t\t\t\t\t\t\t\t\t<\/a>\n                                    <div class=\"mentor-popup\">\n                                        <div class=\"flex\">\n                                            <div class=\"inner\">\n                                                <a href=\"#\" class=\"close\">Close<\/a>\n                                                 \n                                                    <div class=\"picture\">\n                                                        <img decoding=\"async\" data-src=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/10\/simko-jakub-web_51330185419_o-255x341.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 255px; --smush-placeholder-aspect-ratio: 255\/341;\">\n                                                                                                            <\/div>\n                                                                                                <span class=\"title\">Jakub \u0160imko<\/span>                                                <span class=\"position\">Lead researcher, KInIT<\/span>                                                <div id=\"\" class=\"element core-paragraph\">\n<p>Jakub \u0160imko is an expert researcher at KInIT, where he also leads the Web and User Data Processing team. Jakub focuses on the intersection of human computation, machine learning and user modeling. He has recently been working on social media algorithm auditing, misinformation modeling and promotes interdisciplinary approaches to computer science research. He graduated from Slovak University of Technology in Bratislava, where, after receiving his PhD, he worked for 7 years as a researcher and teacher. He co-authored more than 30 internationally recognized publications, together receiving more than 350 citations.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-buttons\">\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\"><div id=\"\" class=\"element core-button\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"https:\/\/kinit.sk\/member\/jakub-simko\/\">Profile<\/a><\/div>\n<\/div><\/div>\n<\/div>                                            <\/div>                                         \n                                        <\/div>                                      \n                                    <\/div>\n                                    \n                                <\/div>\t\t\n                                <div class=\"overlay-mentor\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n                                <div class=\"mentor\">\n\t\t\t\t\t\t\t\t\t<a href=\"#\">\n\t\t\t\t\t\t\t\t\t\t \n                                                    <div class=\"picture\">\n                                                        <img decoding=\"async\" data-src=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/10\/macko-web_51330462885_o-255x341.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 255px; --smush-placeholder-aspect-ratio: 255\/341;\">\n                                                                                                            <\/div>\n                                                \t\t\t\t\t\t\t\t\t\t<span class=\"title\">Dominik Macko<\/span>\t\t\t\t\t\t\t\t\t\t<span class=\"position\">Senior researcher, KInIT<\/span>\t\t\t\t\t\t\t\t\t\t<span class=\"more\">Viac info<\/span>\n\t\t\t\t\t\t\t\t\t<\/a>\n                                    <div class=\"mentor-popup\">\n                                        <div class=\"flex\">\n                                            <div class=\"inner\">\n                                                <a href=\"#\" class=\"close\">Close<\/a>\n                                                 \n                                                    <div class=\"picture\">\n                                                        <img decoding=\"async\" data-src=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/10\/macko-web_51330462885_o-255x341.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 255px; --smush-placeholder-aspect-ratio: 255\/341;\">\n                                                                                                            <\/div>\n                                                                                                <span class=\"title\">Dominik Macko<\/span>                                                <span class=\"position\">Senior researcher, KInIT<\/span>                                                <div id=\"\" class=\"element core-paragraph\">\n<p>Dominik focuses on energy efficiency and security in the Internet of Things environment, from a communication point of view as well as from a device point of view. He focuses on reduction of unnecessary control overhead to create a secure channel and transmit data by strictly power-managed sensor nodes. Also, he deals with anomaly and intrusion detection in IP networks based on communication statistics. Recently, he focuses on robust detection of multilingual machine-generated text.<\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-buttons\">\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\"><div id=\"\" class=\"element core-button\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/kinit.sk\/member\/dominik-macko\/\">Profile<\/a><\/div>\n<\/div><\/div>\n<\/div>                                            <\/div>                                         \n                                        <\/div>                                      \n                                    <\/div>\n                                    \n                                <\/div>\t\t\n                                <div class=\"overlay-mentor\"><\/div>\n\t\t\t\t\t\t                    <\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section> \n<\/div>","protected":false},"excerpt":{"rendered":"<p>\u0160kolite\u013e: Jakub \u0160imko (UPGM \u00dastav po\u010d\u00edta\u010dov\u00e9 grafiky a multim\u00e9di\u00ed) S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre&#8230;<\/p>\n","protected":false},"author":26,"featured_media":30625,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[67],"tags":[116,374],"class_list":["post-30662","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized-sk","tag-phd-sk","tag-phd-at-kinit-sk"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT<\/title>\n<meta name=\"description\" content=\"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/\" \/>\n<meta property=\"og:locale\" content=\"sk_SK\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT\" \/>\n<meta property=\"og:description\" content=\"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/\" \/>\n<meta property=\"og:site_name\" content=\"KInIT\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-11T11:50:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-15T13:17:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1093\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Marianna Palkova\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@kinit\" \/>\n<meta name=\"twitter:site\" content=\"@kinit\" \/>\n<meta name=\"twitter:label1\" content=\"Autor\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marianna Palkova\" \/>\n\t<meta name=\"twitter:label2\" content=\"Predpokladan\u00fd \u010das \u010d\u00edtania\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 min\u00faty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/\"},\"author\":{\"name\":\"Marianna Palkova\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#\\\/schema\\\/person\\\/8b175aaaf3267b5bbbbb97e4a6db8cea\"},\"headline\":\"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov\",\"datePublished\":\"2024-01-11T11:50:19+00:00\",\"dateModified\":\"2024-01-15T13:17:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/\"},\"wordCount\":527,\"image\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/1_Header1_Research_Teams-Edit2-scaled.jpg\",\"keywords\":[\"PhD\",\"PhD at KInIT\"],\"articleSection\":[\"Uncategorized @sk\"],\"inLanguage\":\"sk-SK\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/\",\"url\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/\",\"name\":\"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/1_Header1_Research_Teams-Edit2-scaled.jpg\",\"datePublished\":\"2024-01-11T11:50:19+00:00\",\"dateModified\":\"2024-01-15T13:17:16+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#\\\/schema\\\/person\\\/8b175aaaf3267b5bbbbb97e4a6db8cea\"},\"description\":\"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#breadcrumb\"},\"inLanguage\":\"sk-SK\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"sk-SK\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#primaryimage\",\"url\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/1_Header1_Research_Teams-Edit2-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/kinit.sk\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/1_Header1_Research_Teams-Edit2-scaled.jpg\",\"width\":2560,\"height\":1093},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Uncategorized @sk\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/category\\\/uncategorized-sk\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\",\"url\":\"https:\\\/\\\/kinit.sk\\\/\",\"name\":\"KInIT\",\"description\":\"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/kinit.sk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"sk-SK\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#\\\/schema\\\/person\\\/8b175aaaf3267b5bbbbb97e4a6db8cea\",\"name\":\"Marianna Palkova\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT","description":"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/","og_locale":"sk_SK","og_type":"article","og_title":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT","og_description":"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?","og_url":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/","og_site_name":"KInIT","article_published_time":"2024-01-11T11:50:19+00:00","article_modified_time":"2024-01-15T13:17:16+00:00","og_image":[{"width":2560,"height":1093,"url":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg","type":"image\/jpeg"}],"author":"Marianna Palkova","twitter_card":"summary_large_image","twitter_creator":"@kinit","twitter_site":"@kinit","twitter_misc":{"Autor":"Marianna Palkova","Predpokladan\u00fd \u010das \u010d\u00edtania":"2 min\u00faty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#article","isPartOf":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/"},"author":{"name":"Marianna Palkova","@id":"https:\/\/kinit.sk\/#\/schema\/person\/8b175aaaf3267b5bbbbb97e4a6db8cea"},"headline":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov","datePublished":"2024-01-11T11:50:19+00:00","dateModified":"2024-01-15T13:17:16+00:00","mainEntityOfPage":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/"},"wordCount":527,"image":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#primaryimage"},"thumbnailUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg","keywords":["PhD","PhD at KInIT"],"articleSection":["Uncategorized @sk"],"inLanguage":"sk-SK"},{"@type":"WebPage","@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/","url":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/","name":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov - KInIT","isPartOf":{"@id":"https:\/\/kinit.sk\/#website"},"primaryImageOfPage":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#primaryimage"},"image":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#primaryimage"},"thumbnailUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg","datePublished":"2024-01-11T11:50:19+00:00","dateModified":"2024-01-15T13:17:16+00:00","author":{"@id":"https:\/\/kinit.sk\/#\/schema\/person\/8b175aaaf3267b5bbbbb97e4a6db8cea"},"description":"S n\u00e1stupom ve\u013ek\u00fdch jazykov\u00fdch modelov (LLM) vyvst\u00e1vaj\u00fa v\u00fdskumn\u00e9 ot\u00e1zky ako mera\u0165 kvalitu a vlastnosti ich v\u00fdstupov. Tieto merania s\u00fa d\u00f4le\u017eit\u00e9 pre porovn\u00e1vanie a vylep\u0161ovanie modelov \u010di ladenie ich vstupov (prompts). Niektor\u00e9 techniky vyhodnocovania sa vz\u0165ahuj\u00fa k \u0161pecifick\u00fdm dom\u00e9nam a scen\u00e1rom pou\u017eitia (napr. ako presne model odpoved\u00e1 na faktick\u00e9 ot\u00e1zky v konkr\u00e9tnej dom\u00e9ne?","breadcrumb":{"@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#breadcrumb"},"inLanguage":"sk-SK","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/"]}]},{"@type":"ImageObject","inLanguage":"sk-SK","@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#primaryimage","url":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg","contentUrl":"https:\/\/kinit.sk\/wp-content\/uploads\/2024\/01\/1_Header1_Research_Teams-Edit2-scaled.jpg","width":2560,"height":1093},{"@type":"BreadcrumbList","@id":"https:\/\/kinit.sk\/sk\/phd-temy-2024-meranie-kvality-vystupov-velkych-jazykovych-modelov\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kinit.sk\/sk\/"},{"@type":"ListItem","position":2,"name":"Uncategorized @sk","item":"https:\/\/kinit.sk\/sk\/category\/uncategorized-sk\/"},{"@type":"ListItem","position":3,"name":"PhD T\u00e9my 2024: Meranie kvality v\u00fdstupov ve\u013ek\u00fdch jazykov\u00fdch modelov"}]},{"@type":"WebSite","@id":"https:\/\/kinit.sk\/#website","url":"https:\/\/kinit.sk\/","name":"KInIT","description":"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kinit.sk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"sk-SK"},{"@type":"Person","@id":"https:\/\/kinit.sk\/#\/schema\/person\/8b175aaaf3267b5bbbbb97e4a6db8cea","name":"Marianna Palkova"}]}},"_links":{"self":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/posts\/30662","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/users\/26"}],"replies":[{"embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/comments?post=30662"}],"version-history":[{"count":4,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/posts\/30662\/revisions"}],"predecessor-version":[{"id":30858,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/posts\/30662\/revisions\/30858"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media\/30625"}],"wp:attachment":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media?parent=30662"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/categories?post=30662"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/tags?post=30662"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}