{"id":41339,"date":"2026-04-02T10:53:45","date_gmt":"2026-04-02T08:53:45","guid":{"rendered":"https:\/\/kinit.sk\/?post_type=publication&#038;p=41339"},"modified":"2026-05-14T14:53:43","modified_gmt":"2026-05-14T12:53:43","slug":"peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models","status":"publish","type":"publication","link":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/","title":{"rendered":"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models"},"content":{"rendered":"<div id=\"\" class=\"element core-paragraph\">\n<p>Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). Currently, many newly introduced PEFT methods are challenging to replicate, deploy, or compare with one another. To address this, we introduce PEFT-Factory, a unified framework for efficient fine-tuning LLMs using both off-the-shelf and custom PEFT methods. While its modular design supports extensibility, it natively provides a representative set of 19 PEFT methods, 27 classification and text generation datasets addressing 12 tasks, and both standard and PEFT-specific evaluation metrics. As a result, PEFT-Factory provides a ready-to-use, controlled, and stable environment, improving replicability and benchmarking of PEFT methods. PEFT-Factory is a downstream framework that originates from the popular LLaMA-Factory, and is publicly available at https:\/\/github.com\/kinit-sk\/PEFT-Factory.<br><\/p>\n<\/div>\n\n<div id=\"\" class=\"element core-paragraph\">\n<p><strong>Cite<\/strong>: <em>Robert Belanec, Ivan Srba, and Maria Bielikova. 2026.\u00a0<a href=\"https:\/\/aclanthology.org\/2026.eacl-demo.15\/\">PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models<\/a>. In\u00a0<em>Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)<\/em>, pages 188\u2013202, Rabat, Marocco. Association for Computational Linguistics.<\/em><\/p>\n<\/div>","protected":false},"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[78,236,542],"class_list":["post-41339","publication","type-publication","status-publish","hentry","category-web-user-data-processing-sk","category-bielikovam-sk","category-2026-sk"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/\" \/>\n<meta property=\"og:locale\" content=\"sk_SK\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT\" \/>\n<meta property=\"og:description\" content=\"Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). Currently, many newly introduced PEFT methods are challenging to replicate, deploy, or compare with one another. To...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/\" \/>\n<meta property=\"og:site_name\" content=\"KInIT\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-14T12:53:43+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/03\/KINIT_Sharepic.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@kinit\" \/>\n<meta name=\"twitter:label1\" content=\"Predpokladan\u00fd \u010das \u010d\u00edtania\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 min\u00fata\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\\\/\",\"url\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\\\/\",\"name\":\"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\"},\"datePublished\":\"2026-04-02T08:53:45+00:00\",\"dateModified\":\"2026-05-14T12:53:43+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\\\/#breadcrumb\"},\"inLanguage\":\"sk-SK\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/publikacia\\\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Web &amp; User Data Processing\",\"item\":\"https:\\\/\\\/kinit.sk\\\/sk\\\/category\\\/web-user-data-processing-sk\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/kinit.sk\\\/#website\",\"url\":\"https:\\\/\\\/kinit.sk\\\/\",\"name\":\"KInIT\",\"description\":\"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/kinit.sk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"sk-SK\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/","og_locale":"sk_SK","og_type":"article","og_title":"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT","og_description":"Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). Currently, many newly introduced PEFT methods are challenging to replicate, deploy, or compare with one another. To...","og_url":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/","og_site_name":"KInIT","article_modified_time":"2026-05-14T12:53:43+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/kinit.sk\/wp-content\/uploads\/2021\/03\/KINIT_Sharepic.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@kinit","twitter_misc":{"Predpokladan\u00fd \u010das \u010d\u00edtania":"1 min\u00fata"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/","url":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/","name":"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models - KInIT","isPartOf":{"@id":"https:\/\/kinit.sk\/#website"},"datePublished":"2026-04-02T08:53:45+00:00","dateModified":"2026-05-14T12:53:43+00:00","breadcrumb":{"@id":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/#breadcrumb"},"inLanguage":"sk-SK","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/kinit.sk\/sk\/publikacia\/peft-factory-unified-parameter-efficient-fine-tuning-of-autoregressive-large-language-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kinit.sk\/sk\/"},{"@type":"ListItem","position":2,"name":"Web &amp; User Data Processing","item":"https:\/\/kinit.sk\/sk\/category\/web-user-data-processing-sk\/"},{"@type":"ListItem","position":3,"name":"PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models"}]},{"@type":"WebSite","@id":"https:\/\/kinit.sk\/#website","url":"https:\/\/kinit.sk\/","name":"KInIT","description":"Vyu\u017e\u00edvame v\u00fdskum pre \u013eud\u00ed a priemysel","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kinit.sk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"sk-SK"}]}},"_links":{"self":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/41339","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/types\/publication"}],"version-history":[{"count":1,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/41339\/revisions"}],"predecessor-version":[{"id":42453,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/publication\/41339\/revisions\/42453"}],"wp:attachment":[{"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/media?parent=41339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kinit.sk\/sk\/wp-json\/wp\/v2\/categories?post=41339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}