FEASIBILITY OF USING LOW-PARAMETER LOCAL LLMS IN ANSWERING QUESTIONS FROM ENTERPRISE KNOWLEDGE BASE

FEASIBILITY OF USING LOW-PARAMETER LOCAL LLMS IN ANSWERING QUESTIONS FROM ENTERPRISE KNOWLEDGE BASE

This paper evaluates the feasibility of deploying locally-run Large Language Models (LLMs) for retrieval-augmented question answering (RAG-QA) over internal knowledge bases in small and medium enterprises (SMEs), with a focus on Polish-language datasets. The study benchmarks eight popular open-sourc...

Full description

Saved in:
Bibliographic Details
Main Authors: Marcin BADUROWICZ, Stanisław SKULIMOWSKI, Maciej LASKOWSKI
Format: Article
Language:English
Published: Polish Association for Knowledge Promotion 2024-12-01
Series:Applied Computer Science
Subjects:
large language models
benchmark
retrieval-augmented generation
desktop deployment
quantization
Online Access:https://ph.pollub.pl/index.php/acs/article/view/6812
Tags: Add Tag
No Tags, Be the first to tag this record!

Similar Items

Similar Items