RAFT: Adapting Language Model to Domain Specific RAG

Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or private domain knowledge) into the pretrained model either through RAG-based-prompting, or fine-tuning. However, the optimal methodology for the model to gain su

[stealthinu]

RAGとfine-tuningを組み合わせて通常のRAGよりも性能が出る手法。

[secondlife]

RAG結果も考慮したドメイン固有学習。間違った入力がある前提で学習させる。

[arrowKato]

RAGありきで、さらにfine tuningも取り入れるときの、学習させ方