Prefix Tuning Using Residual Reparameterization

Fine-tuning large language models for specific tasks requires updating and storing all parameters, leading to significant computational and storage cost issues. To address these challenges, parameter-efficient learning such as prefix tuning has gained attention. However, prefix tuning can suffer fro...

Full description

Saved in:
Bibliographic Details
Main Authors: Youngjun Jung, Hyunsun Hwang, Changki Lee
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10938609/
Tags: Add Tag
No Tags, Be the first to tag this record!