Peft库使用技巧（二）：删除、合并微调参数【从全参数微调后的模型参数中剔除基座模型参数（冻结），然后发布自己训练的这部分参数模块】

我会带着你远行 2023-10-13 09:08 55阅读 0赞

从全参数微调后的模型参数中剔除基座模型参数（冻结），然后发布自己训练的这部分参数模块

#    Copyright 2023 Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li
    #
    #    Licensed under the Apache License, Version 2.0 (the "License");
    #    you may not use this file except in compliance with the License.
    #    You may obtain a copy of the License at
    #
    #        http://www.apache.org/licenses/LICENSE-2.0
    #
    #    Unless required by applicable law or agreed to in writing, software
    #    distributed under the License is distributed on an "AS IS" BASIS,
    #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    #    See the License for the specific language governing permissions and
    #    limitations under the License.
     
    from typing import Optional
    from peft import PeftModel
    import fire
    import torch
    import tqdm
    import transformers
    # from train import smart_tokenizer_and_embedding_resize
     
    @torch.inference_mode()
    def make_diff(