Skip to content

Cannot load pre-trained weights NLS_loc_modeltes - persistent id error #2

Description

@xmeng1544-eng

Describe the bug

无法加载预训练权重文件 NLS_loc_modeltes。尝试了多种方法均失败,包括:

  • torch.load() 报错:A load persistent id instruction was encountered
  • torch.load(weights_only=False) 报错:'Tensor' object has no attribute '_untyped_storage'
  • pytorch_lightning.utilities.cloud_io.load() 报错:模块路径不存在

To Reproduce

  1. 按照官网指引下载 NLS_loc_modeltes 并放置在 ./Recommendation_system/ 目录
  2. 运行以下代码:
import torch
checkpoint = torch.load("./Recommendation_system/NLS_loc_modeltes/data.pkl", map_location="cpu")
报错信息如下_pickle.UnpicklingError: A load persistent id instruction was encountered,
but no persistent_load function was specified.
3尝试 weights_only=Falsecheckpoint = torch.load("./Recommendation_system/NLS_loc_modeltes/data.pkl", map_location="cpu", weights_only=False)
报错信息如下AttributeError: 'Tensor' object has no attribute '_untyped_storage'
4尝试 PyTorch Lightning 加载from pytorch_lightning.utilities.cloud_io import load
checkpoint = load("./Recommendation_system/NLS_loc_modeltes", map_location="cpu")
报错如下ModuleNotFoundError: No module named 'pytorch_lightning.utilities.cloud_io'

5Expected behavior
期望能够成功加载预训练权重并正常使用 A2KA 模型进行 NLS 预测6Environment
OS: CentOS Linux (64-bit)
Python: 3.8 / 3.10
PyTorch versions tested: 1.9.0, 1.12.0, 2.0.0, 2.12.0 (CPU only)
PyTorch Lightning versions tested: 1.5.0, 1.6.0, 2.0.0
Hardware: CPU only (no GPU)

7Additional context
权重文件已正确下载并解压目录结构如下Recommendation_system/NLS_loc_modeltes/
├── data/          (7303个分片文件)
├── data.pkl
└── version
version 文件内容为 3Lightning 分片检查点版本3已尝试过 PyTorch 1.9.0 + Lightning 1.5.0 组合仍然报错 _untyped_storage
服务器无法联网所有包均为离线安装

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions