Skip to content

mismatch to load pretrained model #12

@wizardlancet

Description

@wizardlancet

Monai 0.8.1

RuntimeError: Error(s) in loading state_dict for UNETR:
Missing key(s) in state_dict: "vit.patch_embedding.cls_token", "encoder2.blocks.0.1.conv3.conv.weight", "encoder2.blocks.1.1.conv3.conv.weight", "encoder3.blocks.0.1.conv3.conv.weight".

pth from dropbox, total 170 parameters:
dict_keys(['vit.patch_embedding.position_embeddings', 'vit.patch_embedding.patch_embeddings.1.weight', 'vit.patch_embedding.patch_embeddings.1.bias', 'vit.blocks.0.mlp.linear1.weight', 'vit.blocks.0.mlp.linear1.bias', 'vit.blocks.0.mlp.linear2.weight', 'vit.blocks.0.mlp.linear2.bias', 'vit.blocks.0.norm1.weight', 'vit.blocks.0.norm1.bias', 'vit.blocks.0.attn.out_proj.weight', 'vit.blocks.0.attn.out_proj.bias', 'vit.blocks.0.attn.qkv.weight', 'vit.blocks.0.norm2.weight', 'vit.blocks.0.norm2.bias', 'vit.blocks.1.mlp.linear1.weight', 'vit.blocks.1.mlp.linear1.bias', 'vit.blocks.1.mlp.linear2.weight', 'vit.blocks.1.mlp.linear2.bias', 'vit.blocks.1.norm1.weight', 'vit.blocks.1.norm1.bias', 'vit.blocks.1.attn.out_proj.weight', 'vit.blocks.1.attn.out_proj.bias', 'vit.blocks.1.attn.qkv.weight', 'vit.blocks.1.norm2.weight', 'vit.blocks.1.norm2.bias', 'vit.blocks.2.mlp.linear1.weight', 'vit.blocks.2.mlp.linear1.bias', 'vit.blocks.2.mlp.linear2.weight', 'vit.blocks.2.mlp.linear2.bias', 'vit.blocks.2.norm1.weight', 'vit.blocks.2.norm1.bias', 'vit.blocks.2.attn.out_proj.weight', 'vit.blocks.2.attn.out_proj.bias', 'vit.blocks.2.attn.qkv.weight', 'vit.blocks.2.norm2.weight', 'vit.blocks.2.norm2.bias', 'vit.blocks.3.mlp.linear1.weight', 'vit.blocks.3.mlp.linear1.bias', 'vit.blocks.3.mlp.linear2.weight', 'vit.blocks.3.mlp.linear2.bias', 'vit.blocks.3.norm1.weight', 'vit.blocks.3.norm1.bias', 'vit.blocks.3.attn.out_proj.weight', 'vit.blocks.3.attn.out_proj.bias', 'vit.blocks.3.attn.qkv.weight', 'vit.blocks.3.norm2.weight', 'vit.blocks.3.norm2.bias', 'vit.blocks.4.mlp.linear1.weight', 'vit.blocks.4.mlp.linear1.bias', 'vit.blocks.4.mlp.linear2.weight', 'vit.blocks.4.mlp.linear2.bias', 'vit.blocks.4.norm1.weight', 'vit.blocks.4.norm1.bias', 'vit.blocks.4.attn.out_proj.weight', 'vit.blocks.4.attn.out_proj.bias', 'vit.blocks.4.attn.qkv.weight', 'vit.blocks.4.norm2.weight', 'vit.blocks.4.norm2.bias', 'vit.blocks.5.mlp.linear1.weight', 'vit.blocks.5.mlp.linear1.bias', 'vit.blocks.5.mlp.linear2.weight', 'vit.blocks.5.mlp.linear2.bias', 'vit.blocks.5.norm1.weight', 'vit.blocks.5.norm1.bias', 'vit.blocks.5.attn.out_proj.weight', 'vit.blocks.5.attn.out_proj.bias', 'vit.blocks.5.attn.qkv.weight', 'vit.blocks.5.norm2.weight', 'vit.blocks.5.norm2.bias', 'vit.blocks.6.mlp.linear1.weight', 'vit.blocks.6.mlp.linear1.bias', 'vit.blocks.6.mlp.linear2.weight', 'vit.blocks.6.mlp.linear2.bias', 'vit.blocks.6.norm1.weight', 'vit.blocks.6.norm1.bias', 'vit.blocks.6.attn.out_proj.weight', 'vit.blocks.6.attn.out_proj.bias', 'vit.blocks.6.attn.qkv.weight', 'vit.blocks.6.norm2.weight', 'vit.blocks.6.norm2.bias', 'vit.blocks.7.mlp.linear1.weight', 'vit.blocks.7.mlp.linear1.bias', 'vit.blocks.7.mlp.linear2.weight', 'vit.blocks.7.mlp.linear2.bias', 'vit.blocks.7.norm1.weight', 'vit.blocks.7.norm1.bias', 'vit.blocks.7.attn.out_proj.weight', 'vit.blocks.7.attn.out_proj.bias', 'vit.blocks.7.attn.qkv.weight', 'vit.blocks.7.norm2.weight', 'vit.blocks.7.norm2.bias', 'vit.blocks.8.mlp.linear1.weight', 'vit.blocks.8.mlp.linear1.bias', 'vit.blocks.8.mlp.linear2.weight', 'vit.blocks.8.mlp.linear2.bias', 'vit.blocks.8.norm1.weight', 'vit.blocks.8.norm1.bias', 'vit.blocks.8.attn.out_proj.weight', 'vit.blocks.8.attn.out_proj.bias', 'vit.blocks.8.attn.qkv.weight', 'vit.blocks.8.norm2.weight', 'vit.blocks.8.norm2.bias', 'vit.blocks.9.mlp.linear1.weight', 'vit.blocks.9.mlp.linear1.bias', 'vit.blocks.9.mlp.linear2.weight', 'vit.blocks.9.mlp.linear2.bias', 'vit.blocks.9.norm1.weight', 'vit.blocks.9.norm1.bias', 'vit.blocks.9.attn.out_proj.weight', 'vit.blocks.9.attn.out_proj.bias', 'vit.blocks.9.attn.qkv.weight', 'vit.blocks.9.norm2.weight', 'vit.blocks.9.norm2.bias', 'vit.blocks.10.mlp.linear1.weight', 'vit.blocks.10.mlp.linear1.bias', 'vit.blocks.10.mlp.linear2.weight', 'vit.blocks.10.mlp.linear2.bias', 'vit.blocks.10.norm1.weight', 'vit.blocks.10.norm1.bias', 'vit.blocks.10.attn.out_proj.weight', 'vit.blocks.10.attn.out_proj.bias', 'vit.blocks.10.attn.qkv.weight', 'vit.blocks.10.norm2.weight', 'vit.blocks.10.norm2.bias', 'vit.blocks.11.mlp.linear1.weight', 'vit.blocks.11.mlp.linear1.bias', 'vit.blocks.11.mlp.linear2.weight', 'vit.blocks.11.mlp.linear2.bias', 'vit.blocks.11.norm1.weight', 'vit.blocks.11.norm1.bias', 'vit.blocks.11.attn.out_proj.weight', 'vit.blocks.11.attn.out_proj.bias', 'vit.blocks.11.attn.qkv.weight', 'vit.blocks.11.norm2.weight', 'vit.blocks.11.norm2.bias', 'vit.norm.weight', 'vit.norm.bias', 'encoder1.layer.conv1.conv.weight', 'encoder1.layer.conv2.conv.weight', 'encoder1.layer.conv3.conv.weight', 'encoder2.transp_conv_init.conv.weight', 'encoder2.blocks.0.0.conv.weight', 'encoder2.blocks.0.1.conv1.conv.weight', 'encoder2.blocks.0.1.conv2.conv.weight', 'encoder2.blocks.1.0.conv.weight', 'encoder2.blocks.1.1.conv1.conv.weight', 'encoder2.blocks.1.1.conv2.conv.weight', 'encoder3.transp_conv_init.conv.weight', 'encoder3.blocks.0.0.conv.weight', 'encoder3.blocks.0.1.conv1.conv.weight', 'encoder3.blocks.0.1.conv2.conv.weight', 'encoder4.transp_conv_init.conv.weight', 'decoder5.transp_conv.conv.weight', 'decoder5.conv_block.conv1.conv.weight', 'decoder5.conv_block.conv2.conv.weight', 'decoder5.conv_block.conv3.conv.weight', 'decoder4.transp_conv.conv.weight', 'decoder4.conv_block.conv1.conv.weight', 'decoder4.conv_block.conv2.conv.weight', 'decoder4.conv_block.conv3.conv.weight', 'decoder3.transp_conv.conv.weight', 'decoder3.conv_block.conv1.conv.weight', 'decoder3.conv_block.conv2.conv.weight', 'decoder3.conv_block.conv3.conv.weight', 'decoder2.transp_conv.conv.weight', 'decoder2.conv_block.conv1.conv.weight', 'decoder2.conv_block.conv2.conv.weight', 'decoder2.conv_block.conv3.conv.weight', 'out.conv.conv.weight', 'out.conv.conv.bias'])

while UNETER model need 174

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions