Skip to content

Check failed: operation != nullptr #15

@ray0809

Description

@ray0809

hi, when I ran the commands according to the readme, It throw an error

RUN:

bash build.sh. 
bash launch.sh. 
python stable_diffusion_v1_5.py. # error throw in the command

Print Log:

Fetching 15 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:00<00:00, 37117.73it/s]
/oneflow/python/oneflow/nn/modules/module.py:152: UserWarning: Interpolate() is called in a nn.Graph, but not registered into a nn.Graph.
  warnings.warn(
  0%|                                                                                                                                                                   | 0/50 [00:00<?, ?it/s]F20230202 03:51:34.659189  1094 conv_cutlass_kernels.cu:138] Check failed: operation != nullptr
*** Check failure stack trace: ***
    @     0x7f549aa0b5e0  google::LogMessage::Fail()
    @     0x7f549aa0e6a1  google::LogMessage::SendToLog()
    @     0x7f549aa0b0bc  google::LogMessage::Flush()
    @     0x7f549aa0ed9f  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f54960c90b8  oneflow::(anonymous namespace)::Conv2dCutlassKernel::Compute()
    @     0x7f549562cc9f  oneflow::UserKernel::ForwardUserKernel()
    @     0x7f549562ceaf  oneflow::UserKernel::ForwardDataContent()
    @     0x7f54955fb70b  oneflow::Kernel::Forward()
    @     0x7f54955fbc01  oneflow::Kernel::Launch()
    @     0x7f54956c165b  oneflow::(anonymous namespace)::LightActor<>::ProcessMsg()
    @     0x7f5495cce467  oneflow::Thread::PollMsgChannel()
    @     0x7f5495cce987  _ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN7oneflow6ThreadC4ERKNS3_8StreamIdEEUlvE_EEEEE6_M_runEv
    @     0x7f550b5f8017  execute_native_thread_routine
    @     0x7f550ba21609  start_thread
    @     0x7f550b7e0133  clone
Aborted (core dumped)

My Env:

GPU: Titan Xp
Driver Version: 525.78.01
Docker: diffusion-benchmark:latest

Could someone please to help me? How can i solve the problem

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions