Fail TSAN test: DeltaMergeStoreTestFastAddPeer.SimpleWriteReadAfterRestoreFromCheckPointWithSplit #10630
Description
Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)
2025-12-23T18:21:30.575Z] ==================
[2025-12-23T18:21:30.575Z] WARNING: ThreadSanitizer: data race (pid=30481)
[2025-12-23T18:21:30.575Z] Write of size 8 at 0x7b1c000576b0 by main thread (mutexes: write M0):
[2025-12-23T18:21:30.575Z] #0 operator delete(void*) /tiflash-release-8.3/release-centos7-llvm/dockerfiles/misc/llvm-project/compiler-rt/lib/tsan/rtl/tsan_new_delete.cpp:126:3 (gtests_dbms+0x3705c3f)
[2025-12-23T18:21:30.575Z] #1 void std::__1::__libcpp_operator_delete[abi:ue170006]<void*>(void*) /usr/local/bin/../include/c++/v1/new:278:3 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #2 void std::__1::__do_deallocate_handle_size[abi:ue170006]<>(void*, unsigned long) /usr/local/bin/../include/c++/v1/new:302:10 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #3 std::__1::__libcpp_deallocate[abi:ue170006](void*, unsigned long, unsigned long) /usr/local/bin/../include/c++/v1/new:318:14 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #4 std::__1::allocator<char>::deallocate[abi:ue170006](char*, unsigned long) /usr/local/bin/../include/c++/v1/__memory/allocator.h:130:13 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #5 std::__1::allocator_traits<std::__1::allocator<char>>::deallocate[abi:ue170006](std::__1::allocator<char>&, char*, unsigned long) /usr/local/bin/../include/c++/v1/__memory/allocator_traits.h:288:13 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #6 std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_string() /usr/local/bin/../include/c++/v1/string:1096:7 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.575Z] #7 void std::__1::__destroy_at[abi:ue170006]<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, 0>(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>*) /usr/local/bin/../include/c++/v1/__memory/construct_at.h:69:13 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #8 void std::__1::destroy_at[abi:ue170006]<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, 0>(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>*) /usr/local/bin/../include/c++/v1/__memory/construct_at.h:104:5 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #9 void std::__1::allocator_traits<std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::destroy[abi:ue170006]<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, void, void>(std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>*) /usr/local/bin/../include/c++/v1/__memory/allocator_traits.h:323:9 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #10 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::__base_destruct_at_end[abi:ue170006](std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>*) /usr/local/bin/../include/c++/v1/vector:944:9 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #11 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::__clear[abi:ue170006]() /usr/local/bin/../include/c++/v1/vector:938:29 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #12 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::clear[abi:ue170006]() /usr/local/bin/../include/c++/v1/vector:723:9 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #13 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::__vdeallocate() /usr/local/bin/../include/c++/v1/vector:1072:9 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #14 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::__move_assign(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>&, std::__1::integral_constant<bool, true>) /usr/local/bin/../include/c++/v1/vector:1395:5 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #15 std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>::operator=[abi:ue170006](std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>&&) /usr/local/bin/../include/c++/v1/vector:1369:5 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #16 DB::PathPool::operator=(DB::PathPool&&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/PathPool.h:38:7 (gtests_dbms+0x1010f67b)
[2025-12-23T18:21:30.576Z] #17 DB::Context::setPathPool(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&, std::__1::shared_ptr<DB::PathCapacityMetrics>, std::__1::shared_ptr<DB::FileProvider>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Interpreters/Context.cpp:624:23 (gtests_dbms+0x10100763)
[2025-12-23T18:21:30.576Z] #18 DB::tests::TiFlashTestEnv::getContext(DB::Settings const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Debug/TiFlashTestEnv.cpp:200:13 (gtests_dbms+0xfb1a45a)
[2025-12-23T18:21:30.576Z] #19 DB::DM::tests::DMTestEnv::getContext(DB::Settings const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/DeltaMerge/tests/DMTestEnv.h:127:16 (gtests_dbms+0x6c669bd)
[2025-12-23T18:21:30.576Z] #20 DB::DM::tests::DeltaMergeStoreTestFastAddPeer_SimpleWriteReadAfterRestoreFromCheckPointWithSplit_Test::TestBody() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/DeltaMerge/tests/gtest_dm_delta_merge_store_fast_add_peer.cpp:469:18 (gtests_dbms+0x6c669bd)
[2025-12-23T18:21:30.576Z] #21 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2443:10 (gtests_dbms+0xe5a2c19)
[2025-12-23T18:21:30.576Z] #22 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2479:14 (gtests_dbms+0xe5a2c19)
[2025-12-23T18:21:30.576Z] #23 testing::Test::Run() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2517:5 (gtests_dbms+0xe578383)
[2025-12-23T18:21:30.576Z] #24 testing::TestInfo::Run() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2693:11 (gtests_dbms+0xe579b9e)
[2025-12-23T18:21:30.576Z] #25 testing::TestCase::Run() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2811:28 (gtests_dbms+0xe57ab83)
[2025-12-23T18:21:30.576Z] #26 testing::internal::UnitTestImpl::RunAllTests() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:5177:43 (gtests_dbms+0xe58cf9a)
[2025-12-23T18:21:30.576Z] #27 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2443:10 (gtests_dbms+0xe5a412d)
[2025-12-23T18:21:30.576Z] #28 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:2479:14 (gtests_dbms+0xe5a412d)
[2025-12-23T18:21:30.577Z] #29 testing::UnitTest::Run() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/src/gtest.cc:4786:10 (gtests_dbms+0xe58c864)
[2025-12-23T18:21:30.577Z] #30 RUN_ALL_TESTS() /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/googletest/googletest/include/gtest/gtest.h:2341:46 (gtests_dbms+0x77f8527)
[2025-12-23T18:21:30.577Z] #31 main /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/TestUtils/gtests_dbms_main.cpp:120:16 (gtests_dbms+0x77f8527)
[2025-12-23T18:21:30.577Z]
[2025-12-23T18:21:30.577Z] Previous read of size 8 at 0x7b1c000576b0 by thread T4:
[2025-12-23T18:21:30.577Z] #0 std::__1::pair<char const*, char*> std::__1::__uninitialized_copy_n[abi:ue170006]<char, char const*, unsigned long, char*, std::__1::__unreachable_sentinel>(char const*, unsigned long, char*, std::__1::__unreachable_sentinel) /usr/local/bin/../include/c++/v1/__memory/uninitialized_algorithms.h:99:51 (gtests_dbms+0x38ab641)
[2025-12-23T18:21:30.577Z] #1 char* std::__1::uninitialized_copy_n[abi:ue170006]<char const*, unsigned long, char*>(char const*, unsigned long, char*) /usr/local/bin/../include/c++/v1/__memory/uninitialized_algorithms.h:114:19 (gtests_dbms+0x38ab641)
[2025-12-23T18:21:30.577Z] #2 void fmt::v10::detail::buffer<char>::append<char>(char const*, char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:877:5 (gtests_dbms+0x38ab641)
[2025-12-23T18:21:30.577Z] #3 fmt::v10::appender fmt::v10::detail::copy_str<char, char const*>(char const*, char const*, fmt::v10::appender) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/core.h:1489:22 (gtests_dbms+0x38ab641)
[2025-12-23T18:21:30.577Z] #4 fmt::v10::appender fmt::v10::detail::copy_str_noinline<char, char const*, fmt::v10::appender>(char const*, char const*, fmt::v10::appender) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:645:10 (gtests_dbms+0x38ab641)
[2025-12-23T18:21:30.577Z] #5 fmt::v10::appender fmt::v10::detail::write<char, fmt::v10::appender>(fmt::v10::appender, fmt::v10::basic_string_view<char>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:3688:8 (gtests_dbms+0x137d6808)
[2025-12-23T18:21:30.577Z] #6 fmt::v10::appender fmt::v10::detail::default_arg_formatter<char>::operator()<fmt::v10::basic_string_view<char>>(fmt::v10::basic_string_view<char>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:3775:12 (gtests_dbms+0x137d6808)
[2025-12-23T18:21:30.577Z] #7 decltype(fp(0)) fmt::v10::visit_format_arg<fmt::v10::detail::default_arg_formatter<char>, fmt::v10::basic_format_context<fmt::v10::appender, char>>(fmt::v10::detail::default_arg_formatter<char>&&, fmt::v10::basic_format_arg<fmt::v10::basic_format_context<fmt::v10::appender, char>> const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/core.h:1696:12 (gtests_dbms+0x137d6808)
[2025-12-23T18:21:30.577Z] #8 void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref)::format_handler::on_replacement_field(int, char const*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:4365:26 (gtests_dbms+0x137d6808)
[2025-12-23T18:21:30.581Z] #9 char const* fmt::v10::detail::parse_replacement_field<char, void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref)::format_handler&>(char const*, char const*, void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref)::format_handler&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/core.h:2457:13 (gtests_dbms+0x137d6808)
[2025-12-23T18:21:30.581Z] #10 void fmt::v10::detail::parse_format_string<false, char, void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref)::format_handler>(fmt::v10::basic_string_view<char>, void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref)::format_handler&&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/core.h:2489:21 (gtests_dbms+0x137c98c2)
[2025-12-23T18:21:30.581Z] #11 void fmt::v10::detail::vformat_to<char>(fmt::v10::detail::buffer<char>&, fmt::v10::basic_string_view<char>, fmt::v10::detail::vformat_args<char>::type, fmt::v10::detail::locale_ref) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format.h:4392:3 (gtests_dbms+0x137c98c2)
[2025-12-23T18:21:30.581Z] #12 fmt::v10::vformat(fmt::v10::basic_string_view<char>, fmt::v10::basic_format_args<fmt::v10::basic_format_context<fmt::v10::appender, char>>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/format-inl.h:1424:3 (gtests_dbms+0x137c848a)
[2025-12-23T18:21:30.581Z] #13 std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> fmt::v10::format<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>(fmt::v10::basic_format_string<char, fmt::v10::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>::type, fmt::v10::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>::type>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/contrib/fmtlib-cmake/../fmtlib/include/fmt/core.h:2788:10 (gtests_dbms+0x10d0a910)
[2025-12-23T18:21:30.581Z] #14 DB::PSDiskDelegatorGlobalMulti::listPaths() const /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/PathPool.cpp:1034:25 (gtests_dbms+0x10d0a910)
[2025-12-23T18:21:30.581Z] #15 DB::PS::V3::WALStoreReader::listAllFiles(std::__1::shared_ptr<DB::PSDiskDelegator> const&, std::__1::shared_ptr<DB::Logger>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/WAL/WALReader.cpp:45:48 (gtests_dbms+0x119982bc)
[2025-12-23T18:21:30.582Z] #16 DB::PS::V3::WALStore::tryGetFilesSnapshot(unsigned long, unsigned long, std::__1::function<std::__1::optional<unsigned long> (std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&)>&&, bool) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/WALStore.cpp:176:42 (gtests_dbms+0x118d4477)
[2025-12-23T18:21:30.582Z] #17 DB::PS::V3::PageDirectory<DB::PS::V3::universal::PageDirectoryTrait>::tryDumpSnapshot(std::__1::shared_ptr<DB::WriteLimiter> const&, bool) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/PageDirectory.cpp:2063:28 (gtests_dbms+0x1188ed4a)
[2025-12-23T18:21:30.582Z] #18 DB::PS::V3::ExternalPageCallbacksManager<DB::PS::V3::universal::ExternalPageCallbacksManagerTrait>::doGC(DB::PS::V3::BlobStore<DB::PS::V3::universal::BlobStoreTrait>&, DB::PS::V3::PageDirectory<DB::PS::V3::universal::PageDirectoryTrait>&, std::__1::shared_ptr<DB::WriteLimiter> const&, std::__1::shared_ptr<DB::ReadLimiter> const&, std::__1::unordered_map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, unsigned long, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, unsigned long>>>*) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/GCDefines.cpp:261:52 (gtests_dbms+0x118ca95d)
[2025-12-23T18:21:30.582Z] #19 DB::PS::V3::ExternalPageCallbacksManager<DB::PS::V3::universal::ExternalPageCallbacksManagerTrait>::gc(DB::PS::V3::BlobStore<DB::PS::V3::universal::BlobStoreTrait>&, DB::PS::V3::PageDirectory<DB::PS::V3::universal::PageDirectoryTrait>&, std::__1::shared_ptr<DB::WriteLimiter> const&, std::__1::shared_ptr<DB::ReadLimiter> const&, std::__1::unordered_map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, unsigned long, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, unsigned long>>>*, std::__1::shared_ptr<DB::Logger>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/GCDefines.cpp:147:41 (gtests_dbms+0x118ca476)
[2025-12-23T18:21:30.582Z] #20 DB::UniversalPageStorage::gc(bool, std::__1::shared_ptr<DB::WriteLimiter> const&, std::__1::shared_ptr<DB::ReadLimiter> const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/Universal/UniversalPageStorage.cpp:448:34 (gtests_dbms+0x1194178b)
[2025-12-23T18:21:30.582Z] #21 DB::UniversalPageStorageService::gc() const /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/Universal/UniversalPageStorageService.cpp:313:36 (gtests_dbms+0x119516cb)
[2025-12-23T18:21:30.582Z] #22 DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1::operator()() const /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/Page/V3/Universal/UniversalPageStorageService.cpp:87:29 (gtests_dbms+0x1195209a)
[2025-12-23T18:21:30.582Z] #23 decltype(std::declval<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1&>()()) std::__1::__invoke[abi:ue170006]<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1&>(DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1&) /usr/local/bin/../include/c++/v1/__type_traits/invoke.h:340:25 (gtests_dbms+0x1195209a)
[2025-12-23T18:21:30.582Z] #24 bool std::__1::__invoke_void_return_wrapper<bool, false>::__call[abi:ue170006]<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1&>(DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1&) /usr/local/bin/../include/c++/v1/__type_traits/invoke.h:407:12 (gtests_dbms+0x1195209a)
[2025-12-23T18:21:30.582Z] #25 std::__1::__function::__alloc_func<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1, std::__1::allocator<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1>, bool ()>::operator()[abi:ue170006]() /usr/local/bin/../include/c++/v1/__functional/function.h:192:16 (gtests_dbms+0x1195209a)
[2025-12-23T18:21:30.582Z] #26 std::__1::__function::__func<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1, std::__1::allocator<DB::UniversalPageStorageService::create(DB::Context&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::PSDiskDelegator>, DB::PageStorageConfig const&)::$_1>, bool ()>::operator()() /usr/local/bin/../include/c++/v1/__functional/function.h:363:12 (gtests_dbms+0x1195209a)
[2025-12-23T18:21:30.582Z] #27 std::__1::__function::__value_func<bool ()>::operator()[abi:ue170006]() const /usr/local/bin/../include/c++/v1/__functional/function.h:517:16 (gtests_dbms+0x10cbea56)
[2025-12-23T18:21:30.582Z] #28 std::__1::function<bool ()>::operator()() const /usr/local/bin/../include/c++/v1/__functional/function.h:1168:12 (gtests_dbms+0x10cbea56)
[2025-12-23T18:21:30.582Z] #29 DB::BackgroundProcessingPool::threadFunction(unsigned long) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/BackgroundProcessingPool.cpp:267:25 (gtests_dbms+0x10cbea56)
[2025-12-23T18:21:30.582Z] #30 DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1::operator()() const /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/BackgroundProcessingPool.cpp:103:46 (gtests_dbms+0x10cbf9a8)
[2025-12-23T18:21:30.583Z] #31 decltype(std::declval<DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1>()()) std::__1::__invoke[abi:ue170006]<DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1>(DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1&&) /usr/local/bin/../include/c++/v1/__type_traits/invoke.h:340:25 (gtests_dbms+0x10cbf9a8)
[2025-12-23T18:21:30.583Z] #32 void std::__1::__thread_execute[abi:ue170006]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1>(std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1>&, std::__1::__tuple_indices<>) /usr/local/bin/../include/c++/v1/__thread/thread.h:221:5 (gtests_dbms+0x10cbf9a8)
[2025-12-23T18:21:30.583Z] #33 void* std::__1::__thread_proxy[abi:ue170006]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1>>(void*) /usr/local/bin/../include/c++/v1/__thread/thread.h:232:5 (gtests_dbms+0x10cbf9a8)
[2025-12-23T18:21:30.583Z]
[2025-12-23T18:21:30.583Z] Mutex M0 (0x7b7400000a38) created at:
[2025-12-23T18:21:30.583Z] #0 pthread_mutex_init /tiflash-release-8.3/release-centos7-llvm/dockerfiles/misc/llvm-project/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1313:3 (gtests_dbms+0x367f580)
[2025-12-23T18:21:30.583Z] #1 std::__1::recursive_mutex::recursive_mutex() <null> (libc++.so.1+0x8f87b)
[2025-12-23T18:21:30.583Z] #2 DB::ContextShared* std::__1::construct_at[abi:ue170006]<DB::ContextShared, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&, DB::ContextShared*>(DB::ContextShared*, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&) /usr/local/bin/../include/c++/v1/__memory/construct_at.h:41:46 (gtests_dbms+0x1011dc67)
[2025-12-23T18:21:30.583Z] #3 void std::__1::allocator_traits<std::__1::allocator<DB::ContextShared>>::construct[abi:ue170006]<DB::ContextShared, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&, void, void>(std::__1::allocator<DB::ContextShared>&, DB::ContextShared*, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&) /usr/local/bin/../include/c++/v1/__memory/allocator_traits.h:304:9 (gtests_dbms+0x1011dc67)
[2025-12-23T18:21:30.583Z] #4 std::__1::__shared_ptr_emplace<DB::ContextShared, std::__1::allocator<DB::ContextShared>>::__shared_ptr_emplace[abi:ue170006]<std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&>(std::__1::allocator<DB::ContextShared>, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:299:13 (gtests_dbms+0x1011dc67)
[2025-12-23T18:21:30.583Z] #5 std::__1::shared_ptr<DB::ContextShared> std::__1::allocate_shared[abi:ue170006]<DB::ContextShared, std::__1::allocator<DB::ContextShared>, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&, void>(std::__1::allocator<DB::ContextShared> const&, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:1022:55 (gtests_dbms+0x100fd411)
[2025-12-23T18:21:30.583Z] #6 std::__1::shared_ptr<DB::ContextShared> std::__1::make_shared[abi:ue170006]<DB::ContextShared, std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&, void>(std::__1::shared_ptr<DB::IRuntimeComponentsFactory>&, DB::Context::ApplicationType&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:1031:12 (gtests_dbms+0x100fd411)
[2025-12-23T18:21:30.583Z] #7 DB::Context::createGlobal(std::__1::shared_ptr<DB::IRuntimeComponentsFactory>, DB::Context::ApplicationType, std::__1::optional<DB::DisaggOptions> const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Interpreters/Context.cpp:359:19 (gtests_dbms+0x100fd411)
[2025-12-23T18:21:30.583Z] #8 DB::Context::createGlobal(DB::Context::ApplicationType, std::__1::optional<DB::DisaggOptions> const&) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Interpreters/Context.cpp:375:12 (gtests_dbms+0x100fd916)
[2025-12-23T18:21:30.583Z] #9 DB::tests::TiFlashTestEnv::addGlobalContext(DB::Settings const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>, DB::PageStorageRunMode, unsigned long) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Debug/TiFlashTestEnv.cpp:113:52 (gtests_dbms+0xfb17d2a)
[2025-12-23T18:21:30.583Z] #10 DB::tests::TiFlashTestEnv::initializeGlobalContext(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>, DB::PageStorageRunMode, unsigned long) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Debug/TiFlashTestEnv.cpp:103:5 (gtests_dbms+0xfb17b94)
[2025-12-23T18:21:30.583Z] #11 main /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/TestUtils/gtests_dbms_main.cpp:73:5 (gtests_dbms+0x77f750f)
[2025-12-23T18:21:30.583Z]
[2025-12-23T18:21:30.583Z] Thread T4 'bg-1' (tid=30504, running) created by main thread at:
[2025-12-23T18:21:30.583Z] #0 pthread_create /tiflash-release-8.3/release-centos7-llvm/dockerfiles/misc/llvm-project/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1020:3 (gtests_dbms+0x367db9b)
[2025-12-23T18:21:30.583Z] #1 std::__1::__libcpp_thread_create[abi:ue170006](unsigned long*, void* (*)(void*), void*) /usr/local/bin/../include/c++/v1/__threading_support:371:10 (gtests_dbms+0x10cbd88b)
[2025-12-23T18:21:30.583Z] #2 std::__1::thread::thread<DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1, void>(DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>)::$_1&&) /usr/local/bin/../include/c++/v1/__thread/thread.h:248:16 (gtests_dbms+0x10cbd88b)
[2025-12-23T18:21:30.584Z] #3 DB::BackgroundProcessingPool::BackgroundProcessingPool(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Storages/BackgroundProcessingPool.cpp:103:22 (gtests_dbms+0x10cbd88b)
[2025-12-23T18:21:30.584Z] #4 DB::BackgroundProcessingPool* std::__1::construct_at[abi:ue170006]<DB::BackgroundProcessingPool, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>, DB::BackgroundProcessingPool*>(DB::BackgroundProcessingPool*, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>&&) /usr/local/bin/../include/c++/v1/__memory/construct_at.h:41:46 (gtests_dbms+0x10125cc2)
[2025-12-23T18:21:30.584Z] #5 void std::__1::allocator_traits<std::__1::allocator<DB::BackgroundProcessingPool>>::construct[abi:ue170006]<DB::BackgroundProcessingPool, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>, void, void>(std::__1::allocator<DB::BackgroundProcessingPool>&, DB::BackgroundProcessingPool*, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>&&) /usr/local/bin/../include/c++/v1/__memory/allocator_traits.h:304:9 (gtests_dbms+0x10107849)
[2025-12-23T18:21:30.584Z] #6 std::__1::__shared_ptr_emplace<DB::BackgroundProcessingPool, std::__1::allocator<DB::BackgroundProcessingPool>>::__shared_ptr_emplace[abi:ue170006]<unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>>(std::__1::allocator<DB::BackgroundProcessingPool>, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>&&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:299:13 (gtests_dbms+0x10107849)
[2025-12-23T18:21:30.584Z] #7 std::__1::shared_ptr<DB::BackgroundProcessingPool> std::__1::allocate_shared[abi:ue170006]<DB::BackgroundProcessingPool, std::__1::allocator<DB::BackgroundProcessingPool>, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>, void>(std::__1::allocator<DB::BackgroundProcessingPool> const&, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>&&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:1022:55 (gtests_dbms+0x10107849)
[2025-12-23T18:21:30.584Z] #8 std::__1::shared_ptr<DB::BackgroundProcessingPool> std::__1::make_shared[abi:ue170006]<DB::BackgroundProcessingPool, unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>, void>(unsigned short&, char const (&) [4], std::__1::shared_ptr<DB::JointThreadInfoJeallocMap>&&) /usr/local/bin/../include/c++/v1/__memory/shared_ptr.h:1031:12 (gtests_dbms+0x10107849)
[2025-12-23T18:21:30.584Z] #9 DB::Context::initializeBackgroundPool(unsigned short) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Interpreters/Context.cpp:1336:15 (gtests_dbms+0x10107849)
[2025-12-23T18:21:30.584Z] #10 DB::tests::TiFlashTestEnv::addGlobalContext(DB::Settings const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>, DB::PageStorageRunMode, unsigned long) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Debug/TiFlashTestEnv.cpp:126:21 (gtests_dbms+0xfb18001)
[2025-12-23T18:21:30.584Z] #11 DB::tests::TiFlashTestEnv::initializeGlobalContext(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>, DB::PageStorageRunMode, unsigned long) /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/Debug/TiFlashTestEnv.cpp:103:5 (gtests_dbms+0xfb17b94)
[2025-12-23T18:21:30.584Z] #12 main /home/jenkins/agent/workspace/tiflash-sanitizer-daily/tiflash/dbms/src/TestUtils/gtests_dbms_main.cpp:73:5 (gtests_dbms+0x77f750f)
[2025-12-23T18:21:30.584Z]
[2025-12-23T18:21:30.584Z] SUMMARY: ThreadSanitizer: data race /tiflash-release-8.3/release-centos7-llvm/dockerfiles/misc/llvm-project/compiler-rt/lib/tsan/rtl/tsan_new_delete.cpp:126:3 in operator delete(void*)