(serverless)tiflash cn node crash during run workload

[mayjiang0203]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Run one workload with many partition created and dropped.

2. What did you expect to see? (Required)

Works fine.

3. What did you see instead (Required)

{"namespace":"endless-cse-htap-partition360-v71-tps-6240090-1-22","pod":"tc1-tiflash-0","level":"ERROR","container":"data0","log":"[BaseDaemon.cpp:563] [\"\\n       0x76e8671\\tfaultSignalHandler(int, siginfo_t*, void*) [tiflash+124683889]\\n                \\tlibs/libdaemon/src/BaseDaemon.cpp:214\\n  0x7fcfa42a8630\\t<unknown symbol> [libpthread.so.0+63024]\\n       0x1e42f2c\\tDB::ResourceControlQueue<DB::MultiLevelFeedbackQueue<DB::CPUTimeGetter> >::updateStatistics(std::__1::unique_ptr<DB::Task, std::__1::default_delete<DB::Task> > const&, DB::ExecTaskStatus, unsigned long) [tiflash+31731500]\\n                \\tdbms/src/Flash/Pipeline/Schedule/TaskQueues/ResourceControlQueue.cpp:159\\n       0x1e3be77\\tDB::TaskThreadPool<DB::CPUImpl>::loop(unsigned long) [tiflash+31702647]\\n                \\tdbms/src/Flash/Pipeline/Schedule/ThreadPool/TaskThreadPool.cpp:59\\n       0x1e3c546\\tvoid* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (DB::TaskThreadPool<DB::CPUImpl>::*)(unsigned long), DB::TaskThreadPool<DB::CPUImpl>*, unsigned long> >(void*) [tiflash+31704390]\\n                \\t/usr/local/bin/../include/c++/v1/thread:291\\n  0x7fcfa42a0ea5\\tstart_thread [libpthread.so.0+32421]\"] [source=BaseDaemon] [thread_id=134]"}

4. What is your TiFlash version? (Required)

{"namespace":"endless-cse-htap-partition360-v71-tps-6240090-1-22","level":"INFO","pod":"tc1-tiflash-0","container":"data0","log":"[BaseDaemon.cpp:1183] [\"TiFlash build info: TiFlash\\nRelease Version: v7.1.0-alpha-460-gbbaa661\\nEdition:         Community\\nGit Commit Hash: bbaa661f83758c9e26cd5a9d586c5fb19aa42ad2\\nGit Branch:      cloud-engine-on-release-7.4\\nUTC Build Time:  2024-01-11 02:53:08\\nEnable Features: jemalloc sm4(GmSSL) avx2 avx512 unwind thinlto\\nProfile:         RELWITHDEBINFO\\n\"] [thread_id=1]"}

[guo-shaoge]

#8233 fixed