stable-25-1-3: ydb/tests/compatibility/test_stress.py.TestStress.test_log[mixed_current_and_stable-25-1-3-column]

[maximyurchuk]

stable-25-1-3 + main

https://github.com/ydb-platform/ydb/actions/runs/16302420567

https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/Regression-run_compatibility/16302420567/ya-main-x86-64/try_1/ya-test.html#FAIL

ydb/tests/compatibility/test_stress.py.TestStress.test_log[mixed_current_and_stable-25-1-3-column]

teardown failed:
ydb/tests/compatibility/test_stress.py:17: in setup
    yield from self.setup_cluster(
ydb/tests/library/compatibility/fixtures.py:166: in setup_cluster
    self.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:624: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = -6.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/compatibility/test-results/py3test/testing_out_stuff/test_stress.py.TestStress.test_log.mixed_current_and_stable-25-1-3-column/cluster/node_2/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/compatibility/test-results/py3test/testing_out_stuff/test_stress.py.TestStress.test_log.mixed_current_and_stable-25-1-3-column/cluster/node_2/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Not freed 0x00007FAF90E78EB0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78DC0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78D90 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78D30 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78D00 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78A60 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78970 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78910 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E788B0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78880 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78850 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78790 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78670 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78610 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78580 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78550 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78520 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78430 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78400 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E783A0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E782B0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78250 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E781F0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78190 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78130 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E780A0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78070 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E78010 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E77FE0 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/minikql/mkql_alloc.h:505. For more detailed location use YQL_MKQL_COLLECT_STACKTRACES_FOR_ALLOCATIONS environment variable.
E   Not freed 0x00007FAF90E77F80 size: 48, location: /home/runner/actions_runner/_work/ydb/ydb/yql/essentials/min...

[XJIE6]

[fail] test_stress.py::TestStress::test_log[mixed_current_and_stable-25-1-3-column] [default-linux-x86_64-debug] (194.90s)
teardown failed:
ydb/tests/compatibility/test_stress.py:17: in setup
    yield from self.setup_cluster(
ydb/tests/library/compatibility/fixtures.py:166: in setup_cluster
    self.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = -6.
E   Stdout file name: 
E   /home/xjie6/dev/ydb-my/ydb/tests/compatibility/test-results/py3test/test_stress/chunk0/testing_out_stuff/test_stress.py.TestStress.test_log.mixed_current_and_stable-25-1-3-column/cluster/node_1/stdout
E   Stderr file name: 
E   /home/xjie6/dev/ydb-my/ydb/tests/compatibility/test-results/py3test/test_stress/chunk0/testing_out_stuff/test_stress.py.TestStress.test_log.mixed_current_and_stable-25-1-3-column/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   VERIFY failed (2025-07-24T11:38:09.115176+0300): tablet_id=72075186224037889;self_id=[1:7530564900502947568:2313];ev=NKikimr::TEvDataShard::TEvKqpScan;tx_id=281474976715657;scan_id=100;gen=1;table=/Root/column;snapshot={1753346289000:max};tablet=72075186224037889;timeout=0.000000s;cpu_limits=Disabled;;verification=sortedNodes.size() == Nodes.size();fline=graph_execute.cpp:148;debug=digraph program {N0[shape=box, label="N0(0):{\"p\":{\"v\":\"service1\"},\"o\":\"10\",\"t\":\"Const\"}\n"];
...

[XJIE6]

Та же верифайка, что и #21275

[maximyurchuk]

Не совсем понятно: текущая проблема про потенциально stable-25-1-3, то что и в main присутствует -- это возможно, но не отменяет текущее issue

[XJIE6]

VERIFY failed (2025-07-24T20:35:48.285446+0300): Allocated: 8551624, Freed: 8250376, Peak: 962104
  yql/essentials/minikql/mkql_mem_info.cpp:174
  VerifyDebug(): requirement GetUsage() == 0 failed
0. /home/xjie6/dev/ydb/util/system/backtrace.cpp:102: BackTrace(void**, unsigned long) @ 0x11F57AFC
1. /home/xjie6/dev/ydb/util/system/backtrace.cpp:265: FormatBackTrace(IOutputStream*) @ 0x11F57FCF
2. /home/xjie6/dev/ydb/util/system/backtrace.cpp:274: PrintBackTrace() @ 0x11F58010
3. /home/xjie6/dev/ydb/util/system/yassert.cpp:83: NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long) @ 0x11F8AF62
4. /home/xjie6/dev/ydb/util/system/yassert.cpp:55: NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...) @ 0x11F80B61
5. /-S/yql/essentials/minikql/mkql_mem_info.cpp:172: NKikimr::NMiniKQL::TMemoryUsageInfo::VerifyDebug() const @ 0x16CC8C5F
6. /-S/yql/essentials/minikql/mkql_mem_info.cpp:58: NKikimr::NMiniKQL::TMemoryUsageInfo::~TMemoryUsageInfo() @ 0x16CC8911
7. /-S/yql/essentials/minikql/mkql_mem_info.cpp:56: NKikimr::NMiniKQL::TMemoryUsageInfo::~TMemoryUsageInfo() @ 0x16CC8D98
8. /-S/util/generic/ptr.h:36: void CheckedDelete<TThrRefBase>(TThrRefBase*) @ 0x102F8B9C
9. /-S/util/generic/ptr.h:57: void TDelete::Destroy<TThrRefBase>(TThrRefBase*) @ 0x102F8B54
10. /-S/util/generic/ptr.h:421: TRefCounted<TThrRefBase, TAtomicCounter, TDelete>::UnRef(long) @ 0x102F8B31
11. /-S/util/generic/ptr.h:426: TRefCounted<TThrRefBase, TAtomicCounter, TDelete>::UnRef() @ 0x102F8A29
12. /-S/util/generic/ptr.h:497: TDefaultIntrusivePtrOps<NKikimr::NMiniKQL::TMemoryUsageInfo>::UnRef(NKikimr::NMiniKQL::TMemoryUsageInfo*) @ 0x16CC449D
13. /-S/util/generic/ptr.h:641: TIntrusivePtr<NKikimr::NMiniKQL::TMemoryUsageInfo, TDefaultIntrusivePtrOps<NKikimr::NMiniKQL::TMemoryUsageInfo>>::UnRef() @ 0x16CC43B9
14. /-S/util/generic/ptr.h:539: TIntrusivePtr<NKikimr::NMiniKQL::TMemoryUsageInfo, TDefaultIntrusivePtrOps<NKikimr::NMiniKQL::TMemoryUsageInfo>>::~TIntrusivePtr() @ 0x16CBFDD4
15. /-S/yql/essentials/minikql/mkql_alloc.h:69: NKikimr::NMiniKQL::TAllocState::~TAllocState() @ 0x1A25555F
16. /-S/yql/essentials/minikql/mkql_alloc.h:223: NKikimr::NMiniKQL::TScopedAlloc::~TScopedAlloc() @ 0x1A2554F1
17. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:154: std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>::destroy[abi:fe200000](NKikimr::NMiniKQL::TScopedAlloc*) @ 0x2687DB78
18. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator_traits.h:335: void std::__y1::allocator_traits<std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>>::destroy[abi:fe200000]<NKikimr::NMiniKQL::TScopedAlloc, 0>(std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>&, NKikimr::NMiniKQL::TScopedAlloc*) @ 0x2687DB4C
19. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:317: void std::__y1::__shared_ptr_emplace<NKikimr::NMiniKQL::TScopedAlloc, std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>>::__on_zero_shared_impl[abi:fe200000]<std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>, 0>() @ 0x2687DB0D
20. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:320: std::__y1::__shared_ptr_emplace<NKikimr::NMiniKQL::TScopedAlloc, std::__y1::allocator<NKikimr::NMiniKQL::TScopedAlloc>>::__on_zero_shared() @ 0x2687DA14
21. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:173: std::__y1::__shared_count::__release_shared[abi:fe200000]() @ 0x1029E220
22. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:219: std::__y1::__shared_weak_count::__release_shared[abi:fe200000]() @ 0x1029E1C8
23. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:694: std::__y1::shared_ptr<NKikimr::NMiniKQL::TScopedAlloc>::~shared_ptr[abi:fe200000]() @ 0x247CA0AB
24. /-S/ydb/library/yql/dq/actors/compute/dq_compute_actor_impl.h:223: NYql::NDq::TDqComputeActorBase<NKikimr::NKqp::NScanPrivate::TKqpScanComputeActor, NYql::NDq::TComputeActorAsyncInputHelperSync>::~TDqComputeActorBase() @ 0x2CFBAAE3
25. /-S/ydb/library/yql/dq/actors/compute/dq_sync_compute_actor_base.h:10: NYql::NDq::TDqSyncComputeActorBase<NKikimr::NKqp::NScanPrivate::TKqpScanComputeActor>::~TDqSyncComputeActorBase() @ 0x2CFB9EF6
26. /-S/ydb/core/kqp/runtime/scheduler/old/kqp_compute_scheduler.h:131: NKikimr::NKqp::NSchedulerOld::TSchedulableComputeActorBase<NKikimr::NKqp::NScanPrivate::TKqpScanComputeActor>::~TSchedulableComputeActorBase() @ 0x2CFB99A6
27. /-S/ydb/core/kqp/compute_actor/kqp_scan_compute_actor.h:12: NKikimr::NKqp::NScanPrivate::TKqpScanComputeActor::~TKqpScanComputeActor() @ 0x2CFB22B6
28. /-S/ydb/core/kqp/compute_actor/kqp_scan_compute_actor.h:12: NKikimr::NKqp::NScanPrivate::TKqpScanComputeActor::~TKqpScanComputeActor() @ 0x2CFB22D8
29. /-S/util/generic/ptr.h:36: void CheckedDelete<NActors::IActor>(NActors::IActor*) @ 0x1459463C
30. /-S/util/generic/ptr.h:57: void TDelete::Destroy<NActors::IActor>(NActors::IActor*) @ 0x145945F4
31. /-S/util/generic/ptr.h:376: THolder<NActors::IActor, TDelete>::DoDestroy() @ 0x145945D9
32. /-S/util/generic/ptr.h:306: THolder<NActors::IActor, TDelete>::~THolder() @ 0x1458CCD4
33. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:154: std::__y1::allocator<THolder<NActors::IActor, TDelete>>::destroy[abi:fe200000](THolder<NActors::IActor, TDelete>*) @ 0x14603068
34. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator_traits.h:335: void std::__y1::allocator_traits<std::__y1::allocator<THolder<NActors::IActor, TDelete>>>::destroy[abi:fe200000]<THolder<NActors::IActor, TDelete>, 0>(std::__y1::allocator<THolder<NActors::IActor, TDelete>>&, THolder<NActors::IActor, TDelete>*) @ 0x1460302C
35. /-S/contrib/libs/cxxsupp/libcxx/include/vector:1015: std::__y1::vector<THolder<NActors::IActor, TDelete>, std::__y1::allocator<THolder<NActors::IActor, TDelete>>>::__base_destruct_at_end[abi:fe200000](THolder<NActors::IActor, TDelete>*) @ 0x14602FE7
36. /-S/contrib/libs/cxxsupp/libcxx/include/vector:1009: std::__y1::vector<THolder<NActors::IActor, TDelete>, std::__y1::allocator<THolder<NActors::IActor, TDelete>>>::__clear[abi:fe200000]() @ 0x14602F07
37. /-S/contrib/libs/cxxsupp/libcxx/include/vector:766: std::__y1::vector<THolder<NActors::IActor, TDelete>, std::__y1::allocator<THolder<NActors::IActor, TDelete>>>::clear[abi:fe200000]() @ 0x145FBD35
38. /-S/ydb/library/actors/core/executor_thread.cpp:113: NActors::TExecutorThread::DropUnregistered() @ 0x145FB9F6
39. /-S/ydb/library/actors/core/executor_thread.cpp:279: NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) @ 0x145FCC1D
40. /-S/ydb/library/actors/core/executor_thread.cpp:458: NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const @ 0x1460173F
41. /-S/ydb/library/actors/core/executor_thread.cpp:510: NActors::TExecutorThread::ProcessExecutorPool() @ 0x1460137D
42. /-S/ydb/library/actors/core/executor_thread.cpp:536: NActors::TExecutorThread::ThreadProc() @ 0x14601F5B
43. /home/xjie6/dev/ydb/util/system/thread.cpp:386: void* (anonymous namespace)::ThreadProcWrapper<ISimpleThread>(void*) @ 0x11F89E35
44. /home/xjie6/dev/ydb/util/system/thread.cpp:245: (anonymous namespace)::TPosixThread::ThreadProxy(void*) @ 0x11F8E26C
45. ??:0: ?? @ 0x7FA2DE3C6608
46. ??:0: ?? @ 0x7FA2DE2EB352