[BUG] Smoke test fail in connecting flow between apps

[sunxilin]

Description

ten_engine_link_connection_to_remote@remote_interface.c:198 The relationship of remote and connection should be 1-1 mapping.

in smoke test ExtensionTest.GraphMultiplePolygon

Environment

all

Steps to reproduce

run smoke test ExtensionTest.GraphMultiplePolygon, but occasional appearance.

Expected behavior

no error in this test case

Actual behavior

assert failure

Version

0.3.1

Severity

Major

Additional Information

No response

[sunxilin]

more logs：

[ RUN ] ExtensionTest.GraphMultiplePolygonOneApp
11-12 08:58:25.553 58417(6959) D [email protected]:922 [test_extension_2] Load metadata.
11-12 08:58:25.553 58417(6959) D [email protected]:767 [test_extension_2] on_configure().
11-12 08:58:25.553 58417(6959) D ten_extension_on_configure_done@on_xxx.c:88 [test_extension_2] on_configure() done.
11-12 08:58:25.553 58417(6959) I [email protected]:314 [test_extension_2] _ten section is not found in the property, skip.
11-12 08:58:25.553 58417(6959) D [email protected]:792 [test_extension_2] on_init().
11-12 08:58:25.553 58417(6959) D ten_extension_on_init_done@on_xxx.c:176 [test_extension_2] on_init() done.
11-12 08:58:25.553 58417(6959) I [email protected]:806 [test_extension_2] on_start().
11-12 08:58:25.553 58417(6959) I ten_extension_on_start_done@on_xxx.c:235 [test_extension_2] on_start() done.
11-12 08:58:25.556 58417(259) D [email protected]:75 Close tcp client: 127.0.0.1:49473
11-12 08:58:25.556 58417(7239) D [email protected]:154 Try to close communication protocol: aeacf776-55bc-47c4-b24d-511d89d0e477
11-12 08:58:25.556 58417(7239) D [email protected]:66 Close integrated protocol.
11-12 08:58:25.556 58417(7239) D [email protected]:86 Close base protocol.
11-12 08:58:25.556 58417(7239) D [email protected]:133 Try to close connection.
11-12 08:58:25.556 58417(7239) D [email protected]:121 Close connection.
11-12 08:58:25.556 58417(7239) D [email protected]:229 Try to close remote (aeacf776-55bc-47c4-b24d-511d89d0e477)
11-12 08:58:25.556 58417(7239) D [email protected]:105 Remote (aeacf776-55bc-47c4-b24d-511d89d0e477) can be closed now.
11-12 08:58:25.556 58417(7239) D [email protected]:32 [msgpack://127.0.0.1:8001/] Try to close engine.
11-12 08:58:25.556 58417(7239) D ten_extension_context_close@extension_context.c:159 [fdd2b311-97c2-4157-a6e5-fcde90645c61] Try to close extension context.
11-12 08:58:25.556 58417(7239) D ten_extension_thread_close@extension_thread.c:349 Try to close extension thread.
11-12 08:58:25.556 58417(6959) I [email protected]:822 [test_extension_1] on_stop().
11-12 08:58:25.556 58417(6959) I ten_extension_on_stop_done@on_xxx.c:252 [test_extension_1] on_stop() done.
11-12 08:58:25.556 58417(6959) I [email protected]:822 [test_extension_2] on_stop().
11-12 08:58:25.556 58417(6959) I ten_extension_on_stop_done@on_xxx.c:252 [test_extension_2] on_stop() done.
11-12 08:58:25.556 58417(6959) D [email protected]:836 [test_extension_2] on_deinit().
11-12 08:58:25.556 58417(6959) D ten_extension_on_deinit_done@on_xxx.c:332 [test_extension_2] on_deinit() done.
11-12 08:58:25.556 58417(6959) D ten_env_close@ten_env.c:169 [test_extension_2] Close ten of extension.
11-12 08:58:25.556 58417(6959) D ten_extension_thread_del_extension@on_xxx.c:272 [test_extension_2] Deleted from extension thread (extension_group_with_same_name).
11-12 08:58:25.557 58417(6959) D [email protected]:836 [test_extension_1] on_deinit().
11-12 08:58:25.557 58417(6959) D ten_extension_on_deinit_done@on_xxx.c:332 [test_extension_1] on_deinit() done.
11-12 08:58:25.557 58417(6959) D ten_env_close@ten_env.c:169 [test_extension_1] Close ten of extension.
11-12 08:58:25.557 58417(6959) D ten_extension_thread_del_extension@on_xxx.c:272 [test_extension_1] Deleted from extension thread (extension_group_with_same_name).
11-12 08:58:25.557 58417(6959) D ten_extension_group_destroy_extensions@extension_group.c:196 [extension_group_with_same_name] destroy_extensions.
11-12 08:58:25.557 58417(6959) D ten_extension_group_on_destroy_extensions_done@on_xxx.c:166 [extension_group_with_same_name] destroy_extensions() done.
11-12 08:58:25.557 58417(6959) D ten_extension_group_on_deinit_done@on_xxx.c:116 [extension_group_with_same_name] on_deinit() done.
11-12 08:58:25.557 58417(6959) D ten_env_close@ten_env.c:165 [extension_group_with_same_name] Close ten of extension group.
11-12 08:58:25.557 58417(6959) D ten_extension_thread_main_actual@extension_thread.c:266 Extension thread is stopped.
11-12 08:58:25.557 58417(7239) D ten_engine_on_extension_thread_closed@on_xxx.c:172 [fdd2b311-97c2-4157-a6e5-fcde90645c61] Waiting for extension thread (0x600000a48000) be reclaimed.
11-12 08:58:25.557 58417(7239) D ten_engine_on_extension_thread_closed@on_xxx.c:179 [fdd2b311-97c2-4157-a6e5-fcde90645c61] Extension thread (0x600000a48000) is reclaimed.
11-12 08:58:25.557 58417(7239) D ten_extension_context_on_close@extension_context.c:244 [fdd2b311-97c2-4157-a6e5-fcde90645c61] Close extension context.
11-12 08:58:25.557 58417(7239) D ten_env_close@ten_env.c:160 [fdd2b311-97c2-4157-a6e5-fcde90645c61] Close ten of engine.
11-12 08:58:25.557 58417(7239) D [email protected]:197 [msgpack://127.0.0.1:8001/] engine liveness: 0 remotes, 0 timers, extension_context 0x0
11-12 08:58:25.557 58417(7239) D [email protected]:234 Close engine.
11-12 08:58:25.557 58417(7239) D ten_app_del_engine@engine_interface.c:99 [msgpack://127.0.0.1:8001/] Remove engine from app.
11-12 08:58:25.557 58417(7239) D [email protected]:113 [msgpack://127.0.0.1:8001/] Try to close app.
11-12 08:58:25.557 58417(7239) D [email protected]:55 [msgpack://127.0.0.1:8001/] Could not close alive app.
11-12 08:58:25.557 58417(7239) D [email protected]:66 [msgpack://127.0.0.1:8001/] Try to close app.
11-12 08:58:25.557 58417(7239) D [email protected]:147 Try to close listening protocol: msgpack://127.0.0.1:8001/
11-12 08:58:25.557 58417(7239) D [email protected]:55 [msgpack://127.0.0.1:8001/] Could not close alive app.
11-12 08:58:25.558 58417(7239) D [email protected]:66 Close integrated protocol.
11-12 08:58:25.558 58417(7239) D [email protected]:86 Close base protocol.
11-12 08:58:25.558 58417(7239) D [email protected]:58 [msgpack://127.0.0.1:8001/] Close app.
11-12 08:58:25.558 58417(7239) D ten_app_on_deinit_done@on_xxx.c:277 app::on_deinit_done().
11-12 08:58:25.558 58417(7239) D ten_env_close@ten_env.c:156 [msgpack://127.0.0.1:8001/] Close ten of app.
11-12 08:58:25.558 58417(7239) D [email protected]:64 TEN app runloop ends.
11-12 08:58:25.558 58417(7239) D [email protected]:148 [msgpack://127.0.0.1:8001/] Destroy a App
11-12 08:58:25.558 58417(7243) I [email protected]:70 [] App is created.
11-12 08:58:25.559 58417(7243) W ten_find_app_base_dir@base_dir.c:52 Could not get app home from module path, using TEN_APP_BASE_DIR instead.
11-12 08:58:25.559 58417(7243) D ten_app_find_and_set_base_dir@base_dir.c:64 Failed to determine app base directory.
11-12 08:58:25.561 58417(7243) I [email protected]:25 Skip the loading of manifest.json because the base_dir of is missing.
11-12 08:58:25.561 58417(7243) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:25.561 58417(7243) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:25.561 58417(7243) I ten_protocol_integrated_listen@protocol_integrated.c:386 tcp://127.0.0.1:8001/ start listening.
11-12 08:58:25.630 58417(7243) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:25.630 58417(7243) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:25.630 58417(7243) D [email protected]:28 [msgpack://127.0.0.1:8001/] A client is connected.
11-12 08:58:25.630 58417(7243) D [email protected]:195 Create a connection 0x600001651030
11-12 08:58:25.630 58417(7243) D [email protected]:75 [msgpack://127.0.0.1:8001/] Add a orphan connection 0x600001651030 (total cnt 0)
11-12 08:58:25.630 58417(7243) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:25.645 58417(7243) D [email protected]:35 The base dir of app [msgpack://127.0.0.1:8001/] is not set, skip checking graph.
11-12 08:58:25.645 58417(7243) D ten_app_create_engine@engine_interface.c:84 [msgpack://127.0.0.1:8001/] App creates an engine.
11-12 08:58:25.645 58417(7243) D [email protected]:167 Create engine.
11-12 08:58:25.645 58417(7243) D [email protected]:100 [msgpack://127.0.0.1:8001/] Remove a orphan connection 0x600001651030
11-12 08:58:25.645 58417(7243) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri '1fbde5f6-5f0c-4fd0-aaeb-4a267c85ffc2' is not in 'weak_remotes' list.
11-12 08:58:25.645 58417(7243) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8001/] Add 1fbde5f6-5f0c-4fd0-aaeb-4a267c85ffc2 (0x7f7f1707ce00) as remote.
11-12 08:58:25.646 58417(7243) D ten_engine_handle_cmd_start_graph@start_graph.c:51 No more extensions need to be connected in the graph, enable the extension system now.
11-12 08:58:25.646 58417(7243) D ten_extension_context_create@extension_context.c:61 [9cfa36aa-6900-4269-875a-8447b88dd946] Create Extension context.
11-12 08:58:25.646 58417(7243) D [email protected]:404 Try to find addon for default_extension_group
11-12 08:58:25.646 58417(6963) D ten_extension_thread_main_actual@extension_thread.c:238 Extension thread is started
11-12 08:58:25.646 58417(6963) D [email protected]:24 [graph_multiple_polygon_one_app__extension_group] Load metadata.
11-12 08:58:25.646 58417(6963) D ten_extension_group_on_init_done@on_xxx.c:75 [graph_multiple_polygon_one_app__extension_group] on_init() done.
11-12 08:58:25.646 58417(6963) I [email protected]:25 Skip the loading of manifest.json because the base_dir of graph_multiple_polygon_one_app__extension_group is missing.
11-12 08:58:25.646 58417(6963) I [email protected]:51 Skip the loading of property.json because the base_dir of graph_multiple_polygon_one_app__extension_group is missing.
11-12 08:58:25.646 58417(6963) D ten_extension_group_create_extensions@extension_group.c:174 [graph_multiple_polygon_one_app__extension_group] create_extensions.
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D [email protected]:404 Try to find addon for graph_multiple_polygon_one_app__extension
11-12 08:58:25.646 58417(6963) D ten_extension_group_on_create_extensions_done@on_xxx.c:138 [graph_multiple_polygon_one_app__extension_group] create_extensions() done.
11-12 08:58:25.646 58417(7243) D ten_engine_on_extension_thread_is_ready@on_xxx.c:53 [9cfa36aa-6900-4269-875a-8447b88dd946] All extension threads are initted.
11-12 08:58:25.647 58417(7243) D ten_engine_on_extension_thread_is_ready@on_xxx.c:95 [9cfa36aa-6900-4269-875a-8447b88dd946] Engine is ready to handle messages.
11-12 08:58:25.647 58417(6963) D [email protected]:922 [A] Load metadata.
11-12 08:58:25.647 58417(6963) D [email protected]:767 [A] on_configure().
11-12 08:58:25.647 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [A] on_configure() done.
11-12 08:58:25.647 58417(6963) I [email protected]:314 [A] _ten section is not found in the property, skip.
11-12 08:58:25.647 58417(6963) D [email protected]:792 [A] on_init().
11-12 08:58:25.647 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [A] on_init() done.
11-12 08:58:25.647 58417(6963) I [email protected]:806 [A] on_start().
11-12 08:58:25.647 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [A] on_start() done.
11-12 08:58:25.647 58417(6963) D [email protected]:922 [B] Load metadata.
11-12 08:58:25.647 58417(6963) D [email protected]:767 [B] on_configure().
11-12 08:58:25.647 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [B] on_configure() done.
11-12 08:58:25.647 58417(6963) I [email protected]:314 [B] _ten section is not found in the property, skip.
11-12 08:58:25.647 58417(6963) D [email protected]:792 [B] on_init().
11-12 08:58:25.647 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [B] on_init() done.
11-12 08:58:25.647 58417(6963) I [email protected]:806 [B] on_start().
11-12 08:58:25.647 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [B] on_start() done.
11-12 08:58:25.647 58417(6963) D [email protected]:922 [C] Load metadata.
11-12 08:58:25.647 58417(6963) D [email protected]:767 [C] on_configure().
11-12 08:58:25.647 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [C] on_configure() done.
11-12 08:58:25.647 58417(6963) I [email protected]:314 [C] _ten section is not found in the property, skip.
11-12 08:58:25.647 58417(6963) D [email protected]:792 [C] on_init().
11-12 08:58:25.648 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [C] on_init() done.
11-12 08:58:25.648 58417(6963) I [email protected]:806 [C] on_start().
11-12 08:58:25.648 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [C] on_start() done.
11-12 08:58:25.648 58417(6963) D [email protected]:922 [D] Load metadata.
11-12 08:58:25.648 58417(6963) D [email protected]:767 [D] on_configure().
11-12 08:58:25.648 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [D] on_configure() done.
11-12 08:58:25.648 58417(6963) I [email protected]:314 [D] _ten section is not found in the property, skip.
11-12 08:58:25.648 58417(6963) D [email protected]:792 [D] on_init().
11-12 08:58:25.648 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [D] on_init() done.
11-12 08:58:25.648 58417(6963) I [email protected]:806 [D] on_start().
11-12 08:58:25.648 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [D] on_start() done.
11-12 08:58:25.648 58417(6963) D [email protected]:922 [E] Load metadata.
11-12 08:58:25.648 58417(6963) D [email protected]:767 [E] on_configure().
11-12 08:58:25.648 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [E] on_configure() done.
11-12 08:58:25.649 58417(6963) I [email protected]:314 [E] _ten section is not found in the property, skip.
11-12 08:58:25.649 58417(6963) D [email protected]:792 [E] on_init().
11-12 08:58:25.649 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [E] on_init() done.
11-12 08:58:25.649 58417(6963) I [email protected]:806 [E] on_start().
11-12 08:58:25.649 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [E] on_start() done.
11-12 08:58:25.649 58417(6963) D [email protected]:922 [F] Load metadata.
11-12 08:58:25.649 58417(6963) D [email protected]:767 [F] on_configure().
11-12 08:58:25.649 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [F] on_configure() done.
11-12 08:58:25.649 58417(6963) I [email protected]:314 [F] _ten section is not found in the property, skip.
11-12 08:58:25.649 58417(6963) D [email protected]:792 [F] on_init().
11-12 08:58:25.649 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [F] on_init() done.
11-12 08:58:25.649 58417(6963) I [email protected]:806 [F] on_start().
11-12 08:58:25.649 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [F] on_start() done.
11-12 08:58:25.649 58417(6963) D [email protected]:922 [G] Load metadata.
11-12 08:58:25.649 58417(6963) D [email protected]:767 [G] on_configure().
11-12 08:58:25.649 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [G] on_configure() done.
11-12 08:58:25.649 58417(6963) I [email protected]:314 [G] _ten section is not found in the property, skip.
11-12 08:58:25.649 58417(6963) D [email protected]:792 [G] on_init().
11-12 08:58:25.649 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [G] on_init() done.
11-12 08:58:25.649 58417(6963) I [email protected]:806 [G] on_start().
11-12 08:58:25.649 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [G] on_start() done.
11-12 08:58:25.649 58417(6963) D [email protected]:922 [H] Load metadata.
11-12 08:58:25.649 58417(6963) D [email protected]:767 [H] on_configure().
11-12 08:58:25.649 58417(6963) D ten_extension_on_configure_done@on_xxx.c:88 [H] on_configure() done.
11-12 08:58:25.649 58417(6963) I [email protected]:314 [H] _ten section is not found in the property, skip.
11-12 08:58:25.649 58417(6963) D [email protected]:792 [H] on_init().
11-12 08:58:25.649 58417(6963) D ten_extension_on_init_done@on_xxx.c:176 [H] on_init() done.
11-12 08:58:25.649 58417(6963) I [email protected]:806 [H] on_start().
11-12 08:58:25.649 58417(6963) I ten_extension_on_start_done@on_xxx.c:235 [H] on_start() done.
11-12 08:58:25.671 58417(259) D [email protected]:75 Close tcp client: 127.0.0.1:49475
11-12 08:58:25.671 58417(7243) D [email protected]:154 Try to close communication protocol: 1fbde5f6-5f0c-4fd0-aaeb-4a267c85ffc2
11-12 08:58:25.671 58417(7243) D [email protected]:66 Close integrated protocol.
11-12 08:58:25.671 58417(7243) D [email protected]:86 Close base protocol.
11-12 08:58:25.671 58417(7243) D [email protected]:133 Try to close connection.
11-12 08:58:25.671 58417(7243) D [email protected]:121 Close connection.
11-12 08:58:25.671 58417(7243) D [email protected]:229 Try to close remote (1fbde5f6-5f0c-4fd0-aaeb-4a267c85ffc2)
11-12 08:58:25.671 58417(7243) D [email protected]:105 Remote (1fbde5f6-5f0c-4fd0-aaeb-4a267c85ffc2) can be closed now.
11-12 08:58:25.671 58417(7243) D [email protected]:32 [msgpack://127.0.0.1:8001/] Try to close engine.
11-12 08:58:25.671 58417(7243) D ten_extension_context_close@extension_context.c:159 [9cfa36aa-6900-4269-875a-8447b88dd946] Try to close extension context.
11-12 08:58:25.671 58417(7243) D ten_extension_thread_close@extension_thread.c:349 Try to close extension thread.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [A] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [A] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [B] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [B] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [C] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [C] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [D] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [D] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [E] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [E] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [F] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [F] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [G] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [G] on_stop() done.
11-12 08:58:25.671 58417(6963) I [email protected]:822 [H] on_stop().
11-12 08:58:25.671 58417(6963) I ten_extension_on_stop_done@on_xxx.c:252 [H] on_stop() done.
11-12 08:58:25.672 58417(6963) D [email protected]:836 [H] on_deinit().
11-12 08:58:25.672 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [H] on_deinit() done.
11-12 08:58:25.672 58417(6963) D ten_env_close@ten_env.c:169 [H] Close ten of extension.
11-12 08:58:25.672 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [H] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.672 58417(6963) D [email protected]:836 [G] on_deinit().
11-12 08:58:25.672 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [G] on_deinit() done.
[ OK ] ExtensionTest.GraphMultiplePolygonOneApp (118 ms)
11-12 08:58:25.672 58417(6963) D ten_env_close@ten_env.c:169 [G] Close ten of extension.
[ RUN ] ExtensionTest.GraphMultiplePolygon
11-12 08:58:25.672 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [G] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.672 58417(6963) D [email protected]:836 [F] on_deinit().
11-12 08:58:25.672 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [F] on_deinit() done.
11-12 08:58:25.672 58417(6963) D ten_env_close@ten_env.c:169 [F] Close ten of extension.
11-12 08:58:25.672 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [F] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.672 58417(6963) D [email protected]:836 [E] on_deinit().
11-12 08:58:25.672 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [E] on_deinit() done.
11-12 08:58:25.672 58417(6963) D ten_env_close@ten_env.c:169 [E] Close ten of extension.
11-12 08:58:25.672 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [E] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.673 58417(6963) D [email protected]:836 [D] on_deinit().
11-12 08:58:25.673 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [D] on_deinit() done.
11-12 08:58:25.673 58417(6963) D ten_env_close@ten_env.c:169 [D] Close ten of extension.
11-12 08:58:25.673 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [D] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.673 58417(6963) D [email protected]:836 [C] on_deinit().
11-12 08:58:25.673 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [C] on_deinit() done.
11-12 08:58:25.673 58417(6963) D ten_env_close@ten_env.c:169 [C] Close ten of extension.
11-12 08:58:25.673 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [C] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.673 58417(6963) D [email protected]:836 [B] on_deinit().
11-12 08:58:25.673 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [B] on_deinit() done.
11-12 08:58:25.673 58417(6963) D ten_env_close@ten_env.c:169 [B] Close ten of extension.
11-12 08:58:25.673 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [B] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.673 58417(6963) D [email protected]:836 [A] on_deinit().
11-12 08:58:25.673 58417(6963) D ten_extension_on_deinit_done@on_xxx.c:332 [A] on_deinit() done.
11-12 08:58:25.673 58417(6963) D ten_env_close@ten_env.c:169 [A] Close ten of extension.
11-12 08:58:25.673 58417(6963) D ten_extension_thread_del_extension@on_xxx.c:272 [A] Deleted from extension thread (graph_multiple_polygon_one_app__extension_group).
11-12 08:58:25.673 58417(6963) D ten_extension_group_destroy_extensions@extension_group.c:196 [graph_multiple_polygon_one_app__extension_group] destroy_extensions.
11-12 08:58:25.674 58417(6963) D ten_extension_group_on_destroy_extensions_done@on_xxx.c:166 [graph_multiple_polygon_one_app__extension_group] destroy_extensions() done.
11-12 08:58:25.674 58417(6963) D ten_extension_group_on_deinit_done@on_xxx.c:116 [graph_multiple_polygon_one_app__extension_group] on_deinit() done.
11-12 08:58:25.674 58417(6963) D ten_env_close@ten_env.c:165 [graph_multiple_polygon_one_app__extension_group] Close ten of extension group.
11-12 08:58:25.674 58417(6963) D ten_extension_thread_main_actual@extension_thread.c:266 Extension thread is stopped.
11-12 08:58:25.674 58417(7243) D ten_engine_on_extension_thread_closed@on_xxx.c:172 [9cfa36aa-6900-4269-875a-8447b88dd946] Waiting for extension thread (0x600000a4c000) be reclaimed.
11-12 08:58:25.674 58417(7243) D ten_engine_on_extension_thread_closed@on_xxx.c:179 [9cfa36aa-6900-4269-875a-8447b88dd946] Extension thread (0x600000a4c000) is reclaimed.
11-12 08:58:25.674 58417(7243) D ten_extension_context_on_close@extension_context.c:244 [9cfa36aa-6900-4269-875a-8447b88dd946] Close extension context.
11-12 08:58:25.674 58417(7243) D ten_env_close@ten_env.c:160 [9cfa36aa-6900-4269-875a-8447b88dd946] Close ten of engine.
11-12 08:58:25.674 58417(7243) D [email protected]:197 [msgpack://127.0.0.1:8001/] engine liveness: 0 remotes, 0 timers, extension_context 0x0
11-12 08:58:25.674 58417(7243) D [email protected]:234 Close engine.
11-12 08:58:25.674 58417(7243) D ten_app_del_engine@engine_interface.c:99 [msgpack://127.0.0.1:8001/] Remove engine from app.
11-12 08:58:25.674 58417(7243) D [email protected]:113 [msgpack://127.0.0.1:8001/] Try to close app.
11-12 08:58:25.674 58417(7243) D [email protected]:55 [msgpack://127.0.0.1:8001/] Could not close alive app.
11-12 08:58:25.675 58417(7243) D [email protected]:66 [msgpack://127.0.0.1:8001/] Try to close app.
11-12 08:58:25.675 58417(7243) D [email protected]:147 Try to close listening protocol: msgpack://127.0.0.1:8001/
11-12 08:58:25.675 58417(7243) D [email protected]:55 [msgpack://127.0.0.1:8001/] Could not close alive app.
11-12 08:58:25.675 58417(7243) D [email protected]:66 Close integrated protocol.
11-12 08:58:25.675 58417(7243) D [email protected]:86 Close base protocol.
11-12 08:58:25.675 58417(7243) D [email protected]:58 [msgpack://127.0.0.1:8001/] Close app.
11-12 08:58:25.675 58417(7243) D ten_app_on_deinit_done@on_xxx.c:277 app::on_deinit_done().
11-12 08:58:25.675 58417(7243) D ten_env_close@ten_env.c:156 [msgpack://127.0.0.1:8001/] Close ten of app.
11-12 08:58:25.676 58417(7243) D [email protected]:64 TEN app runloop ends.
11-12 08:58:25.676 58417(7243) D [email protected]:148 [msgpack://127.0.0.1:8001/] Destroy a App
11-12 08:58:25.676 58417(7247) I [email protected]:70 [] App is created.
11-12 08:58:25.676 58417(6967) I [email protected]:70 [] App is created.
11-12 08:58:25.676 58417(7483) I [email protected]:70 [] App is created.
11-12 08:58:25.678 58417(7247) W ten_find_app_base_dir@base_dir.c:52 Could not get app home from module path, using TEN_APP_BASE_DIR instead.
11-12 08:58:25.678 58417(7247) D ten_app_find_and_set_base_dir@base_dir.c:64 Failed to determine app base directory.
11-12 08:58:25.679 58417(6967) W ten_find_app_base_dir@base_dir.c:52 Could not get app home from module path, using TEN_APP_BASE_DIR instead.
11-12 08:58:25.679 58417(6967) D ten_app_find_and_set_base_dir@base_dir.c:64 Failed to determine app base directory.
11-12 08:58:25.679 58417(7483) W ten_find_app_base_dir@base_dir.c:52 Could not get app home from module path, using TEN_APP_BASE_DIR instead.
11-12 08:58:25.679 58417(7483) D ten_app_find_and_set_base_dir@base_dir.c:64 Failed to determine app base directory.
11-12 08:58:25.680 58417(7247) I [email protected]:25 Skip the loading of manifest.json because the base_dir of is missing.
11-12 08:58:25.680 58417(6967) I [email protected]:25 Skip the loading of manifest.json because the base_dir of is missing.
11-12 08:58:25.680 58417(7483) I [email protected]:25 Skip the loading of manifest.json because the base_dir of is missing.
11-12 08:58:25.681 58417(7247) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:25.681 58417(6967) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:25.681 58417(6967) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:25.681 58417(7483) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:25.681 58417(7483) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:25.681 58417(7247) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:25.681 58417(7483) I ten_protocol_integrated_listen@protocol_integrated.c:386 tcp://127.0.0.1:8001/ start listening.
11-12 08:58:25.681 58417(6967) I ten_protocol_integrated_listen@protocol_integrated.c:386 tcp://127.0.0.1:8002/ start listening.
11-12 08:58:25.681 58417(7247) I ten_protocol_integrated_listen@protocol_integrated.c:386 tcp://127.0.0.1:8003/ start listening.
11-12 08:58:26.012 58417(7483) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:26.012 58417(7483) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.012 58417(7483) D [email protected]:28 [msgpack://127.0.0.1:8001/] A client is connected.
11-12 08:58:26.012 58417(7483) D [email protected]:195 Create a connection 0x600001656140
11-12 08:58:26.012 58417(7483) D [email protected]:75 [msgpack://127.0.0.1:8001/] Add a orphan connection 0x600001656140 (total cnt 0)
11-12 08:58:26.012 58417(7483) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:26.037 58417(7483) D [email protected]:35 The base dir of app [msgpack://127.0.0.1:8001/] is not set, skip checking graph.
11-12 08:58:26.037 58417(7483) D ten_app_create_engine@engine_interface.c:84 [msgpack://127.0.0.1:8001/] App creates an engine.
11-12 08:58:26.037 58417(7483) D [email protected]:167 Create engine.
11-12 08:58:26.037 58417(7483) D [email protected]:100 [msgpack://127.0.0.1:8001/] Remove a orphan connection 0x600001656140
11-12 08:58:26.038 58417(7483) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'd6e61684-a2f4-45e8-bdc1-0fa146eedb1b' is not in 'weak_remotes' list.
11-12 08:58:26.038 58417(7483) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8001/] Add d6e61684-a2f4-45e8-bdc1-0fa146eedb1b (0x7f7f17840000) as remote.
11-12 08:58:26.038 58417(7483) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8002/.
11-12 08:58:26.038 58417(7483) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8002/' is not in 'weak_remotes' list.
11-12 08:58:26.038 58417(7483) D ten_engine_handle_cmd_start_graph@start_graph.c:72 msgpack://127.0.0.1:8002/ is unconnected, connect now.
11-12 08:58:26.039 58417(7483) D ten_engine_connect_to_graph_remote@remote_interface.c:379 Trying to connect to msgpack://127.0.0.1:8002/ inside graph.
11-12 08:58:26.039 58417(7483) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:26.040 58417(7483) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.040 58417(7483) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8003/.
11-12 08:58:26.040 58417(7483) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8003/' is not in 'weak_remotes' list.
11-12 08:58:26.040 58417(7483) D ten_engine_handle_cmd_start_graph@start_graph.c:72 msgpack://127.0.0.1:8003/ is unconnected, connect now.
11-12 08:58:26.041 58417(7483) D ten_engine_connect_to_graph_remote@remote_interface.c:379 Trying to connect to msgpack://127.0.0.1:8003/ inside graph.
11-12 08:58:26.041 58417(7483) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:26.041 58417(7483) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.041 58417(7483) D ten_engine_handle_cmd_start_graph@start_graph.c:139 Create a IN path for the receiving 'start_graph' command: d6e61684-a2f4-45e8-bdc1-0fa146eedb1b.
11-12 08:58:26.041 58417(7483) D [email protected]:195 Create a connection 0x60000164bc60
11-12 08:58:26.041 58417(7483) D ten_engine_add_weak_remote@remote_interface.c:155 [msgpack://127.0.0.1:8001/] Add msgpack://127.0.0.1:8002/ (0x7f7f17868800) as weak remote.
11-12 08:58:26.042 58417(7483) D [email protected]:195 Create a connection 0x60000164bbf0
11-12 08:58:26.042 58417(7483) D ten_engine_add_weak_remote@remote_interface.c:155 [msgpack://127.0.0.1:8001/] Add msgpack://127.0.0.1:8003/ (0x7f7f17869000) as weak remote.
11-12 08:58:26.042 58417(6967) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:26.042 58417(6967) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.042 58417(6967) D [email protected]:28 [msgpack://127.0.0.1:8002/] A client is connected.
11-12 08:58:26.042 58417(6967) D [email protected]:195 Create a connection 0x600001651420
11-12 08:58:26.042 58417(6967) D [email protected]:75 [msgpack://127.0.0.1:8002/] Add a orphan connection 0x600001651420 (total cnt 0)
11-12 08:58:26.042 58417(6967) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:26.042 58417(7483) D [email protected]:301 Connected to remote (msgpack://127.0.0.1:8002/)
11-12 08:58:26.043 58417(7483) D [email protected]:301 Connected to remote (msgpack://127.0.0.1:8003/)
11-12 08:58:26.043 58417(7247) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:26.043 58417(7247) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.043 58417(7247) D [email protected]:28 [msgpack://127.0.0.1:8003/] A client is connected.
11-12 08:58:26.043 58417(7247) D [email protected]:195 Create a connection 0x600001644d90
11-12 08:58:26.043 58417(7247) D [email protected]:75 [msgpack://127.0.0.1:8003/] Add a orphan connection 0x600001644d90 (total cnt 0)
11-12 08:58:26.043 58417(7247) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:26.064 58417(6967) D [email protected]:35 The base dir of app [msgpack://127.0.0.1:8002/] is not set, skip checking graph.
11-12 08:58:26.064 58417(6967) D ten_app_create_engine@engine_interface.c:84 [msgpack://127.0.0.1:8002/] App creates an engine.
11-12 08:58:26.064 58417(6967) D [email protected]:167 Create engine.
11-12 08:58:26.064 58417(6967) D [email protected]:124 [a6307611-5e52-48f4-bf09-5beb1ecd904a] Inherit engine's name from previous node.
11-12 08:58:26.064 58417(6967) D [email protected]:100 [msgpack://127.0.0.1:8002/] Remove a orphan connection 0x600001651420
11-12 08:58:26.064 58417(6967) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8001/' is not in 'weak_remotes' list.
11-12 08:58:26.064 58417(6967) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8002/] Add msgpack://127.0.0.1:8001/ (0x7f7f1785c600) as remote.
11-12 08:58:26.065 58417(6967) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8001/.
11-12 08:58:26.065 58417(6967) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f1785c600 for uri 'msgpack://127.0.0.1:8001/' is found in 'remotes' list.
11-12 08:58:26.065 58417(6967) D ten_engine_handle_cmd_start_graph@start_graph.c:110 msgpack://127.0.0.1:8001/ is connected, there is nothing to do.
11-12 08:58:26.065 58417(6967) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8003/.
11-12 08:58:26.065 58417(6967) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8003/' is not in 'weak_remotes' list.
11-12 08:58:26.065 58417(6967) D ten_engine_handle_cmd_start_graph@start_graph.c:72 msgpack://127.0.0.1:8003/ is unconnected, connect now.
11-12 08:58:26.066 58417(6967) D ten_engine_connect_to_graph_remote@remote_interface.c:379 Trying to connect to msgpack://127.0.0.1:8003/ inside graph.
11-12 08:58:26.066 58417(6967) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:26.066 58417(6967) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.066 58417(6967) D ten_engine_handle_cmd_start_graph@start_graph.c:139 Create a IN path for the receiving 'start_graph' command: 79b4b0dd-a0cc-4709-b970-ec1caedf29c0.
11-12 08:58:26.066 58417(6967) D [email protected]:195 Create a connection 0x60000164b9c0
11-12 08:58:26.066 58417(6967) D ten_engine_add_weak_remote@remote_interface.c:155 [msgpack://127.0.0.1:8002/] Add msgpack://127.0.0.1:8003/ (0x7f7f1785bc00) as weak remote.
11-12 08:58:26.067 58417(6967) D [email protected]:301 Connected to remote (msgpack://127.0.0.1:8003/)
11-12 08:58:26.067 58417(7247) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:26.067 58417(7247) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.068 58417(7247) D [email protected]:28 [msgpack://127.0.0.1:8003/] A client is connected.
11-12 08:58:26.068 58417(7247) D [email protected]:195 Create a connection 0x60000164b870
11-12 08:58:26.068 58417(7247) D [email protected]:75 [msgpack://127.0.0.1:8003/] Add a orphan connection 0x60000164b870 (total cnt 1)
11-12 08:58:26.068 58417(7247) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:26.089 58417(7247) D [email protected]:35 The base dir of app [msgpack://127.0.0.1:8003/] is not set, skip checking graph.
11-12 08:58:26.089 58417(7247) D ten_app_create_engine@engine_interface.c:84 [msgpack://127.0.0.1:8003/] App creates an engine.
11-12 08:58:26.089 58417(7247) D [email protected]:167 Create engine.
11-12 08:58:26.089 58417(7247) D [email protected]:124 [a6307611-5e52-48f4-bf09-5beb1ecd904a] Inherit engine's name from previous node.
11-12 08:58:26.089 58417(7247) D [email protected]:100 [msgpack://127.0.0.1:8003/] Remove a orphan connection 0x60000164b870
11-12 08:58:26.094 58417(7247) D [email protected]:100 [msgpack://127.0.0.1:8003/] Remove a orphan connection 0x600001644d90
11-12 08:58:26.094 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8002/' is not in 'weak_remotes' list.
11-12 08:58:26.094 58417(7247) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8003/] Add msgpack://127.0.0.1:8002/ (0x7f7f16814800) as remote.
11-12 08:58:26.094 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8001/.
11-12 08:58:26.094 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8001/' is not in 'weak_remotes' list.
11-12 08:58:26.094 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:72 msgpack://127.0.0.1:8001/ is unconnected, connect now.
11-12 08:58:26.095 58417(7247) D ten_engine_connect_to_graph_remote@remote_interface.c:379 Trying to connect to msgpack://127.0.0.1:8001/ inside graph.
11-12 08:58:26.095 58417(7247) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:26.095 58417(7247) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8002/.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f16814800 for uri 'msgpack://127.0.0.1:8002/' is found in 'remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:110 msgpack://127.0.0.1:8002/ is connected, there is nothing to do.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:139 Create a IN path for the receiving 'start_graph' command: 8af22249-ed2f-48e0-8039-f6b60a654c50.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8001/' is not in 'weak_remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8003/] Add msgpack://127.0.0.1:8001/ (0x7f7f1682aa00) as remote.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8001/.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f1682aa00 for uri 'msgpack://127.0.0.1:8001/' is found in 'remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:110 msgpack://127.0.0.1:8001/ is connected, there is nothing to do.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8002/.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f16814800 for uri 'msgpack://127.0.0.1:8002/' is found in 'remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:110 msgpack://127.0.0.1:8002/ is connected, there is nothing to do.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:144 No more new connections should be made, enable the extension system now.
11-12 08:58:26.095 58417(7247) D ten_extension_context_create@extension_context.c:61 [a6307611-5e52-48f4-bf09-5beb1ecd904a] Create Extension context.
11-12 08:58:26.095 58417(7247) D [email protected]:404 Try to find addon for default_extension_group
11-12 08:58:26.096 58417(7247) D [email protected]:195 Create a connection 0x600001644b60
11-12 08:58:26.096 58417(7247) D ten_engine_add_weak_remote@remote_interface.c:155 [msgpack://127.0.0.1:8003/] Add msgpack://127.0.0.1:8001/ (0x7f7f1682c400) as weak remote.
11-12 08:58:26.096 58417(7483) D [email protected]:254 Loading protocol addon: msgpack
11-12 08:58:26.096 58417(7483) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.096 58417(7483) D [email protected]:28 [msgpack://127.0.0.1:8001/] A client is connected.
11-12 08:58:26.096 58417(7483) D [email protected]:195 Create a connection 0x600001656370
11-12 08:58:26.096 58417(7483) D [email protected]:75 [msgpack://127.0.0.1:8001/] Add a orphan connection 0x600001656370 (total cnt 0)
11-12 08:58:26.096 58417(7483) D ten_app_thread_on_client_protocol_created@protocol_integrated.c:320 Start read from stream
11-12 08:58:26.096 58417(3647) D ten_extension_thread_main_actual@extension_thread.c:238 Extension thread is started
11-12 08:58:26.096 58417(3647) D [email protected]:24 [graph_multiple_polygon_3] Load metadata.
11-12 08:58:26.096 58417(3647) D ten_extension_group_on_init_done@on_xxx.c:75 [graph_multiple_polygon_3] on_init() done.
11-12 08:58:26.096 58417(7247) D [email protected]:301 Connected to remote (msgpack://127.0.0.1:8001/)
11-12 08:58:26.097 58417(3647) I [email protected]:25 Skip the loading of manifest.json because the base_dir of graph_multiple_polygon_3 is missing.
11-12 08:58:26.097 58417(3647) I [email protected]:51 Skip the loading of property.json because the base_dir of graph_multiple_polygon_3 is missing.
11-12 08:58:26.097 58417(3647) D ten_extension_group_create_extensions@extension_group.c:174 [graph_multiple_polygon_3] create_extensions.
11-12 08:58:26.097 58417(3647) D [email protected]:404 Try to find addon for graph_multiple_polygon__extension
11-12 08:58:26.097 58417(3647) D [email protected]:404 Try to find addon for graph_multiple_polygon__extension
11-12 08:58:26.097 58417(3647) D ten_extension_group_on_create_extensions_done@on_xxx.c:138 [graph_multiple_polygon_3] create_extensions() done.
11-12 08:58:26.103 58417(7247) D ten_engine_on_extension_thread_is_ready@on_xxx.c:53 [a6307611-5e52-48f4-bf09-5beb1ecd904a] All extension threads are initted.
11-12 08:58:26.103 58417(7247) D ten_engine_on_extension_thread_is_ready@on_xxx.c:95 [a6307611-5e52-48f4-bf09-5beb1ecd904a] Engine is ready to handle messages.
11-12 08:58:26.103 58417(3647) D [email protected]:922 [F] Load metadata.
11-12 08:58:26.103 58417(3647) D [email protected]:767 [F] on_configure().
11-12 08:58:26.103 58417(3647) D ten_extension_on_configure_done@on_xxx.c:88 [F] on_configure() done.
11-12 08:58:26.104 58417(3647) I [email protected]:314 [F] _ten section is not found in the property, skip.
11-12 08:58:26.104 58417(3647) D [email protected]:792 [F] on_init().
11-12 08:58:26.104 58417(3647) D ten_extension_on_init_done@on_xxx.c:176 [F] on_init() done.
11-12 08:58:26.104 58417(3647) I [email protected]:806 [F] on_start().
11-12 08:58:26.104 58417(3647) I ten_extension_on_start_done@on_xxx.c:235 [F] on_start() done.
11-12 08:58:26.104 58417(3647) D [email protected]:922 [H] Load metadata.
11-12 08:58:26.104 58417(3647) D [email protected]:767 [H] on_configure().
11-12 08:58:26.104 58417(3647) D ten_extension_on_configure_done@on_xxx.c:88 [H] on_configure() done.
11-12 08:58:26.104 58417(3647) I [email protected]:314 [H] _ten section is not found in the property, skip.
11-12 08:58:26.104 58417(3647) D [email protected]:792 [H] on_init().
11-12 08:58:26.104 58417(3647) D ten_extension_on_init_done@on_xxx.c:176 [H] on_init() done.
11-12 08:58:26.104 58417(3647) I [email protected]:806 [H] on_start().
11-12 08:58:26.104 58417(3647) I ten_extension_on_start_done@on_xxx.c:235 [H] on_start() done.
11-12 08:58:26.109 58417(7483) D [email protected]:100 [msgpack://127.0.0.1:8001/] Remove a orphan connection 0x600001656370
11-12 08:58:26.109 58417(7483) D ten_engine_check_remote_is_weak@remote_interface.c:499 remote 0x7f7f17869000 is weak.
11-12 08:58:26.110 58417(7483) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8001/] Add msgpack://127.0.0.1:8003/ (0x7f7f17869000) as remote.
11-12 08:58:26.110 58417(7483) D ten_engine_handle_cmd_result_for_cmd_start_graph@cmd_result.c:126 The 'start_graph' flow is not completed, skip the cmd_result now.
11-12 08:58:26.110 58417(7483) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f17869000 for uri 'msgpack://127.0.0.1:8003/' is found in 'remotes' list.
11-12 08:58:26.110 58417(7483) W ten_engine_check_remote_is_duplicated@remote_interface.c:474 Found a remote msgpack://127.0.0.1:8003/ (0x7f7f17869000), checking duplication...
11-12 08:58:26.110 58417(7483) W ten_engine_check_remote_is_duplicated@remote_interface.c:481 > Remote msgpack://127.0.0.1:8003/ (0x7f7f17869000) is larger, keep this channel.
The relationship of remote and connection should be 1-1 mapping.
11-12 08:58:26.110 58417(7483) E [email protected]:62 0 libten_utils.dylib 0x0000000107b5c389 ten_backtrace_dump + 57
11-12 08:58:26.110 58417(7483) E [email protected]:62 1 libten_runtime.dylib 0x00000001085b6f7a ten_engine_link_connection_to_remote.cold.4 + 58
11-12 08:58:26.110 58417(7483) E [email protected]:62 2 libten_runtime.dylib 0x00000001082b00c5 ten_engine_link_connection_to_remote + 325
11-12 08:58:26.110 58417(7483) E [email protected]:62 3 libten_runtime.dylib 0x00000001082b2333 ten_engine_handle_in_msgs_task + 531
11-12 08:58:26.110 58417(7483) E [email protected]:62 4 libten_utils.dylib 0x0000000107b2db2c flush_remaining_tasks + 220
11-12 08:58:26.110 58417(7483) E [email protected]:62 5 libten_utils.dylib 0x0000000107b64741 uv__async_io + 289
11-12 08:58:26.110 58417(7483) E [email protected]:62 6 libten_utils.dylib 0x0000000107b6a9f0 uv__io_poll + 1200
11-12 08:58:26.110 58417(7483) E [email protected]:62 7 libten_utils.dylib 0x0000000107b64a71 uv_run + 369
11-12 08:58:26.110 58417(7483) E [email protected]:62 8 libten_utils.dylib 0x0000000107b2f648 ten_runloop_uv_run + 120
11-12 08:58:26.110 58417(7483) E [email protected]:62 9 libten_utils.dylib 0x0000000107b2cc38 ten_runloop_run + 232
11-12 08:58:26.110 58417(7483) E [email protected]:62 10 libten_runtime.dylib 0x000000010827d04b ten_app_start + 123
11-12 08:58:26.110 58417(7483) E [email protected]:62 11 libten_runtime.dylib 0x0000000108280900 ten_app_routine + 240
11-12 08:58:26.110 58417(7483) E [email protected]:62 12 libten_runtime.dylib 0x00000001082807c2 ten_app_run + 162
11-12 08:58:26.110 58417(7483) E [email protected]:62 13 ten_runtime_smoke_test 0x0000000107478946 _ZN12_GLOBAL__N_117app_thread_1_mainEPv + 70
11-12 08:58:26.110 58417(7483) E [email protected]:62 14 libten_utils.dylib 0x0000000107b35592 pthread_routine + 194
11-12 08:58:26.110 58417(7483) E [email protected]:62 15 libsystem_pthread.dylib 0x00007ff8195c71d3 _pthread_start + 125
11-12 08:58:26.110 58417(7483) E [email protected]:62 16 libsystem_pthread.dylib 0x00007ff8195c2bd3 thread_start + 15
/Users/runner/work/_temp/5fca9ffa-7011-447f-b4d3-ebe4aa69db9c.sh: line 2: 58417 Abort trap: 6 out/mac/x64/tests/standalone/ten_runtime_smoke_test

[sunxilin]

根据日志分析，基本找到了出错的环节，核心原因是在 remote_t 的创建异步化之后，创建完成加入engine remote列表并且connect to remote之前没有做判断，因为可能此时engine内可能已存在了和远端的连接。

为什么 GraphMultiplePolygon 这个test case会跑出来错误？
原因就是由于 8001, 8002 app均在graph中有连到8003， 所以如果8002的start_graph command 先到8003的话，8003就会创建remote去和8001建连，但在remote创建的过程中，8001发到8003的start_graph command 被收到了，于是对于 8001 就出现了同一个remote建立了两个连接的错误。

解决办法：
在每次remote试图加入到engine remote list之前，都要去判断是否duplicated，发现重复的话就不需要建连。因为全部发生在engine thread，所以是线程安全的。

[sunxilin]

核心日志是这一段，全部都是8003的app thread， 在连接到 8001 的remote创建过程中，收到了来自8001的start_graph cmd, 所以能看到连向同一个远端的两个remote对象都被加入到了remote list里：

11-12 08:58:26.094 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8001/.
11-12 08:58:26.094 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8001/' is not in 'weak_remotes' list.
11-12 08:58:26.094 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:72 msgpack://127.0.0.1:8001/ is unconnected, connect now.
11-12 08:58:26.095 58417(7247) D ten_engine_connect_to_graph_remote@remote_interface.c:379 Trying to connect to msgpack://127.0.0.1:8001/ inside graph.
11-12 08:58:26.095 58417(7247) D [email protected]:207 Loading protocol addon: msgpack
11-12 08:58:26.095 58417(7247) D [email protected]:404 Try to find addon for msgpack
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:139 Create a IN path for the receiving 'start_graph' command: 8af22249-ed2f-48e0-8039-f6b60a654c50.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:451 remote 0x0 for uri 'msgpack://127.0.0.1:8001/' is not in 'weak_remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_add_remote@remote_interface.c:138 [msgpack://127.0.0.1:8003/] Add msgpack://127.0.0.1:8001/ (0x7f7f1682aa00) as remote.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:66 Check if we have connected to msgpack://127.0.0.1:8001/.
11-12 08:58:26.095 58417(7247) D ten_engine_check_remote_is_existed@remote_interface.c:434 remote 0x7f7f1682aa00 for uri 'msgpack://127.0.0.1:8001/' is found in 'remotes' list.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:110 msgpack://127.0.0.1:8001/ is connected, there is nothing to do.
11-12 08:58:26.095 58417(7247) D ten_engine_handle_cmd_start_graph@start_graph.c:144 No more new connections should be made, enable the extension system now.
11-12 08:58:26.095 58417(7247) D ten_extension_context_create@extension_context.c:61 [a6307611-5e52-48f4-bf09-5beb1ecd904a] Create Extension context.
11-12 08:58:26.095 58417(7247) D [email protected]:404 Try to find addon for default_extension_group
11-12 08:58:26.096 58417(7247) D [email protected]:195 Create a connection 0x600001644b60
11-12 08:58:26.096 58417(7247) D ten_engine_add_weak_remote@remote_interface.c:155 [msgpack://127.0.0.1:8003/] Add msgpack://127.0.0.1:8001/ (0x7f7f1682c400) as weak remote.