BGP Convergence Performance and Scalability Cases #5098

selldinesh · 2022-02-09T02:34:41Z

Description of PR

Summary:BGP Convergence Performance and Scalability Cases
BGP Convergence Performance
BGP Scalability

Fixes # (issue)

Type of change

Bug fix
Testbed and Framework(new/improvement)
Test case(new/improvement)

Back port request

201911

Approach

What is the motivation for this PR?

How did you do it?

How did you verify/test it?

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

https://github.com//issues/3609

#3610

Get latest changes

lgtm-com · 2022-02-09T03:02:44Z

This pull request introduces 4 alerts when merging 2d56f9d into 1a6806c - view on LGTM.com

new alerts:

2 for Unused local variable
1 for Unused import
1 for Wrong number of arguments in a call

lgtm-com · 2022-02-11T22:24:14Z

This pull request introduces 4 alerts when merging 79092ff into 3acec36 - view on LGTM.com

new alerts:

2 for Unused local variable
1 for Unused import
1 for Wrong number of arguments in a call

selldinesh · 2022-05-31T20:27:18Z

/azpw run

azure-pipelines · 2022-05-31T20:27:23Z

Commenter does not have sufficient privileges for PR 5098 in repo Azure/sonic-mgmt

lgtm-com · 2022-06-14T22:24:45Z

This pull request introduces 1 alert when merging 7d33881 into fe8fee6 - view on LGTM.com

new alerts:

1 for Unused local variable

selldinesh · 2022-07-07T03:32:04Z

@wangxin can you please approve this PR

selldinesh · 2022-07-13T20:44:14Z

init._fi 05:26:24 init._fi 05:26:24 init._fi 05:26:26 init._fi 05:26:26 init._fi 05:26:26 init._fi 05:26:26 init._fi 05:26:26 init._fi 05:26:26 init._fi 05:26:33 init._fi data-hovercard-type="user" data-hovercard-url="/users/wangxin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wangxin">@wangxin
onvergence_performance.py
-----------------------------------------------+
Control to Data Plane Convergence Time (ms) |
-----------------------------------------------|
651 |
1310 |
1976 |
2807 |
3353 |
5766 |
4245 |
5694 |
6419 |
6533 |
8082 |
8697 |
9143 |
9427 |
10709 |
11088 |
12860 |
13001 |
13293 |
16353 |
16011 |
16206 |
16530 |
16955 |
16997 |
19952 |
17964 |
21480 |
20542 |
21422 |
23207 |
22245 |
-----------------------------------------------+
L0800 INFO | Wait until all critical services are fully started
L0802 INFO | Convergence Test Completed
[100%]
------------------------------------------------ live log teardown ----------------------------------------------------------------------------------
xture_generator_decorator L0083 INFO | -------------------- fixture cvg_api teardown starts --------------------
xture_generator_decorator L0092 INFO | -------------------- fixture cvg_api teardown ends --------------------
xture_generator_decorator L0083 INFO | -------------------- fixture start_pfcwd_after_test teardown starts --------------------
xture_generator_decorator L0092 INFO | -------------------- fixture start_pfcwd_after_test teardown ends --------------------
xture_generator_decorator L0083 INFO | -------------------- fixture rand_lossy_prio teardown starts --------------------
xture_generator_decorator L0092 INFO | -------------------- fixture rand_lossy_prio teardown ends --------------------
xture_generator_decorator L0083 INFO | -------------------- fixture rand_lossless_prio teardown starts --------------------
xture_generator_decorator L0092 INFO | -------------------- fixture rand_lossless_prio teardown ends --------------------
xture_generator_decorator L0083 INFO | -------------------- fixture enable_packet_aging_after_test teardown starts --------------------
xture_generator_decorator L0092 INFO | -------------------- fixture enable_packet_aging_after_test teardown ends --------------------

================================================================================== warnings summary ===================================================================================
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:538
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:538: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests.common.dualtor
self.import_plugin(import_spec)

snappi/bgp/test_bgp_convergence_performance.py::test_bgp_convergence_performance[IPv4-16500-500-500-2]
/usr/local/lib/python2.7/dist-packages/pytest_ansible-2.2.2-py2.7.egg/pytest_ansible/module_dispatcher/v28.py:70: UserWarning: provided hosts list is empty, only localhost is available
warnings.warn("provided hosts list is empty, only localhost is available")

-- Docs: https://docs.pytest.org/en/latest/warnings.html
------------------------------------------------------------------------------- live log sessionfinish --------------------------------------------------------------------------------
05:26:33 init.pytest_terminal_summary L0064 INFO | Can not get Allure report URL. Please check logs
=================== 1 passed, 2 warnings in 6715.13 seconds ====================
INFO:root:Can not get Allure report URL. Please check logs

selldinesh · 2022-07-14T00:15:46Z

@wangxin here is the log for test_ bgp_scalability.py
`============================= test session starts ==============================
platform linux2 -- Python 2.7.17, pytest-4.6.5, py-1.10.0, pluggy-0.13.1
ansible: 2.8.12
rootdir: /var/johnar/sonic-mgmt/tests, inifile: pytest.ini
plugins: html-1.22.1, xdist-1.28.0, forked-1.3.0, metadata-1.11.0, repeat-0.9.1, ansible-2.2.2

----------------------------- live log collection ------------------------------
20:52:58 init.load_dut_basic_facts L0101 INFO | Getting dut basic facts
20:53:01 init.pytest_collection_modifyitems L0305 INFO | Available basic facts that can be used in conditional skip:
{
"topo_type": "ptf",
"topo_name": "ptf64"
}

-------------------------------- live log setup --------------------------------
20:53:01 init.set_default L0049 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
20:53:01 init.check_test_completeness L0138 INFO | Test has no defined levels. Continue without test completeness checks
20:53:07 conftest.generate_params_dut_hostname L0915 INFO | Using DUTs ['sonic-s6100-dut'] in testbed 'vms-snappi-sonic'
20:53:07 conftest.rand_one_dut_hostname L0291 INFO | Randomly select dut sonic-s6100-dut for testing
20:53:07 conftest.creds_on_dut L0540 INFO | dut sonic-s6100-dut belongs to groups [u'snappi-sonic', u'sonic', u'sonic_dell64_40', 'fanout']
20:53:07 conftest.creds_on_dut L0563 INFO | skip empty var file ../ansible/group_vars/all/corefile_uploader.yml
20:53:07 conftest.creds_on_dut L0563 INFO | skip empty var file ../ansible/group_vars/all/env.yml
20:53:10 conftest.nbrhosts L0399 INFO | No VMs exist for this topology: ptf64
20:53:10 init.sanity_check L0106 INFO | Prepare sanity check
20:53:10 init.sanity_check L0142 INFO | Skip sanity check according to command line argument or configuration of test script.
20:53:10 init._fixture_generator_decorator L0071 INFO | -------------------- fixture enable_packet_aging_after_test setup starts --------------------
20:53:10 init._fixture_generator_decorator L0075 INFO | -------------------- fixture enable_packet_aging_after_test setup ends --------------------
20:53:10 init._fixture_generator_decorator L0071 INFO | -------------------- fixture rand_lossless_prio setup starts --------------------
20:53:10 init._fixture_generator_decorator L0075 INFO | -------------------- fixture rand_lossless_prio setup ends --------------------
20:53:10 init._fixture_generator_decorator L0071 INFO | -------------------- fixture rand_lossy_prio setup starts --------------------
20:53:10 init._fixture_generator_decorator L0075 INFO | -------------------- fixture rand_lossy_prio setup ends --------------------
20:53:10 init._fixture_generator_decorator L0071 INFO | -------------------- fixture start_pfcwd_after_test setup starts --------------------
20:53:10 init._fixture_generator_decorator L0075 INFO | -------------------- fixture start_pfcwd_after_test setup ends --------------------
20:53:10 init._fixture_func_decorator L0059 INFO | -------------------- fixture snappi_api_serv_ip setup starts --------------------
20:53:10 init._fixture_func_decorator L0066 INFO | -------------------- fixture snappi_api_serv_ip setup ends --------------------
20:53:10 init._fixture_func_decorator L0059 INFO | -------------------- fixture snappi_api_serv_port setup starts --------------------
20:53:10 init._fixture_func_decorator L0066 INFO | -------------------- fixture snappi_api_serv_port setup ends --------------------
20:53:10 init._fixture_generator_decorator L0071 INFO | -------------------- fixture cvg_api setup starts --------------------
20:53:10 init._fixture_generator_decorator L0075 INFO | -------------------- fixture cvg_api setup ends --------------------
20:53:11 init._fixture_func_decorator L0059 INFO | -------------------- fixture tgen_ports setup starts --------------------
20:53:12 init._fixture_func_decorator L0066 INFO | -------------------- fixture tgen_ports setup ends --------------------
20:53:12 init.loganalyzer L0048 INFO | Log analyzer is disabled
-------------------------------- live log call ---------------------------------
20:53:15 bgp_test_gap_helper.duthost_bgp_scalabil L0327 INFO | Removing configured IP and IPv6 Address from Ethernet72
20:53:16 bgp_test_gap_helper.duthost_bgp_scalabil L0327 INFO | Removing configured IP and IPv6 Address from Ethernet68
20:53:18 bgp_test_gap_helper.duthost_bgp_scalabil L0338 INFO | Configuring Ethernet72 to PortChannel2
20:53:21 bgp_test_gap_helper.duthost_bgp_scalabil L0338 INFO | Configuring Ethernet68 to PortChannel3
20:53:23 bgp_test_gap_helper.duthost_bgp_scalabil L0341 INFO | Configuring BGP in config_db.json
20:53:27 bgp_test_gap_helper.duthost_bgp_scalabil L0360 INFO | {u'FLEX_COUNTER_TABLE': {u'BUFFER_POOL_WATERMARK': {u'FLEX_COUNTER_STATUS': u'enable'}, u'PORT_BUFFER_DROP': {u'FLEX_COUNTER_STATUS': u'enable'}, u'QUEUE_WATERMARK': {u'FLEX_COUNTER_STATUS': u'enable'}, u'PFCWD': {u'FLEX_COUNTER_STATUS': u'enable'}, u'QUEUE': {u'FLEX_COUNTER_STATUS': u'enable'}, u'PG_WATERMARK': {u'FLEX_COUNTER_STATUS': u'enable'}, u'PG_DROP': {u'FLEX_COUNTER_STATUS': u'enable'}, u'RIF': {u'FLEX_COUNTER_STATUS': u'enable'}, u'PORT': {u'FLEX_COUNTER_STATUS': u'enable'}}, u'BGP_NEIGHBOR': {u'10.0.0.15': {u'rrclient': u'0', u'name': u'ARISTA08T2', u'local_addr': u'10.0.0.14', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.63': {u'rrclient': u'0', u'name': u'ARISTA16T0', u'local_addr': u'10.0.0.62', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64016', u'keepalive': u'60'}, u'21.1.1.2': {u'rrclient': u'0', u'name': u'ARISTA06T0', u'local_addr': u'21.1.1.1', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.41': {u'rrclient': u'0', u'name': u'ARISTA05T0', u'local_addr': u'10.0.0.40', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64005', u'keepalive': u'60'}, u'10.0.0.47': {u'rrclient': u'0', u'name': u'ARISTA08T0', u'local_addr': u'10.0.0.46', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64008', u'keepalive': u'60'}, u'10.0.0.45': {u'rrclient': u'0', u'name': u'ARISTA07T0', u'local_addr': u'10.0.0.44', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64007', u'keepalive': u'60'}, u'22.1.1.2': {u'rrclient': u'0', u'name': u'ARISTA08T0', u'local_addr': u'22.1.1.1', u'nhopself': u'0', u'holdtime': u'90', u'asn': 65200, u'keepalive': u'30'}, u'10.0.0.39': {u'rrclient': u'0', u'name': u'ARISTA04T0', u'local_addr': u'10.0.0.38', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64004', u'keepalive': u'60'}, u'10.0.0.33': {u'rrclient': u'0', u'name': u'ARISTA01T0', u'local_addr': u'10.0.0.32', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64001', u'keepalive': u'60'}, u'10.0.0.31': {u'rrclient': u'0', u'name': u'ARISTA16T2', u'local_addr': u'10.0.0.30', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.37': {u'rrclient': u'0', u'name': u'ARISTA03T0', u'local_addr': u'10.0.0.36', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64003', u'keepalive': u'60'}, u'10.0.0.35': {u'rrclient': u'0', u'name': u'ARISTA02T0', u'local_addr': u'10.0.0.34', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64002', u'keepalive': u'60'}, u'10.0.0.59': {u'rrclient': u'0', u'name': u'ARISTA14T0', u'local_addr': u'10.0.0.58', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64014', u'keepalive': u'60'}, u'10.0.0.17': {u'rrclient': u'0', u'name': u'ARISTA09T2', u'local_addr': u'10.0.0.16', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.11': {u'rrclient': u'0', u'name': u'ARISTA06T2', u'local_addr': u'10.0.0.10', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.13': {u'rrclient': u'0', u'name': u'ARISTA07T2', u'local_addr': u'10.0.0.12', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.51': {u'rrclient': u'0', u'name': u'ARISTA10T0', u'local_addr': u'10.0.0.50', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64010', u'keepalive': u'60'}, u'10.0.0.55': {u'rrclient': u'0', u'name': u'ARISTA12T0', u'local_addr': u'10.0.0.54', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64012', u'keepalive': u'60'}, u'10.0.0.53': {u'rrclient': u'0', u'name': u'ARISTA11T0', u'local_addr': u'10.0.0.52', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64011', u'keepalive': u'60'}, u'10.0.0.19': {u'rrclient': u'0', u'name': u'ARISTA10T2', u'local_addr': u'10.0.0.18', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.57': {u'rrclient': u'0', u'name': u'ARISTA13T0', u'local_addr': u'10.0.0.56', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'64013', u'keepalive': u'60'}, u'10.0.0.9': {u'rrclient': u'0', u'name': u'ARISTA05T2', u'local_addr': u'10.0.0.8', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'23.1.1.2': {u'rrclient': u'0', u'name': u'ARISTA09T0', u'local_addr': u'23.1.1.1', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.5': {u'rrclient': u'0', u'name': u'ARISTA03T2', u'local_addr': u'10.0.0.4', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.7': {u'rrclient': u'0', u'name': u'ARISTA04T2', u'local_addr': u'10.0.0.6', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.1': {u'rrclient': u'0', u'name': u'ARISTA01T2', u'local_addr': u'10.0.0.0', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.3': {u'rrclient': u'0', u'name': u'ARISTA02T2', u'local_addr': u'10.0.0.2', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.29': {u'rrclient': u'0', u'name': u'ARISTA15T2', u'local_addr': u'10.0.0.28', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.25': {u'rrclient': u'0', u'name': u'ARISTA13T2', u'local_addr': u'10.0.0.24', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.27': {u'rrclient': u'0', u'name': u'ARISTA14T2', u'local_addr': u'10.0.0.26', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'10.0.0.21': {u'rrclient': u'0', u'name': u'ARISTA11T2', u'local_addr': u'10.0.0.20', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}, u'2000:2::e': {u'rrclient': u'0', u'name': u'ARISTA08T0', u'local_addr': u'2000:2::1', u'nhopself': u'0', u'holdtime': u'90', u'asn': 65200, u'keepalive': u'30'}, u'10.0.0.23': {u'rrclient': u'0', u'name': u'ARISTA12T2', u'local_addr': u'10.0.0.22', u'nhopself': u'0', u'holdtime': u'180', u'asn': u'65200', u'keepalive': u'60'}}, u'VERSIONS': {u'DATABASE': {u'VERSION': u'version_2_0_0'}}, u'DEVICE_METADATA': {u'localhost': {u'hwsku': u'Mellanox-SN2700', u'default_bgp_status': u'up', u'hostname': u'sonic', u'platform': u'x86_64-mlnx_msn2700-r0', u'mac': u'50:6b:4b:8d:47:c0', u'default_pfcwd_status': u'enable', u'bgp_asn': 65100, u'buffer_model': u'traditional', u'type': u'LeafRouter'}}, u'PORTCHANNEL_INTERFACE': {u'PortChannel2|2000:3::1/124': {}, u'PortChannel2': {}, u'PortChannel3': {}, u'PortChannel3|22.1.1.1/24': {}, u'PortChannel2|23.1.1.1/24': {}, u'PortChannel3|2000:2::1/124': {}}, u'SNMP': {u'LOCATION': {u'Location': u'public'}}, u'FEATURE': {u'lldp': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'pmon': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'sflow': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'disabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'database': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'always_enabled', u'state': u'always_enabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'snmp': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'True'}, u'telemetry': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'True'}, u'mux': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'enabled', u'state': u'always_disabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'bgp': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'False', u'has_timer': u'False'}, u'radv': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'mgmt-framework': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'True'}, u'nat': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'disabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'teamd': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'always_enabled', u'has_global_scope': u'False', u'has_timer': u'False'}, u'dhcp_relay': {u'has_per_asic_scope': u'False', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'enabled', u'has_global_scope': u'True', u'has_timer': u'False'}, u'swss': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'always_enabled', u'has_global_scope': u'False', u'has_timer': u'False'}, u'syncd': {u'has_per_asic_scope': u'True', u'high_mem_alert': u'disabled', u'auto_restart': u'disabled', u'state': u'always_enabled', u'has_global_scope': u'False', u'has_timer': u'False'}}, u'PORT': {u'Ethernet8': {u'alias': u'etp3', u'admin_status': u'up', u'lanes': u'8,9,10,11', u'mtu': u'9100'}, u'Ethernet0': {u'alias': u'etp1', u'admin_status': u'up', u'lanes': u'0,1,2,3', u'mtu': u'9100'}, u'Ethernet4': {u'alias': u'etp2', u'admin_status': u'up', u'lanes': u'4,5,6,7', u'mtu': u'9100'}, u'Ethernet108': {u'alias': u'etp28', u'admin_status': u'up', u'lanes': u'108,109,110,111', u'mtu': u'9100'}, u'Ethernet100': {u'alias': u'etp26', u'admin_status': u'up', u'lanes': u'100,101,102,103', u'mtu': u'9100'}, u'Ethernet104': {u'alias': u'etp27', u'admin_status': u'up', u'lanes': u'104,105,106,107', u'mtu': u'9100'}, u'Ethernet96': {u'alias': u'etp25', u'admin_status': u'up', u'lanes': u'96,97,98,99', u'mtu': u'9100'}, u'Ethernet124': {u'alias': u'etp32', u'admin_status': u'up', u'lanes': u'124,125,126,127', u'mtu': u'9100'}, u'Ethernet92': {u'alias': u'etp24', u'admin_status': u'up', u'lanes': u'92,93,94,95', u'mtu': u'9100'}, u'Ethernet120': {u'alias': u'etp31', u'admin_status': u'up', u'lanes': u'120,121,122,123', u'mtu': u'9100'}, u'Ethernet52': {u'alias': u'etp14', u'admin_status': u'up', u'lanes': u'52,53,54,55', u'mtu': u'9100'}, u'Ethernet56': {u'alias': u'etp15', u'admin_status': u'up', u'lanes': u'56,57,58,59', u'mtu': u'9100'}, u'Ethernet76': {u'lanes': u'76,77,78,79', u'fec': u'rs', u'mtu': u'9100', u'alias': u'etp20', u'admin_status': u'up', u'speed': u'100000'}, u'Ethernet72': {u'lanes': u'72,73,74,75', u'fec': u'rs', u'mtu': u'9100', u'alias': u'etp19', u'admin_status': u'up', u'speed': u'100000'}, u'Ethernet32': {u'alias': u'etp9', u'admin_status': u'up', u'lanes': u'32,33,34,35', u'mtu': u'9100'}, u'Ethernet16': {u'alias': u'etp5', u'admin_status': u'up', u'lanes': u'16,17,18,19', u'mtu': u'9100'}, u'Ethernet36': {u'alias': u'etp10', u'admin_status': u'up', u'lanes': u'36,37,38,39', u'mtu': u'9100'}, u'Ethernet12': {u'alias': u'etp4', u'admin_status': u'up', u'lanes': u'12,13,14,15', u'mtu': u'9100'}, u'Ethernet28': {u'alias': u'etp8', u'admin_status': u'up', u'lanes': u'28,29,30,31', u'mtu': u'9100'}, u'Ethernet88': {u'alias': u'etp23', u'admin_status': u'up', u'lanes': u'88,89,90,91', u'mtu': u'9100'}, u'Ethernet24': {u'alias': u'etp7', u'admin_status': u'up', u'lanes': u'24,25,26,27', u'mtu': u'9100'}, u'Ethernet116': {u'alias': u'etp30', u'admin_status': u'up', u'lanes': u'116,117,118,119', u'mtu': u'9100'}, u'Ethernet80': {u'alias': u'etp21', u'admin_status': u'up', u'lanes': u'80,81,82,83', u'mtu': u'9100'}, u'Ethernet112': {u'alias': u'etp29', u'admin_status': u'up', u'lanes': u'112,113,114,115', u'mtu': u'9100'}, u'Ethernet84': {u'alias': u'etp22', u'admin_status': u'up', u'lanes': u'84,85,86,87', u'mtu': u'9100'}, u'Ethernet48': {u'alias': u'etp13', u'admin_status': u'up', u'lanes': u'48,49,50,51', u'mtu': u'9100'}, u'Ethernet44': {u'alias': u'etp12', u'admin_status': u'up', u'lanes': u'44,45,46,47', u'mtu': u'9100'}, u'Ethernet40': {u'alias': u'etp11', u'admin_status': u'up', u'lanes': u'40,41,42,43', u'mtu': u'9100'}, u'Ethernet64': {u'lanes': u'64,65,66,67', u'fec': u'rs', u'mtu': u'9100', u'alias': u'etp17', u'admin_status': u'up', u'speed': u'100000'}, u'Ethernet60': {u'alias': u'etp16', u'admin_status': u'up', u'lanes': u'60,61,62,63', u'mtu': u'9100'}, u'Ethernet20': {u'alias': u'etp6', u'admin_status': u'up', u'lanes': u'20,21,22,23', u'mtu': u'9100'}, u'Ethernet68': {u'lanes': u'68,69,70,71', u'fec': u'rs', u'mtu': u'9100', u'alias': u'etp18', u'admin_status': u'up', u'speed': u'100000'}}, u'PORTCHANNEL': {u'PortChannel2': {u'admin_status': u'up', u'mtu': u'9100'}, u'PortChannel3': {u'admin_status': u'up', u'mtu': u'9100'}}, u'TELEMETRY': {u'gnmi': {u'port': u'8080'}}, u'PORTCHANNEL_MEMBER': {u'PortChannel2|Ethernet72': {}, u'PortChannel3|Ethernet68': {}}, u'INTERFACE': {u'Ethernet8': {}, u'Ethernet96|10.0.0.48/31': {}, u'Ethernet20|10.0.0.10/31': {}, u'Ethernet56|10.0.0.28/31': {}, u'Ethernet104|10.0.0.52/31': {}, u'Ethernet0': {}, u'Ethernet64|2000:1::1/124': {}, u'Ethernet40|10.0.0.20/31': {}, u'Ethernet8|10.0.0.4/31': {}, u'Ethernet4': {}, u'Ethernet60|10.0.0.30/31': {}, u'Ethernet108': {}, u'Ethernet0|10.0.0.0/31': {}, u'Ethernet12|10.0.0.6/31': {}, u'Ethernet36|10.0.0.18/31': {}, u'Ethernet100|10.0.0.50/31': {}, u'Ethernet112|10.0.0.56/31': {}, u'Ethernet100': {}, u'Ethernet52|10.0.0.26/31': {}, u'Ethernet28|10.0.0.14/31': {}, u'Ethernet104': {}, u'Ethernet4|10.0.0.2/31': {}, u'Ethernet96': {}, u'Ethernet124': {}, u'Ethernet32|10.0.0.16/31': {}, u'Ethernet108|10.0.0.54/31': {}, u'Ethernet92': {}, u'Ethernet120': {}, u'Ethernet52': {}, u'Ethernet56': {}, u'Ethernet76': {}, u'Ethernet44|10.0.0.22/31': {}, u'Ethernet32': {}, u'Ethernet16': {}, u'Ethernet24|10.0.0.12/31': {}, u'Ethernet36': {}, u'Ethernet12': {}, u'Ethernet48|10.0.0.24/31': {}, u'Ethernet28': {}, u'Ethernet84|10.0.0.42/31': {}, u'Ethernet16|10.0.0.8/31': {}, u'Ethernet76|2000:4::1/124': {}, u'Ethernet88': {}, u'Ethernet116': {}, u'Ethernet80|10.0.0.40/31': {}, u'Ethernet80': {}, u'Ethernet112': {}, u'Ethernet84': {}, u'Ethernet64|21.1.1.1/24': {}, u'Ethernet76|24.1.1.1/24': {}, u'Ethernet48': {}, u'Ethernet44': {}, u'Ethernet120|10.0.0.60/31': {}, u'Ethernet124|10.0.0.62/31': {}, u'Ethernet40': {}, u'Ethernet92|10.0.0.46/31': {}, u'Ethernet64': {}, u'Ethernet60': {}, u'Ethernet88|10.0.0.44/31': {}, u'Ethernet20': {}, u'Ethernet24': {}, u'Ethernet116|10.0.0.58/31': {}}, u'SNMP_COMMUNITY': {u'public': {u'TYPE': u'RO'}}, u'LOOPBACK_INTERFACE': {u'Loopback0': {}, u'Loopback0|10.1.0.1/32': {}}, u'XCVRD_LOG': {u'Y_CABLE': {u'log_verbosity': u'notice'}}, u'KDUMP': {u'config': {u'enabled': u'false', u'num_dumps': u'3', u'memory': u'0M-2G:256M,2G-4G:320M,4G-8G:384M,8G-:448M'}}, u'MGMT_INTERFACE': {u'eth0|10.36.79.243/22': {}}, u'CRM': {u'Config': {u'acl_group_low_threshold': u'70', u'nexthop_group_threshold_type': u'percentage', u'fdb_entry_high_threshold': u'85', u'acl_entry_threshold_type': u'percentage', u'ipv6_neighbor_low_threshold': u'70', u'ipmc_entry_low_threshold': u'70', u'nexthop_group_member_low_threshold': u'70', u'acl_group_high_threshold': u'85', u'ipv4_route_high_threshold': u'85', u'acl_counter_high_threshold': u'85', u'ipv4_nexthop_low_threshold': u'70', u'ipv4_route_low_threshold': u'70', u'snat_entry_high_threshold': u'85', u'nexthop_group_member_high_threshold': u'85', u'ipv4_neighbor_low_threshold': u'70', u'acl_group_threshold_type': u'percentage', u'ipv4_nexthop_high_threshold': u'85', u'ipv6_route_threshold_type': u'percentage', u'nexthop_group_low_threshold': u'70', u'ipv4_neighbor_high_threshold': u'85', u'ipv6_route_high_threshold': u'85', u'ipv6_nexthop_high_threshold': u'85', u'polling_interval': u'300', u'snat_entry_threshold_type': u'percentage', u'ipv4_nexthop_threshold_type': u'percentage', u'acl_table_threshold_type': u'percentage', u'acl_entry_low_threshold': u'70', u'nexthop_group_member_threshold_type': u'percentage', u'ipv6_nexthop_threshold_type': u'percentage', u'acl_counter_threshold_type': u'percentage', u'dnat_entry_high_threshold': u'85', u'ipv6_neighbor_high_threshold': u'85', u'ipmc_entry_threshold_type': u'percentage', u'ipv4_route_threshold_type': u'percentage', u'acl_table_low_threshold': u'70', u'fdb_entry_threshold_type': u'percentage', u'ipv6_neighbor_threshold_type': u'percentage', u'dnat_entry_threshold_type': u'percentage', u'acl_table_high_threshold': u'85', u'snat_entry_low_threshold': u'70', u'ipv6_nexthop_low_threshold': u'70', u'acl_counter_low_threshold': u'70', u'ipmc_entry_high_threshold': u'85', u'dnat_entry_low_threshold': u'70', u'ipv4_neighbor_threshold_type': u'percentage', u'nexthop_group_high_threshold': u'85', u'ipv6_route_low_threshold': u'70', u'acl_entry_high_threshold': u'85', u'fdb_entry_low_threshold': u'70'}}}
20:53:27 bgp_test_gap_helper.duthost_bgp_scalabil L0362 INFO | Reloading config to apply BGP config
20:54:02 utilities.wait L0078 INFO | Pause 60 seconds, reason: For Config to reload

20:55:03 connection._warn L0321 WARNING| Verification of certificates is disabled
20:55:03 connection._info L0318 INFO | Determining the platform and rest_port using the 10.36.77.53 address...
20:55:03 connection._warn L0321 WARNING| Unable to connect to http://10.36.77.53:11009.
20:55:03 connection._info L0318 INFO | Connection established to https://10.36.77.53:11009 on windows
20:55:04 connection._info L0318 INFO | Using IxNetwork api server version 9.20.0.207
20:55:04 connection._info L0318 INFO | User info IxNetwork/WIN-11RK5TNKNAN/8010
20:55:05 connection._info L0318 INFO | [ixn-otg] snappi-0.8.2
20:55:05 connection._info L0318 INFO | [ixn-otg] snappi_ixnetwork-0.7.10
20:55:05 connection._info L0318 INFO | [ixn-otg] ixnetwork_restpy-1.1.6
20:55:05 connection._info L0318 INFO | [ixn-otg] Config validation 0.014s
20:55:07 connection._info L0318 INFO | [ixn-otg] Ports configuration 1.674s
20:55:07 connection._info L0318 INFO | [ixn-otg] Captures configuration 0.030s
20:55:10 connection._info L0318 INFO | [ixn-otg] Add location hosts [10.36.78.53] 2.319s
20:55:12 connection._info L0318 INFO | [ixn-otg] Location hosts ready [10.36.78.53] 2.042s
20:55:12 connection._info L0318 INFO | [ixn-otg] Speed conversion is not require for (port.name, speed) : [('Source', u'novusHundredGigNonFanOut'), ('Destination', u'novusHundredGigNonFanOut')]
20:55:12 connection._info L0318 INFO | [ixn-otg] Aggregation mode speed change 0.393s
20:55:12 connection._info L0318 INFO | [ixn-otg] Location preemption [10.36.78.53;4;2, 10.36.78.53;4;3] 0.055s
20:55:15 connection._info L0318 INFO | [ixn-otg] Location connect [Source, Destination] 2.601s
20:55:15 connection._info L0318 INFO | [ixn-otg] Location state check [Source, Destination] 0.074s
20:55:15 connection._info L0318 INFO | [ixn-otg] Location configuration 7.677s
20:55:19 connection._info L0318 INFO | [ixn-otg] Layer1 configuration 3.877s
20:55:21 connection._info L0318 INFO | [ixn-otg] Lag Configuration 2.241s
20:55:22 connection._info L0318 INFO | [ixn-otg] Lag Ethernet Configuration 0.763s
20:55:23 connection._info L0318 INFO | [ixn-otg] Lag Protocol Configuration 0.800s
20:55:23 connection._info L0318 INFO | [ixn-otg] Convert device config : 0.040s
20:55:23 connection._info L0318 INFO | [ixn-otg] Create IxNetwork device config : 0.001s
20:55:25 connection._info L0318 INFO | [ixn-otg] Push IxNetwork device config : 2.427s
20:55:25 connection._info L0318 INFO | [ixn-otg] Devices configuration 2.482s
20:55:28 connection._info L0318 INFO | [ixn-otg] Flows configuration 3.431s
20:55:29 connection._info L0318 INFO | [ixn-otg] Start interfaces 0.247s
20:55:29 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
20:56:30 connection.info L0318 INFO | [ixn-otg] Setting protocol state 61.399s
20:56:30 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
20:57:00 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
20:57:07 connection.info L0318 INFO | [ixn-otg] Flows generate/apply 6.670s
20:57:20 connection.info L0318 INFO | [ixn-otg] Flows clear statistics 12.792s
20:57:20 connection.info L0318 INFO | [ixn-otg] Captures start 0.000s
20:57:23 connection.info L0318 INFO | [ixn-otg] Flows start 2.778s
20:57:23 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Traffic To start and stabilize
20:57:54 bgp_test_gap_helper.get_bgp_scalability L0781 INFO ROUTE_THRESHOLD_EXCEEDED NOT FOUND in syslog !!!!!!!!!!!
20:57:54 bgp_test_gap_helper.get_bgp_scalability L0781 INFO | |---- Tx Frame Rate: 11973180.0 ----|
20:57:54 bgp_test_gap_helper.get_bgp_scalability L0782 INFO | |---- Rx Frame Rate: 11973180.0 ----|
20:57:54 bgp_test_gap_helper.get_bgp_scalability L0783 INFO | |---- Loss % : 0.0 ----|
20:57:54 bgp_test_gap_helper.get_bgp_scalability L0789 INFO | PASSED : No Loss observerd in traffic item and THRESHOLD_EXCEEDED warning message not observed in syslog
20:57:54 bgp_test_gap_helper.stop_traffic L0746 INFO | Stopping Traffic
20:58:00 connection._info L0318 INFO | [ixn-otg] Flows stop 5.476s
20:58:00 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Traffic To stop
20:58:20 bgp_test_gap_helper.stop_traffic L0752 INFO | Stopping all protocols ...
20:58:20 connection._info L0318 INFO | [ixn-otg] Setting protocol state 0.024s
20:58:20 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Protocols To STOP
PASSED [ 20%]
snappi/bgp/test_bgp_scalability.py::test_bgp_scalability_8k_v6_routes[64-8000-1]
-------------------------------- live log setup --------------------------------
20:58:40 init.set_default L0049 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
20:58:40 init.check_test_completeness L0138 INFO | Test has no defined levels. Continue without test completeness checks
20:58:40 init.loganalyzer L0048 INFO | Log analyzer is disabled
-------------------------------- live log call ---------------------------------
20:58:41 connection._info L0318 INFO | [ixn-otg] Config validation 0.015s
20:58:41 connection._info L0318 INFO | [ixn-otg] Ports configuration 0.059s
20:58:41 connection._info L0318 INFO | [ixn-otg] Captures configuration 0.031s
20:58:41 connection._info L0318 INFO | [ixn-otg] Location hosts ready [10.36.78.53] 0.019s
20:58:41 connection._info L0318 INFO | [ixn-otg] Speed change not require due to redundant Layer1 config
20:58:41 connection._info L0318 INFO | [ixn-otg] Aggregation mode speed change 0.011s
20:58:41 connection._info L0318 INFO | [ixn-otg] Location configuration 0.107s
20:58:41 connection._info L0318 INFO | [ixn-otg] Layer1 configuration 0.067s
20:58:42 connection._info L0318 INFO | [ixn-otg] Lag Configuration 1.078s
20:58:42 connection._info L0318 INFO | [ixn-otg] Lag Ethernet Configuration 0.144s
20:58:43 connection._info L0318 INFO | [ixn-otg] Lag Protocol Configuration 0.556s
20:58:43 connection._info L0318 INFO | [ixn-otg] Convert device config : 0.178s
20:58:43 connection._info L0318 INFO | [ixn-otg] Create IxNetwork device config : 0.001s
20:58:44 connection._info L0318 INFO | [ixn-otg] Push IxNetwork device config : 1.232s
20:58:44 connection._info L0318 INFO | [ixn-otg] Devices configuration 1.424s
20:58:46 connection._info L0318 INFO | [ixn-otg] Flows configuration 1.444s
20:58:46 connection._info L0318 INFO | [ixn-otg] Start interfaces 0.193s
20:58:46 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:01:13 connection._info L0318 INFO | [ixn-otg] Setting protocol state 147.426s
21:01:13 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:01:44 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:02:06 connection._info L0318 INFO | [ixn-otg] Flows generate/apply 22.045s
21:02:06 bgp_test_gap_helper.run_traffic L0741 INFO | Error in L2/L3 Traffic Apply

21:02:06 bgp_test_gap_helper.restart_traffic L0712 INFO | L2/3 traffic apply failed,Restarting protocols and traffic
21:02:06 bgp_test_gap_helper.get_bgp_scalability_ L0770 INFO | Error in L2/L3 Traffic Apply

21:02:09 reboot.reboot L0133 INFO | waiting for ssh to drop on sonic-s6100-dut
21:02:09 reboot.execute_reboot_command L0117 INFO | rebooting sonic-s6100-dut with command "fast-reboot"
21:03:04 reboot.reboot L0154 INFO | waiting for ssh to startup on sonic-s6100-dut
21:03:14 reboot.reboot L0165 INFO | ssh has started up on sonic-s6100-dut
21:03:14 reboot.reboot L0167 INFO | waiting for switch sonic-s6100-dut to initialize
21:05:14 reboot.reboot L0172 INFO | fast reboot finished on sonic-s6100-dut
21:05:16 reboot.reboot L0175 INFO | DUT sonic-s6100-dut up since 2022-07-13 20:47:00
21:05:16 bgp_test_gap_helper.get_bgp_scalability_ L0773 INFO | Wait until the system is stable
21:06:54 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:07:21 connection.info L0318 INFO | [ixn-otg] Setting protocol state 27.103s
21:07:21 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:07:51 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:07:55 connection.info L0318 INFO | [ixn-otg] Flows generate/apply 3.282s
21:08:08 connection.info L0318 INFO | [ixn-otg] Flows clear statistics 13.438s
21:08:08 connection.info L0318 INFO | [ixn-otg] Captures start 0.000s
21:08:11 connection.info L0318 INFO | [ixn-otg] Flows start 2.943s
21:08:11 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Traffic To start and stabilize
21:08:42 bgp_test_gap_helper.get_bgp_scalability L0781 INFO ROUTE_THRESHOLD_EXCEEDED NOT FOUND in syslog !!!!!!!!!!!
21:08:42 bgp_test_gap_helper.get_bgp_scalability L0781 INFO | |---- Tx Frame Rate: 11973180.0 ----|
21:08:42 bgp_test_gap_helper.get_bgp_scalability L0782 INFO | |---- Rx Frame Rate: 11973180.0 ----|
21:08:42 bgp_test_gap_helper.get_bgp_scalability L0783 INFO | |---- Loss % : 0.0 ----|
21:08:42 bgp_test_gap_helper.get_bgp_scalability L0789 INFO | PASSED : No Loss observerd in traffic item and THRESHOLD_EXCEEDED warning message not observed in syslog
21:08:42 bgp_test_gap_helper.stop_traffic L0746 INFO | Stopping Traffic
21:08:47 connection._info L0318 INFO | [ixn-otg] Flows stop 5.184s
21:08:47 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Traffic To stop
21:09:07 bgp_test_gap_helper.stop_traffic L0752 INFO | Stopping all protocols ...
21:09:07 connection._info L0318 INFO | [ixn-otg] Setting protocol state 0.023s
21:09:07 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Protocols To STOP
PASSED [ 40%]
snappi/bgp/test_bgp_scalability.py::test_bgp_scalability_256_v6_routes[128-256-1]
-------------------------------- live log setup --------------------------------
21:09:27 init.set_default L0049 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
21:09:27 init.check_test_completeness L0138 INFO | Test has no defined levels. Continue without test completeness checks
21:09:27 init.loganalyzer L0048 INFO | Log analyzer is disabled
-------------------------------- live log call ---------------------------------
21:09:28 connection._info L0318 INFO | [ixn-otg] Config validation 0.012s
21:09:28 connection._info L0318 INFO | [ixn-otg] Ports configuration 0.059s
21:09:29 connection._info L0318 INFO | [ixn-otg] Captures configuration 0.030s
21:09:29 connection._info L0318 INFO | [ixn-otg] Location hosts ready [10.36.78.53] 0.019s
21:09:29 connection._info L0318 INFO | [ixn-otg] Speed change not require due to redundant Layer1 config
21:09:29 connection._info L0318 INFO | [ixn-otg] Aggregation mode speed change 0.010s
21:09:29 connection._info L0318 INFO | [ixn-otg] Location configuration 0.107s
21:09:29 connection._info L0318 INFO | [ixn-otg] Layer1 configuration 0.071s
21:09:30 connection._info L0318 INFO | [ixn-otg] Lag Configuration 1.059s
21:09:30 connection._info L0318 INFO | [ixn-otg] Lag Ethernet Configuration 0.151s
21:09:30 connection._info L0318 INFO | [ixn-otg] Lag Protocol Configuration 0.446s
21:09:31 connection._info L0318 INFO | [ixn-otg] Convert device config : 0.124s
21:09:31 connection._info L0318 INFO | [ixn-otg] Create IxNetwork device config : 0.001s
21:09:32 connection._info L0318 INFO | [ixn-otg] Push IxNetwork device config : 1.402s
21:09:32 connection._info L0318 INFO | [ixn-otg] Devices configuration 1.540s
21:09:33 connection._info L0318 INFO | [ixn-otg] Flows configuration 1.574s
21:09:34 connection._info L0318 INFO | [ixn-otg] Start interfaces 0.258s
21:09:34 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:09:52 connection.info L0318 INFO | [ixn-otg] Setting protocol state 17.571s
21:09:52 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:10:22 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:10:28 connection.info L0318 INFO | [ixn-otg] Flows generate/apply 6.699s
21:10:42 connection.info L0318 INFO | [ixn-otg] Flows clear statistics 13.517s
21:10:42 connection.info L0318 INFO | [ixn-otg] Captures start 0.000s
21:10:45 connection.info L0318 INFO | [ixn-otg] Flows start 2.983s
21:10:45 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Traffic To start and stabilize
21:11:16 bgp_test_gap_helper.get_bgp_scalability L0781 INFO ROUTE_THRESHOLD_EXCEEDED NOT FOUND in syslog!!!!!!!!
21:11:16 bgp_test_gap_helper.get_bgp_scalability L0781 INFO | |---- Tx Frame Rate: 11973180.0 ----|
21:11:16 bgp_test_gap_helper.get_bgp_scalability L0782 INFO | |---- Rx Frame Rate: 11973180.0 ----|
21:11:16 bgp_test_gap_helper.get_bgp_scalability L0783 INFO | |---- Loss % : 0.0 ----|
21:11:16 bgp_test_gap_helper.get_bgp_scalability L0789 INFO | PASSED : No Loss observerd in traffic item and THRESHOLD_EXCEEDED warning message not observed in syslog
21:11:16 bgp_test_gap_helper.stop_traffic L0746 INFO | Stopping Traffic
21:11:21 connection._info L0318 INFO | [ixn-otg] Flows stop 5.195s
21:11:21 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Traffic To stop
21:11:41 bgp_test_gap_helper.stop_traffic L0752 INFO | Stopping all protocols ...
21:11:41 connection._info L0318 INFO | [ixn-otg] Setting protocol state 0.023s
21:11:41 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Protocols To STOP
PASSED [ 60%]
snappi/bgp/test_bgp_scalability.py::test_bgp_scalability_8kv4_4kv6_routes[4000-8000-1]
-------------------------------- live log setup --------------------------------
21:12:01 init.set_default L0049 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
21:12:01 init.check_test_completeness L0138 INFO | Test has no defined levels. Continue without test completeness checks
21:12:01 init.loganalyzer L0048 INFO | Log analyzer is disabled
-------------------------------- live log call ---------------------------------
21:12:02 connection._info L0318 INFO | [ixn-otg] Config validation 0.014s
21:12:02 connection._info L0318 INFO | [ixn-otg] Ports configuration 0.055s
21:12:02 connection._info L0318 INFO | [ixn-otg] Captures configuration 0.033s
21:12:02 connection._info L0318 INFO | [ixn-otg] Location hosts ready [10.36.78.53] 0.020s
21:12:02 connection._info L0318 INFO | [ixn-otg] Speed change not require due to redundant Layer1 config
21:12:02 connection._info L0318 INFO | [ixn-otg] Aggregation mode speed change 0.012s
21:12:02 connection._info L0318 INFO | [ixn-otg] Location configuration 0.106s
21:12:02 connection._info L0318 INFO | [ixn-otg] Layer1 configuration 0.071s
21:12:03 connection._info L0318 INFO | [ixn-otg] Lag Configuration 1.062s
21:12:04 connection._info L0318 INFO | [ixn-otg] Lag Ethernet Configuration 0.144s
21:12:04 connection._info L0318 INFO | [ixn-otg] Lag Protocol Configuration 0.557s
21:12:04 connection._info L0318 INFO | [ixn-otg] Convert device config : 0.141s
21:12:04 connection._info L0318 INFO | [ixn-otg] Create IxNetwork device config : 0.001s
21:12:05 connection._info L0318 INFO | [ixn-otg] Push IxNetwork device config : 1.194s
21:12:05 connection._info L0318 INFO | [ixn-otg] Devices configuration 1.350s
21:12:07 connection._info L0318 INFO | [ixn-otg] Flows configuration 1.933s
21:12:08 connection._info L0318 INFO | [ixn-otg] Start interfaces 0.202s
21:12:08 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:12:25 connection.info L0318 INFO | [ixn-otg] Setting protocol state 16.689s
21:12:25 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:12:55 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:13:01 connection.info L0318 INFO | [ixn-otg] Flows generate/apply 6.513s
21:13:15 connection.info L0318 INFO | [ixn-otg] Flows clear statistics 13.405s
21:13:15 connection.info L0318 INFO | [ixn-otg] Captures start 0.000s
21:13:17 connection.info L0318 INFO | [ixn-otg] Flows start 2.439s
21:13:17 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Traffic To start and stabilize
21:13:48 bgp_test_gap_helper.get_bgp_scalability L0781 INFO ROUTE_THRESHOLD_EXCEEDED NOT FOUND in syslog!!!!!!!!
21:13:48 bgp_test_gap_helper.get_bgp_scalability L0781 INFO | |---- Tx Frame Rate: 5986590.0 ----|
21:13:48 bgp_test_gap_helper.get_bgp_scalability L0782 INFO | |---- Rx Frame Rate: 5986590.0 ----|
21:13:48 bgp_test_gap_helper.get_bgp_scalability L0783 INFO | |---- Loss % : 0.0 ----|
21:13:48 bgp_test_gap_helper.get_bgp_scalability L0789 INFO | PASSED : No Loss observerd in traffic item and THRESHOLD_EXCEEDED warning message not observed in syslog
21:13:48 bgp_test_gap_helper.stop_traffic L0746 INFO | Stopping Traffic
21:13:53 connection._info L0318 INFO | [ixn-otg] Flows stop 5.213s
21:13:53 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Traffic To stop
21:14:13 bgp_test_gap_helper.stop_traffic L0752 INFO | Stopping all protocols ...
21:14:13 connection._info L0318 INFO | [ixn-otg] Setting protocol state 0.023s
21:14:13 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Protocols To STOP
PASSED [ 80%]
snappi/bgp/test_bgp_scalability.py::test_bgp_scalability_100kv4_25kv6_routes[25000-100000-1]
-------------------------------- live log setup --------------------------------
21:14:33 init.set_default L0049 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
21:14:33 init.check_test_completeness L0138 INFO | Test has no defined levels. Continue without test completeness checks
21:14:33 init.loganalyzer L0048 INFO | Log analyzer is disabled
-------------------------------- live log call ---------------------------------
21:14:34 connection._info L0318 INFO | [ixn-otg] Config validation 0.015s
21:14:34 connection._info L0318 INFO | [ixn-otg] Ports configuration 0.054s
21:14:34 connection._info L0318 INFO | [ixn-otg] Captures configuration 0.033s
21:14:34 connection._info L0318 INFO | [ixn-otg] Location hosts ready [10.36.78.53] 0.019s
21:14:34 connection._info L0318 INFO | [ixn-otg] Speed change not require due to redundant Layer1 config
21:14:34 connection._info L0318 INFO | [ixn-otg] Aggregation mode speed change 0.010s
21:14:34 connection._info L0318 INFO | [ixn-otg] Location configuration 0.103s
21:14:35 connection._info L0318 INFO | [ixn-otg] Layer1 configuration 0.071s
21:14:36 connection._info L0318 INFO | [ixn-otg] Lag Configuration 1.057s
21:14:36 connection._info L0318 INFO | [ixn-otg] Lag Ethernet Configuration 0.149s
21:14:36 connection._info L0318 INFO | [ixn-otg] Lag Protocol Configuration 0.617s
21:14:37 connection._info L0318 INFO | [ixn-otg] Convert device config : 0.138s
21:14:37 connection._info L0318 INFO | [ixn-otg] Create IxNetwork device config : 0.001s
21:14:38 connection._info L0318 INFO | [ixn-otg] Push IxNetwork device config : 1.203s
21:14:38 connection._info L0318 INFO | [ixn-otg] Devices configuration 1.355s
21:14:41 connection._info L0318 INFO | [ixn-otg] Flows configuration 3.145s
21:14:41 connection._info L0318 INFO | [ixn-otg] Start interfaces 0.214s
21:14:41 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:14:58 connection._info L0318 INFO | [ixn-otg] Setting protocol state 16.484s
21:14:58 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:15:28 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:16:52 connection._info L0318 INFO | [ixn-otg] Flows generate/apply 83.902s
21:16:52 bgp_test_gap_helper.run_traffic L0741 INFO | Error in L2/L3 Traffic Apply

21:16:52 bgp_test_gap_helper.restart_traffic L0712 INFO | L2/3 traffic apply failed,Restarting protocols and traffic
21:16:52 bgp_test_gap_helper.get_bgp_scalability_ L0770 INFO | Error in L2/L3 Traffic Apply

21:16:55 reboot.reboot L0133 INFO | waiting for ssh to drop on sonic-s6100-dut
21:16:55 reboot.execute_reboot_command L0117 INFO | rebooting sonic-s6100-dut with command "fast-reboot"
21:17:48 reboot.reboot L0154 INFO | waiting for ssh to startup on sonic-s6100-dut
21:17:58 reboot.reboot L0165 INFO | ssh has started up on sonic-s6100-dut
21:17:58 reboot.reboot L0167 INFO | waiting for switch sonic-s6100-dut to initialize
21:19:58 reboot.reboot L0172 INFO | fast reboot finished on sonic-s6100-dut
21:20:00 reboot.reboot L0175 INFO | DUT sonic-s6100-dut up since 2022-07-13 21:01:44
21:20:00 bgp_test_gap_helper.get_bgp_scalability_ L0773 INFO | Wait until the system is stable
21:21:48 bgp_test_gap_helper.run_traffic L0728 INFO | Starting all protocols ...
21:23:28 connection.info L0318 INFO | [ixn-otg] Setting protocol state 99.747s
21:23:28 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Protocols To start
21:23:58 bgp_test_gap_helper.run_traffic L0734 INFO | Starting Traffic
21:24:03 connection.info L0318 INFO | [ixn-otg] Flows generate/apply 4.997s
21:24:17 connection.info L0318 INFO | [ixn-otg] Flows clear statistics 13.326s
21:24:17 connection.info L0318 INFO | [ixn-otg] Captures start 0.000s
21:24:19 connection.info L0318 INFO | [ixn-otg] Flows start 2.504s
21:24:19 utilities.wait L0078 INFO | Pause 30 seconds, reason: For Traffic To start and stabilize
21:24:50 bgp_test_gap_helper.get_bgp_scalability L0781 INFO ROUTE_THRESHOLD_EXCEEDED FOUND in syslog !!!!!!!!!!!
21:24:50 bgp_test_gap_helper.get_bgp_scalability L0781 INFO | |---- Tx Frame Rate: 5986590.0 ----|
21:24:50 bgp_test_gap_helper.get_bgp_scalability L0782 INFO | |---- Rx Frame Rate: 0.0 ----|
21:24:50 bgp_test_gap_helper.get_bgp_scalability L0783 INFO | |---- Loss % : 100.0 ----|
21:24:50 bgp_test_gap_helper.get_bgp_scalability L0786 INFO | PASSED : 100.0% Loss observerd in traffic item for 100k routes and THRESHOLD_EXCEEDED warning message observed in syslog
21:24:50 bgp_test_gap_helper.stop_traffic L0746 INFO | Stopping Traffic
21:24:55 connection._info L0318 INFO | [ixn-otg] Flows stop 5.110s
21:24:55 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Traffic To stop
21:25:15 bgp_test_gap_helper.stop_traffic L0752 INFO | Stopping all protocols ...
21:25:15 connection._info L0318 INFO | [ixn-otg] Setting protocol state 0.023s
21:25:15 utilities.wait L0078 INFO | Pause 20 seconds, reason: For Protocols To STOP
21:26:13 bgp_test_gap_helper.cleanup_config L0801 INFO | Wait until all critical services are fully started
21:26:39 bgp_test_gap_helper.cleanup_config L0803 INFO | Convergence Test Completed
PASSED [100%]
------------------------------ live log teardown -------------------------------
21:26:39 init._fixture_generator_decorator L0083 INFO | -------------------- fixture cvg_api teardown starts --------------------
21:26:39 init._fixture_generator_decorator L0092 INFO | -------------------- fixture cvg_api teardown ends --------------------
21:26:39 init._fixture_generator_decorator L0083 INFO | -------------------- fixture start_pfcwd_after_test teardown starts --------------------
21:26:40 init._fixture_generator_decorator L0092 INFO | -------------------- fixture start_pfcwd_after_test teardown ends --------------------
21:26:40 init._fixture_generator_decorator L0083 INFO | -------------------- fixture rand_lossy_prio teardown starts --------------------
21:26:40 init._fixture_generator_decorator L0092 INFO | -------------------- fixture rand_lossy_prio teardown ends --------------------
21:26:40 init._fixture_generator_decorator L0083 INFO | -------------------- fixture rand_lossless_prio teardown starts --------------------
21:26:40 init._fixture_generator_decorator L0092 INFO | -------------------- fixture rand_lossless_prio teardown ends --------------------
21:26:40 init._fixture_generator_decorator L0083 INFO | -------------------- fixture enable_packet_aging_after_test teardown starts --------------------
21:26:47 init._fixture_generator_decorator L0092 INFO | -------------------- fixture enable_packet_aging_after_test teardown ends --------------------

=============================== warnings summary ===============================
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:538
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:538: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests.common.dualtor
self.import_plugin(import_spec)

snappi/bgp/test_bgp_scalability.py::test_bgp_scalability_16k_v4_routes[16000-1]
/usr/local/lib/python2.7/dist-packages/pytest_ansible-2.2.2-py2.7.egg/pytest_ansible/module_dispatcher/v28.py:70: UserWarning: provided hosts list is empty, only localhost is available
warnings.warn("provided hosts list is empty, only localhost is available")

-- Docs: https://docs.pytest.org/en/latest/warnings.html
---------------------------- live log sessionfinish ----------------------------
21:26:49 init.pytest_terminal_summary L0064 INFO | Can not get Allure report URL. Please check logs
=================== 5 passed, 2 warnings in 2031.82 seconds ====================
`

mssonicbld · 2023-01-31T21:03:38Z

/AzurePipelines run

azure-pipelines · 2023-01-31T21:03:47Z

Azure Pipelines successfully started running 1 pipeline(s).

selldinesh · 2023-01-31T21:04:52Z

@wangxin , Getting flake8 failures during azp run, the imported modules are required for the script to run.
For example tests/snappi/bgp/test_bgp_convergence_performance.py:1:1: F401 'tests.common.snappi.snappi_fixtures.cvg_api' imported but unused

in test_bgp_convergence_performance.py cvg_api is used in line 16, similarly for other modules as well. These look like false failure

selldinesh · 2023-01-31T21:06:58Z

@wangxin can you please approve this PR

wangxin · 2023-02-08T01:00:41Z

/azp run

azure-pipelines · 2023-02-08T01:00:51Z

Azure Pipelines successfully started running 1 pipeline(s).

BGP Convergence Performance and Scalability Cases BGP Convergence Performance BGP Scalability

mssonicbld · 2023-08-16T23:18:10Z

@selldinesh PR conflicts with 202305 branch

wangxin · 2023-08-16T23:18:33Z

@developfast This is PR is to add new tests. Do we really need it in 202205 branch?

developfast · 2023-08-17T03:57:32Z

@wangxin yes.

mssonicbld · 2023-08-28T07:14:21Z

@selldinesh PR conflicts with 202205 branch

selldinesh and others added 15 commits March 15, 2021 09:02

Merge pull request #2 from Azure/master

664aef8

Get latest changes

Merge branch 'Azure:master' into master

e527d1f

Merge branch 'Azure:master' into master

c773979

Merge branch 'Azure:master' into master

265a81e

Merge branch 'Azure:master' into master

3b066da

Merge branch 'Azure:master' into master

3f67368

Merge branch 'Azure:master' into master

067ee51

Merge branch 'Azure:master' into master

acb1929

Merge branch 'Azure:master' into master

5cf3c82

Merge branch 'Azure:master' into master

76e594c

Merge branch 'Azure:master' into master

90e6f11

Merge branch 'Azure:master' into master

bf25d8a

Merge branch 'Azure:master' into master

37defd2

Merge branch 'Azure:master' into master

8661011

first commit

2d56f9d

selldinesh requested a review from a team as a code owner February 9, 2022 02:34

as path additions

79092ff

resolving alerts

0fbd776

selldinesh added 2 commits June 8, 2022 16:45

error handling for traffic apply

dc1bd26

final changes

7d33881

resolving alerts

6e03922

typo fix

679c816

selldinesh added 10 commits January 30, 2023 21:27

resolving undefined names

af78467

resolving missing whitespace

8541a27

fixing missing whitespaces

042f4d3

fixing indents

62dffe9

corrections

8f5ba5a

indent fixes

449400a

removing unused imports

de80a6c

flake8 changes

c222c30

flake8 final changes

2049f24

indent changes

b0bb89f

wangxin approved these changes Feb 9, 2023

View reviewed changes

wangxin merged commit fffd683 into sonic-net:master Feb 9, 2023

kellyyeh pushed a commit to kellyyeh/sonic-mgmt that referenced this pull request Mar 31, 2023

BGP Convergence Performance and Scalability Cases (sonic-net#5098)

d7159fd

BGP Convergence Performance and Scalability Cases BGP Convergence Performance BGP Scalability

developfast added Request for 202205 branch Request for 202305 branch labels Aug 14, 2023

wangxin added the Approved for 202305 branch label Aug 16, 2023

mssonicbld added the Cherry Pick Conflict_202305 label Aug 16, 2023

wangxin added the Approved for 202205 branch label Aug 28, 2023

mssonicbld added the Cherry Pick Conflict_202205 label Aug 28, 2023

wsycqyz mentioned this pull request Aug 6, 2024

Need new test: BGP-Convergence #3608

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BGP Convergence Performance and Scalability Cases #5098

BGP Convergence Performance and Scalability Cases #5098

selldinesh commented Feb 9, 2022 •

edited

Loading

lgtm-com bot commented Feb 9, 2022

lgtm-com bot commented Feb 11, 2022

selldinesh commented May 31, 2022 •

edited

Loading

azure-pipelines bot commented May 31, 2022

lgtm-com bot commented Jun 14, 2022

selldinesh commented Jul 7, 2022

selldinesh commented Jul 13, 2022 •

edited

Loading

selldinesh commented Jul 14, 2022 •

edited

Loading

mssonicbld commented Jan 31, 2023

azure-pipelines bot commented Jan 31, 2023

selldinesh commented Jan 31, 2023 •

edited

Loading

selldinesh commented Jan 31, 2023

wangxin commented Feb 8, 2023

azure-pipelines bot commented Feb 8, 2023

mssonicbld commented Aug 16, 2023

wangxin commented Aug 16, 2023

developfast commented Aug 17, 2023

mssonicbld commented Aug 28, 2023

BGP Convergence Performance and Scalability Cases #5098

BGP Convergence Performance and Scalability Cases #5098

Conversation

selldinesh commented Feb 9, 2022 • edited Loading

Description of PR

Type of change

Back port request

Approach

What is the motivation for this PR?

How did you do it?

How did you verify/test it?

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

lgtm-com bot commented Feb 9, 2022

lgtm-com bot commented Feb 11, 2022

selldinesh commented May 31, 2022 • edited Loading

azure-pipelines bot commented May 31, 2022

lgtm-com bot commented Jun 14, 2022

selldinesh commented Jul 7, 2022

selldinesh commented Jul 13, 2022 • edited Loading

selldinesh commented Jul 14, 2022 • edited Loading

mssonicbld commented Jan 31, 2023

azure-pipelines bot commented Jan 31, 2023

selldinesh commented Jan 31, 2023 • edited Loading

selldinesh commented Jan 31, 2023

wangxin commented Feb 8, 2023

azure-pipelines bot commented Feb 8, 2023

mssonicbld commented Aug 16, 2023

wangxin commented Aug 16, 2023

developfast commented Aug 17, 2023

mssonicbld commented Aug 28, 2023

selldinesh commented Feb 9, 2022 •

edited

Loading

selldinesh commented May 31, 2022 •

edited

Loading

selldinesh commented Jul 13, 2022 •

edited

Loading

selldinesh commented Jul 14, 2022 •

edited

Loading

selldinesh commented Jan 31, 2023 •

edited

Loading