[Snappi] Adding Lossless Response to External pause storm test case #8024
+493
−0
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
|
|
The pre-commit check detected issues in the files touched by this pull request. For old issues, it is not mandatory to fix them because they were not caused by this change. It is unfair to blame Detailed pre-commit check results: To run the pre-commit checks locally, you can follow below steps:
|
|
The pre-commit check detected issues in the files touched by this pull request. Detailed pre-commit check results: To run the pre-commit checks locally, you can follow below steps:
|
|
@developfast Can you please review |
|
The pre-commit check detected issues in the files touched by this pull request. Detailed pre-commit check results: To run the pre-commit checks locally, you can follow below steps:
|
|
The pre-commit check detected issues in the files touched by this pull request. Detailed pre-commit check results: To run the pre-commit checks locally, you can follow below steps:
|
|
/azpw run |
|
/AzurePipelines run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
tests/snappi_tests/multidut/pfc/files/lossless_response_to_external_pause_storms_helper.py
Outdated
Show resolved
Hide resolved
tests/snappi_tests/multidut/pfc/files/lossless_response_to_external_pause_storms_helper.py
Show resolved
Hide resolved
tests/snappi_tests/multidut/pfc/test_lossless_response_to_external_pause_storms.py
Outdated
Show resolved
Hide resolved
|
please fix test case failures. |
vmittal-msft
approved these changes
Mar 28, 2024
|
@developfast is this good from your side ? @selldinesh please fix test failures. |
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
@yxieca @developfast, Can you please help merge ? |
mrkcmo
pushed a commit
to Azarack/sonic-mgmt
that referenced
this pull request
Jul 8, 2024
[sdn_tests]: Adding results testhelper to pins_ondatra. (sonic-net#12675) * [sdn_tests]: Adding Build support for pins_ondatra * [sdn_tests]: Adding binding infra to pins_ondatra. * [sdn_tests]: Adding cert generation script and certs folder to pins_ondatra. * [sdn_tests]: Adding Data Infra to pins_ondatra. * [sdn_tests]: Adding gnmi testhelper to pins_ondatra. * [sdn_tests]: Adding GNOI testhelper to pins_ondatra. * [sdn_tests]: Adding LACP testhelper to pins_ondatra. * [sdn_tests]: Adding P4RT testhelper to pins_ondatra. * [sdn_tests]: Adding Platform and port_management testhelper to pins_ondatra. * [sdn_tests]: Adding testhelper to pins_ondatra. * [sdn_tests]: Adding Augment testhelper Infra to pins_ondatra. * [sdn_tests]: Adding results testhelper to pins_ondatra. [Feat] Enhance upgrade image script to support chassis devices (sonic-net#12871) Description of PR Summary: Enhance upgrade image script to support chassis device. For chassis device, we need to firstly upgrade the image for supervisor cards, then upgrade the image for line cards. Approach What is the motivation for this PR? Enhance the upgrade_image script to support chassis devices. How did you do it? Upgrade image on the supervisor cards, then wait 900s for the supervisor card to be ready. Upgrade image on the line cards, then wait 300s for the line cards to be ready. The sonichosts defautly run commands on all supervisor cards and line cards at the same time, enhance the framework to be able to upgrade specific hosts. How did you verify/test it? Run upgrade image script on the chassis device and pizzbox device, both of them works well co-authorized by: [email protected] increase sleep time for packet send/receive (sonic-net#12720) [sdn_tests]: Adding ssh testhelper to pins_ondatra. (sonic-net#12676) * [sdn_tests]: Adding Build support for pins_ondatra * [sdn_tests]: Adding binding infra to pins_ondatra. * [sdn_tests]: Adding cert generation script and certs folder to pins_ondatra. * [sdn_tests]: Adding Data Infra to pins_ondatra. * [sdn_tests]: Adding gnmi testhelper to pins_ondatra. * [sdn_tests]: Adding GNOI testhelper to pins_ondatra. * [sdn_tests]: Adding LACP testhelper to pins_ondatra. * [sdn_tests]: Adding P4RT testhelper to pins_ondatra. * [sdn_tests]: Adding Platform and port_management testhelper to pins_ondatra. * [sdn_tests]: Adding testhelper to pins_ondatra. * [sdn_tests]: Adding Augment testhelper Infra to pins_ondatra. * [sdn_tests]: Adding results testhelper to pins_ondatra. * [sdn_tests]: Adding ssh testhelper to pins_ondatra. Fix qos/test_qos_sai.py::TestQosSai::testQosSaiPfcXonLimit (sonic-net#12649) * Fix qos/test_qos_sai.py::TestQosSai::testQosSaiPfcXonLimit [TACACS] Improve TACACS run command on IPV6 failed issue. (sonic-net#12819) Improve TACACS run command on IPV6 failed issue. Tacplus server crash when receive authorization request from IPV6 address. Check TACACS server status after run command with IPV6 address. Pass all test case. Improve TACACS run command on IPV6 failed issue. [sdn_tests]: Adding ondatra tests bazel to pins_ondatra. (sonic-net#12677) * [sdn_tests]: Adding Build support for pins_ondatra * [sdn_tests]: Adding binding infra to pins_ondatra. * [sdn_tests]: Adding cert generation script and certs folder to pins_ondatra. * [sdn_tests]: Adding Data Infra to pins_ondatra. * [sdn_tests]: Adding gnmi testhelper to pins_ondatra. * [sdn_tests]: Adding GNOI testhelper to pins_ondatra. * [sdn_tests]: Adding LACP testhelper to pins_ondatra. * [sdn_tests]: Adding P4RT testhelper to pins_ondatra. * [sdn_tests]: Adding Platform and port_management testhelper to pins_ondatra. * [sdn_tests]: Adding testhelper to pins_ondatra. * [sdn_tests]: Adding Augment testhelper Infra to pins_ondatra. * [sdn_tests]: Adding results testhelper to pins_ondatra. * [sdn_tests]: Adding ssh testhelper to pins_ondatra. * [sdn_tests]: Adding ondatra bazel tests to pins_ondatra. imporve qos log readability (sonic-net#12526) Log message wrapper: All the messages were outputted to PTF logging by default, and can set flag to output to stderr of PTF console for specific message. so it can avoid lots of message flush on console and "test summary", easy to identify failure when triage. and also can check PTF logging which include all the message when rootcause failure. CounterCollector Class provide general interface for counter collecting, comparing, and displaying. Diagnostic Counter Wrapper so far, we can read 8 kinds of counter: port_counter, queue_counter_counter, queue_share_wm_counter, pg_share_wm_counter, pg_headroom_wm_counter, pg_counter_couner, pg_drop_counter and ptf_tx_rx_counter Although CounterCollector provides a common API to collect, compare and display these counters, if you use countercollect directly, the code of the test case will still become confusing. After all, at least one line of code for each counter. If the types of counter queries are subsequently increased, more code unrelated to the test steps will be exposed in the testcase. Therefore, the diag coutner wrapper is used to include all types of counter activities, so that the code in the test case is more inclined to reflect the test steps and logic rather than these diagnostic codes. assert wrapper By default, we will display the counter difference between the first and last step of this case on both normal and abnormal exits. but using python build-in assert instruction make it difficult to show counter diff. so we implement a assert wrapper to show counter diff when assert exception occur. TextTable Class This is not newly added class, in befor, it help to output counters in table format like well-known python library prettytable. in this PR, add a new class static method "merge_table())" to merge two table which need to show their difference. example case: not applied this feature to all qos testcase. only applied above changes to xoff, xon, lossyqueue cases as a example first. Monitor for long time to collect the feedback, and then enhance. already cover various sku/topo see below test record table skip chassis device since test have not covered chassis yet, skip chassis device support so far. How did you verify/test it? pass verification in lab testbed Set mux mode to manual to disable port toggle in cacl scripts on dualtor testbed (sonic-net#12883) Description of PR GCU test_cacl case failed on dualtor testbed randomly. The failed message: failed on teardown with "Failed: iptable rules are not suppose to change after test. diff: ['+ -A DHCP -m mark --mark 0x67008 -j DROP', '+ -A DHCP -m mark --mark 0x67024 -j DROP', '+ -A DHCP -m mark --mark 0x67022 -j DROP', '+ -A DHCP -m mark --mark 0x67018 -j DROP', '+ -A DHCP -m mark --mark 0x67014 -j DROP', '+ -A DHCP -m mark --mark 0x67013 -j DROP', '+ -A DHCP -m mark --mark 0x67010 -j DROP', '+ -A DHCP -m mark --mark 0x67009 -j DROP', '+ -A DHCP -m mark --mark 0x67004 -j DROP', '+ -A DHCP -m mark --mark 0x67007 -j DROP', '+ -A DHCP -m mark --mark 0x67006 -j DROP', '+ -A DHCP -m mark --mark 0x67002 -j DROP', '+ -A DHCP -m mark --mark 0x67001 -j DROP', '+ -A DHCP -m mark --mark 0x67005 -j DROP']" Summary: Fixes # (issue) The failed reason is dualtor oscillation feature is enabled by default in 202311/mater/internal branch. In nightly test environment, it's easy to trigger oscillation between standby and active ports. In this case, before running test case, some ports are active on DUT, but after test case, when do iptables verification, some ports turn to be standby, that causes iptables DHCP rules to change. The consequence is there is diff between original and latest iptables, which will fail the test case in teardown phase. We have to disable oscillation by set mux to manual mode on both TORs. Enhance the change in sonic-net#11878, set mux mode to manual on both TORs to avoid port state change during test. fix: add topology mark for test_bgp_peer_shutdown.py (sonic-net#12891) Description of PR Add topology mark for test_bgp_peer_shutdown.py so it won't get skipped [CI/CD] Add topo and device_type args for PR test scripts (sonic-net#12731) What is the motivation for this PR? Add "--topology" and "--device_type" arguments to PR test scripts. Fix the issue of "--device_type" skipped on test scripts without "device_type" mark. How did you do it? Add "--topology" and "--device_type" arguments to PR test scripts. Fix the issue of "--device_type" skipped on test scripts without "device_type" mark. How did you verify/test it? Raised Draft PR to test the template script: https://github.com/sonic-net/sonic-mgmt/pull/12645/files Signed-off-by: chunangli <[email protected]> [sdn_tests]: Adding testrunner to pins_ondatra. (sonic-net#12678) * [sdn_tests]: Adding Build support for pins_ondatra * [sdn_tests]: Adding binding infra to pins_ondatra. * [sdn_tests]: Adding cert generation script and certs folder to pins_ondatra. * [sdn_tests]: Adding Data Infra to pins_ondatra. * [sdn_tests]: Adding gnmi testhelper to pins_ondatra. * [sdn_tests]: Adding GNOI testhelper to pins_ondatra. * [sdn_tests]: Adding LACP testhelper to pins_ondatra. * [sdn_tests]: Adding P4RT testhelper to pins_ondatra. * [sdn_tests]: Adding Platform and port_management testhelper to pins_ondatra. * [sdn_tests]: Adding testhelper to pins_ondatra. * [sdn_tests]: Adding Augment testhelper Infra to pins_ondatra. * [sdn_tests]: Adding results testhelper to pins_ondatra. * [sdn_tests]: Adding ssh testhelper to pins_ondatra. * [sdn_tests]: Adding ondatra bazel tests to pins_ondatra. * [sdn_tests]: Adding testrunner to pins_ondatra. Skip DSCP mapping test for test issue (sonic-net#12907) Fix the Keyerror issue caused by none `conn_graph_fact` in VS set-up (sonic-net#12751) What is the motivation for this PR? To adapt to kvm testbed, we need to fix the issue -- conn_graph_fact is none in VS set-up. In this PR, we use method get of a dict to get the value instead of [] to avoid key error when getting value from an empty dict conn_graph_fact. Also, in this PR, after fixing this issue, we can add three platform tests into PR test. [sdn_tests]:Adding Dual switch EthernetCounter Test to pins_ondatra. (sonic-net#12901) [sdn_tests]: Adding GNMI long Stress Test to pins_ondatra. (sonic-net#12902) * [sdn_tests]:Adding Dual switch EthernetCounter Test to pins_ondatra. * [sdn_tests]: Adding GNMI long Stress Test to pins_ondatra. Remove deprecated PR testing pipeline yaml files (sonic-net#12780) PR testing of current repo has been migrated to Elastictest, the legacy PR testing pipeline yaml files are no longer required. This change removed the deprecated PR testing pipeline yaml files. Signed-off-by: Xin Wang <[email protected]> Remove pre-test and GIT_SECRETS from baseline test (sonic-net#12778) * Remove pre-test and GIT_SECRETS from baseline test Baseline test is to run PR tests multiple times to surface flaky issues. The pre-test step is to find out if there is any importing dependency issue between test scripts. This dependency issue only could happen with new PRs. During baseline test, the dependency issue won't happen. It is unnecessary for baseline test. The GIT_SECRETS variable is not really used by baseline tests. This change also deleted the reference to GIT_SECRETS variable group. Signed-off-by: Xin Wang <[email protected]> * Fix depends on conditions --------- Signed-off-by: Xin Wang <[email protected]> [dhcp_server_test] Add multiple vlans test and config change test (sonic-net#12775) Fix m0-2vlan topo prefix_v6 value that causes route_check fail (sonic-net#12851) Explicit zeros in prefix_v6 value causes issue in route_check. Need to use simplified form instead [sdn_tests]:Adding GNOI File Test to pins_ondatra. (sonic-net#12905) * [sdn_tests]:Adding Dual switch EthernetCounter Test to pins_ondatra. * [sdn_tests]: Adding GNMI long Stress Test to pins_ondatra. * [sdn_tests]:Adding GNOI File Test to pins_ondatra. Added temporary skip to system_health TC for MLX platfroms (sonic-net#12798) Update test_ro_disk.py (sonic-net#12913) Fix ro disk test case generate garbled syslog and break loganalyzer issue. Log rotate during ro disk may cause syslog file contains garbled characters. These characters will break loganalyzer, to fix this issue, rotate again to cleanup syslog file. log rotate again after ro disk test case finish, Pass all test case. Fix ro disk test case generate garbled syslog and break loganalyzer issue. Revert "Put back sonic-net#11934, fix qos/test_qos_sai.py teardown for dualtor. (sonic-net#12503)" (sonic-net#12920) This reverts commit 5f6b931. [Snappi] Adding Lossless Response to External pause storm test case (sonic-net#8024) * adding lossless response to external pause storm test case Co-authored-by: selldinesh <[email protected]> [sdn_tests]: Adding LACP time-out test to pins_ondatra. (sonic-net#12917) [sdn_tests]: Adding Link event damping test to pins_ondatra. (sonic-net#12919) * [sdn_tests]: Adding LACP time-out test to pins_ondatra. * [sdn_tests]: Adding Link event damping test to pins_ondatra. [sdn_tests]: Adding port debug data test to pins_ondatra (sonic-net#12921) * [sdn_tests]: Adding LACP time-out test to pins_ondatra. * [sdn_tests]: Adding Link event damping test to pins_ondatra. * [sdn_tests]: Adding port debug data test to pins_ondatra. [sdn_tests]: Adding module reset test to pins_ondatra. (sonic-net#12928) * [sdn_tests]: Adding LACP time-out test to pins_ondatra. * [sdn_tests]: Adding Link event damping test to pins_ondatra. * [sdn_tests]: Adding port debug data test to pins_ondatra. * [sdn_tests]: Adding module reset test to pins_ondatra. Pin requests to version 2.31.0 (sonic-net#12910) Short-term workaround to avoid issue where testbed-cli.sh ... add-topo errored out with 'Not supported URL scheme http+docker' due to the update of the transitive dependency python requests through docker-py. co-authorized by: [email protected] Changed all references to 'is_dualtor_aa' to just 'is_dualtor' (sonic-net#12927) [sdn_tests]: Adding Installation test to pins_ondatra. (sonic-net#12943) [sdn_tests]: Adding inband sw interface dual switch test to pins_ondatra. (sonic-net#12946) * [sdn_tests]: Adding Installation test to pins_ondatra. * [sdn_tests]: Adding inband sw interface dual switch test to pins_ondatra. [TACACS] Increase check local log wait time and print debug info. (sonic-net#12822) Increase check local log wait time and print debug info. test_accounting failed because local log does not exist. Increase check local log wait time and print debug info. Pass all test case. Increase check local log wait time and print debug info. [dhcp_server_test] support dhcp server container auto restarted test on mx topo (sonic-net#12897) What is the motivation for this PR? We need to test if dhcp_server container auto restart will work. How did you do it? Enable dhcp_server feature before the test. How did you verify/test it? Run test on mx topo Fix sonic-mgmt testbed-cli interface_to_vms undefined failure. (sonic-net#12890) What is the motivation for this PR? This change is to fix the error above, when VM list is empty. How did you do it? The fix is straightforward - to give it a default value that is an empty list when enumerating. How did you verify/test it? The change is run locally with topology with empty VMs, and it works. Fix add-topo failure when deploying topology with empty VM list. (sonic-net#12932) What is the motivation for this PR? There are 2 issues are hitting, when deploying any topology without the VM list: Ansible Bind topology to VMs task task will fail, because the vm list is empty, but it is checking the VM base in the VM list. The generated minigraph will fail to load, because minigraph.py is not expecting any ACL interface with empty attached to list. How did you do it? This change fixes both issue with adding the empty list checks in these 2 places. How did you verify/test it? Run the add-topo and deploy-mg locally, both works. Any platform specific information? No. [sdn_tests]: Adding GNMI inband sw interface dual switch LoopbackInCnts test. (sonic-net#12951) * [sdn_tests]: Adding Installation test to pins_ondatra. * [sdn_tests]: Adding inband sw interface dual switch test to pins_ondatra. * [sdn_tests]: Adding GNMI inband sw interface dual switch LoopbackInCnts test. [tests/wr_arp] Migrate warm reboot mgmt plane script ferret to py3 (sonic-net#12898) What is the motivation for this PR? The warm reboot test scripts have been migrated to Python 3. The ferret script still runs in Python 2 environment. This PR migrates that to Py3. How did you do it? Run 2to3 Modified script as struct packing handles bytes instead of str. Modified other affected parts to handle bytes directly How did you verify/test it? Ran warm reboot and warm reboot advanced tests on Dell S6100. Tests have passed successfully. [CI/CD] Update elastictest pr test template file, use long term maintained token instead of personal access token (sonic-net#12940) [CI/CD] Update elastictest pr test template file, use long term maintained token instead of personal access token. Compatibility update, in order to ensure that all PRtests that use this template file can transition smoothly. Signed-off-by: Chun'ang Li <[email protected]> Pin requests to version 2.31.0 in main.yml (sonic-net#12959) What is the motivation for this PR? In latest requests python package, would got error in some steps like add-topo and restart-ptf with message 'Not supported URL scheme http+docker' We already have fix PR sonic-net#12910 in master branch to install stable requests version in docker.yml, but once package_installation was set to false like restart-ptf, docker.yml would skip and report error again How did you do it? Install stable requests version in main.yml after executing docker.yml to cover all scenario Enable container autorestart before test_encap_with_mirror_session (sonic-net#12909) Fix qos/test_pfc_pause.py for dualtor-aa (sonic-net#12530) This test was enabled on T0. This test assigns an ip to Eth0 and (sonic-net#12952) checks if MAC resolution happens properly or not. The same functionality is tested by test_neighbor_mac_noptf.py This test fails on T0s because on T0s the Eth0 may b e part of a port channel. As a result the test fails to assign an IP to the Interface. Disablign this test on T0 is the right approach as the same functionality is bening tested on T0 by test_neighbor_mac_noptf.py Support new topology t1-32-lag in acl test (sonic-net#12965) Limit IP addr flushes to global scope IPs (sonic-net#12556) What is the motivation for this PR? Applying the fix in sonic-net#11779 to all tests How did you do it? How did you verify/test it? Include advanced-reboot ptf exception in pytest assertion (sonic-net#12941) What is the motivation for this PR? Surface more information in our test reporting infrastructure to aid in debugging How did you do it? Added more information to a pytest assertion. How did you verify/test it? Artificially added an exception to the try-except block and saw that it was printed out in the pytest assertions. [sdn_tests]: Adding GNMI inband sw interface dual switch LoopbackOutCnts test. (sonic-net#12955) * [sdn_tests]: Adding Installation test to pins_ondatra. * [sdn_tests]: Adding inband sw interface dual switch test to pins_ondatra. * [sdn_tests]: Adding GNMI inband sw interface dual switch LoopbackInCnts test. * [sdn_tests]: Adding GNMI inband sw interface dual switch LoopbackOutCnts test. [Baseline] Fix 1 testplan fail may cancel others issue (sonic-net#12978) What is the motivation for this PR? Baseline test will run a batch of PR tests, and in baseline test, test plan in same platform will run in 1 test job in azure devops. In current logic, once a test plan fails, the test job would catch the sys.exit code and cancel following steps, but we want it only cancel following steps when all test plans fail in the test job How did you do it? Use set -o to continue bash command when fails, get the return code of polling test plan status, if all polling results fail, raise exit code to cancel following steps Add detailed reason for assert failure (sonic-net#12997) What is the motivation for this PR? Add useful information about failed reason. How did you do it? Add the message parameter in pytest_assert How did you verify/test it? Run ssh.test_ssh_limit. [sonic-mgmt]: Skipping pre-commit checks for pins_ondatra patches. (sonic-net#12999) fix: fix bfd static route tests (sonic-net#12995) Add fixes and improvements to bfd/test_bfd_static_route.py. [sdn-tests]: Adding patches to pins_ondatra. (sonic-net#13012) [sdn_tests]:Adding GNMI Get Modes test to pins_ondatra. (sonic-net#12983) [sdn_tests]: Adding inband sw interface test to pins_ondatra. (sonic-net#12984) [sdn_tests]: Adding Software Platform Components Tests to pins_ondatra. (sonic-net#12985)
mrkcmo
pushed a commit
to Azarack/sonic-mgmt
that referenced
this pull request
Jul 17, 2024
…onic-net#8024) * adding lossless response to external pause storm test case Co-authored-by: selldinesh <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
Tests the dynamic response of lossless streams when subject to continuous external PFC pause messages intending to fully block their bandwidth.
Summary:
Fixes # (issue)
Type of change
Back port request
Approach
What is the motivation for this PR?
The motivation here is to check whether DUT’s PFC mechanism responds fast enough to fully stop lossless streams without drops.
How did you do it?
It was tested by having back ground and test flow @ 100% line rate on the rx port and rx port sending the PFC pause frames to the tx side thereby pausing the dut to send additional packets
How did you verify/test it?
Tested against voq chassis with SONiC installed in it
Any platform specific information?
Supported testbed topology if it's a new test case?
T2, T1 & T0
Documentation
Testplan - #8373
##Output
AzDevOps@6105354dad99:~/sonic-mgmt/tests$ py.test --inventory ../ansible/snappi-sonic --host-pattern sonic-s6100-dut --testbed vms-snappi-sonic --testbed_file ../ansible/testbed.csv --show-capture=stdout --log-cli-level info --showlocals -ra --allow_recover --skip_sanity --disable_loganalyzer snappi_tests/multidut/pfc/test_lossless_response_to_external_pause_storms.py
/usr/local/lib/python2.7/dist-packages/ansible/parsing/vault/init.py:44: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in the next release.
from cryptography.exceptions import InvalidSignature
============================================================================================================== test session starts ==============================================================================================================
platform linux2 -- Python 2.7.18, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
ansible: 2.8.20
rootdir: /var/AzDevOps/sonic-mgmt/tests, inifile: pytest.ini
plugins: allure-pytest-2.8.22, celery-4.4.7, ansible-2.2.4, forked-1.3.0, html-1.22.1, metadata-1.11.0, repeat-0.9.1, xdist-1.28.0
collecting 1 item
-------------------------------------------------------------------------------------------------------------- live log collection --------------------------------------------------------------------------------------------------------------
19:51:59 init.pytest_collection_modifyitems L0582 INFO | Available basic facts that can be used in conditional skip:
{
"topo_type": "ptf",
"testbed": "vms-snappi-sonic",
"topo_name": "ptf64"
}
---------------------------------------------------------------------------------------------------------------- live log setup -----------------------------------------------------------------------------------------------------------------
19:51:59 init.set_default L0054 INFO | Completeness level not set during test execution. Setting to default level: CompletenessLevel.basic
19:51:59 init.check_test_completeness L0152 INFO | Test has no defined levels. Continue without test completeness checks
19:52:06 ptfhost_utils.run_icmp_responder_session L0239 INFO | Skip running icmp_responder at session level, it is only for dualtor testbed with active-active mux ports.
19:52:06 conftest.creds_on_dut L0704 INFO | dut sonic-s6100-dut belongs to groups [u'snappi-sonic', u'sonic', u'sonic_dell64_40', 'fanout']
19:52:06 conftest.creds_on_dut L0728 INFO | skip empty var file ../ansible/group_vars/all/corefile_uploader.yml
19:52:06 conftest.creds_on_dut L0728 INFO | skip empty var file ../ansible/group_vars/all/env.yml
19:52:06 conftest.nbrhosts L0521 INFO | No VMs exist for this topology: ptf64
19:52:06 conftest.core_dump_and_config_check L2032 INFO | Collecting core dumps before test on sonic-s6100-dut
19:52:06 conftest.core_dump_and_config_check L2041 INFO | Collecting running config before test on sonic-s6100-dut
19:52:11 init.sanity_check L0125 INFO | Skip sanity check according to command line argument
19:52:11 conftest.generate_params_dut_hostname L1108 INFO | Using DUTs ['sonic-s6100-dut'] in testbed 'vms-snappi-sonic'
19:52:11 conftest.rand_one_dut_hostname L0378 INFO | Randomly select dut sonic-s6100-dut for testing
19:52:11 init._fixture_generator_decorator L0081 INFO | -------------------- fixture enable_packet_aging_after_test setup starts --------------------
19:52:11 init._fixture_generator_decorator L0085 INFO | -------------------- fixture enable_packet_aging_after_test setup ends --------------------
19:52:11 init._fixture_generator_decorator L0081 INFO | -------------------- fixture rand_lossless_prio setup starts --------------------
19:52:11 init._fixture_generator_decorator L0085 INFO | -------------------- fixture rand_lossless_prio setup ends --------------------
19:52:11 init._fixture_generator_decorator L0081 INFO | -------------------- fixture rand_lossy_prio setup starts --------------------
19:52:11 init._fixture_generator_decorator L0085 INFO | -------------------- fixture rand_lossy_prio setup ends --------------------
19:52:11 init._fixture_generator_decorator L0081 INFO | -------------------- fixture start_pfcwd_after_test setup starts --------------------
19:52:11 init._fixture_generator_decorator L0085 INFO | -------------------- fixture start_pfcwd_after_test setup ends --------------------
19:52:11 init._fixture_func_decorator L0069 INFO | -------------------- fixture snappi_api_serv_ip setup starts --------------------
19:52:11 init._fixture_func_decorator L0076 INFO | -------------------- fixture snappi_api_serv_ip setup ends --------------------
19:52:11 init._fixture_func_decorator L0069 INFO | -------------------- fixture snappi_api_serv_port setup starts --------------------
19:52:11 init._fixture_func_decorator L0076 INFO | -------------------- fixture snappi_api_serv_port setup ends --------------------
19:52:11 init._fixture_generator_decorator L0081 INFO | -------------------- fixture snappi_api setup starts --------------------
19:52:11 init._fixture_generator_decorator L0085 INFO | -------------------- fixture snappi_api setup ends --------------------
19:52:12 init._fixture_func_decorator L0069 INFO | -------------------- fixture prio_dscp_map setup starts --------------------
19:52:13 init._fixture_func_decorator L0076 INFO | -------------------- fixture prio_dscp_map setup ends --------------------
19:52:13 init._fixture_func_decorator L0069 INFO | -------------------- fixture lossless_prio_list setup starts --------------------
19:52:14 init._fixture_func_decorator L0076 INFO | -------------------- fixture lossless_prio_list setup ends --------------------
19:52:14 init.loganalyzer L0045 INFO | Log analyzer is disabled
19:52:14 init._fixture_func_decorator L0069 INFO | -------------------- fixture get_multidut_snappi_ports setup starts --------------------
19:52:14 init._fixture_func_decorator L0076 INFO | -------------------- fixture get_multidut_snappi_ports setup ends --------------------
----------------------------------------------------------------------------------------------------------------- live log call -----------------------------------------------------------------------------------------------------------------
19:52:14 snappi_fixtures.__intf_config_multidut L0732 INFO | Configuring Dut: sonic-s6100-dut with port Ethernet12 with IP 20.0.1.1/24
19:52:16 snappi_fixtures.__intf_config_multidut L0732 INFO | Configuring Dut: sonic-s6100-dut with port Ethernet4 with IP 20.0.2.1/24
19:52:17 snappi_fixtures.__intf_config_multidut L0732 INFO | Configuring Dut: sonic-s6100-dut with port Ethernet0 with IP 20.0.3.1/24
19:52:24 connection._warn L0246 WARNING| Verification of certificates is disabled
19:52:24 connection._info L0243 INFO | Determining the platform and rest_port using the 10.36.78.135 address...
19:52:24 connection._warn L0246 WARNING| Unable to connect to http://10.36.78.135:443.
19:52:24 connection._info L0243 INFO | Connection established to
https://10.36.78.135:443 on linux19:52:38 connection._info L0243 INFO | Using IxNetwork api server version 9.30.2212.7
19:52:38 connection._info L0243 INFO | User info IxNetwork/ixnetworkweb/admin-39-18133
19:52:38 snappi_api.info L1132 INFO | snappi-0.9.1
19:52:38 snappi_api.info L1132 INFO | snappi_ixnetwork-0.9.1
19:52:38 snappi_api.info L1132 INFO | ixnetwork_restpy-1.0.64
19:52:39 snappi_api.info L1132 INFO | Config validation 0.012s
19:52:41 snappi_api.info L1132 INFO | Ports configuration 1.723s
19:52:41 snappi_api.info L1132 INFO | Captures configuration 0.163s
19:52:44 snappi_api.info L1132 INFO | Add location hosts [10.36.78.53] 2.348s
19:52:48 snappi_api.info L1132 INFO | Location hosts ready [10.36.78.53] 4.163s
19:52:49 snappi_api.info L1132 INFO | Speed conversion is not require for (port.name, speed) : [('Port 0', u'novusHundredGigNonFanOut'), ('Port 1', u'novusHundredGigNonFanOut'), ('Port 2', u'novusHundredGigNonFanOut')]
19:52:49 snappi_api.info L1132 INFO | Aggregation mode speed change 0.566s
19:52:55 snappi_api.info L1132 INFO | Location preemption [10.36.78.53;6;4, 10.36.78.53;6;2, 10.36.78.53;6;1] 0.110s
19:53:20 snappi_api.info L1132 INFO | Location connect [Port 0, Port 1, Port 2] 25.049s
19:53:21 snappi_api.warning L1138 WARNING| Port 0 connectedLinkDown
19:53:21 snappi_api.warning L1138 WARNING| Port 1 connectedLinkDown
19:53:21 snappi_api.warning L1138 WARNING| Port 2 connectedLinkDown
19:53:21 snappi_api.info L1132 INFO | Location state check [Port 0, Port 1, Port 2] 0.256s
19:53:21 snappi_api.info L1132 INFO | Location configuration 39.486s
19:53:41 snappi_api.info L1132 INFO | Layer1 configuration 20.078s
19:53:41 snappi_api.info L1132 INFO | Lag Configuration 0.087s
19:53:41 snappi_api.info L1132 INFO | Convert device config : 0.243s
19:53:41 snappi_api.info L1132 INFO | Create IxNetwork device config : 0.000s
19:53:42 snappi_api.info L1132 INFO | Push IxNetwork device config : 0.668s
19:53:42 snappi_api.info L1132 INFO | Devices configuration 0.987s
19:53:46 snappi_api.info L1132 INFO | Flows configuration 4.355s
19:53:56 snappi_api.info L1132 INFO | Start interfaces 9.366s
19:53:56 snappi_api.info L1132 INFO | IxNet - The Traffic Item was modified. Please perform a Traffic Generate to update the associated traffic Flow Groups
19:53:56 traffic_generation.run_traffic L0548 INFO | Wait for Arp to Resolve ...
19:53:57 traffic_generation.run_traffic L0565 INFO | Starting transmit on all flows ...
19:54:01 snappi_api.info L1132 INFO | Flows generate/apply 3.135s
19:54:13 snappi_api.info L1132 INFO | Flows clear statistics 12.200s
19:54:13 snappi_api.info L1132 INFO | Captures start 0.000s
19:54:17 snappi_api.info L1132 INFO | Flows start 3.596s
19:54:17 traffic_generation.run_traffic L0572 INFO | Polling DUT for traffic statistics for 20 seconds ...
19:54:37 traffic_generation.run_traffic L0590 INFO | DUT polling complete
19:54:53 traffic_generation.run_traffic L0606 INFO | All test and background traffic flows stopped
19:54:55 traffic_generation.run_traffic L0629 INFO | Dumping per-flow statistics
19:54:56 traffic_generation.run_traffic L0633 INFO | Stopping transmit on all remaining flows
19:54:56 traffic_generation.verify_m2o_results L1045 INFO | Test Flow 1 -> 0, TX Frames:59865900, RX Frames:59865900
19:54:56 traffic_generation.verify_m2o_results L1045 INFO | Test Flow 2 -> 0, TX Frames:59865900, RX Frames:59865900
19:54:56 traffic_generation.verify_m2o_results L1045 INFO | Background Flow 1 -> 0, TX Frames:59865900, RX Frames:59865900
19:54:56 traffic_generation.verify_m2o_results L1045 INFO | Background Flow 2 -> 0, TX Frames:59865900, RX Frames:59865900
19:54:56 snappi_fixtures.cleanup_config L0885 INFO | Removing Configuration on Dut: sonic-s6100-dut with port Ethernet12 with ip :20.0.1.1/24
19:54:59 snappi_fixtures.cleanup_config L0885 INFO | Removing Configuration on Dut: sonic-s6100-dut with port Ethernet4 with ip :20.0.2.1/24
19:55:01 snappi_fixtures.cleanup_config L0885 INFO | Removing Configuration on Dut: sonic-s6100-dut with port Ethernet0 with ip :20.0.3.1/24
PASSED [100%]
--------------------------------------------------------------------------------------------------------------- live log teardown ---------------------------------------------------------------------------------------------------------------
19:55:03 init._fixture_generator_decorator L0093 INFO | -------------------- fixture snappi_api teardown starts --------------------
19:55:20 init._fixture_generator_decorator L0102 INFO | -------------------- fixture snappi_api teardown ends --------------------
19:55:20 init._fixture_generator_decorator L0093 INFO | -------------------- fixture start_pfcwd_after_test teardown starts --------------------
19:55:21 init._fixture_generator_decorator L0102 INFO | -------------------- fixture start_pfcwd_after_test teardown ends --------------------
19:55:21 init._fixture_generator_decorator L0093 INFO | -------------------- fixture rand_lossy_prio teardown starts --------------------
19:55:21 init._fixture_generator_decorator L0102 INFO | -------------------- fixture rand_lossy_prio teardown ends --------------------
19:55:21 init._fixture_generator_decorator L0093 INFO | -------------------- fixture rand_lossless_prio teardown starts --------------------
19:55:21 init._fixture_generator_decorator L0102 INFO | -------------------- fixture rand_lossless_prio teardown ends --------------------
19:55:21 init._fixture_generator_decorator L0093 INFO | -------------------- fixture enable_packet_aging_after_test teardown starts --------------------
19:55:23 init._fixture_generator_decorator L0102 INFO | -------------------- fixture enable_packet_aging_after_test teardown ends --------------------
19:55:23 conftest.core_dump_and_config_check L2069 INFO | Collecting core dumps after test on sonic-s6100-dut
19:55:24 conftest.core_dump_and_config_check L2086 INFO | Collecting running config after test on sonic-s6100-dut
19:55:25 conftest.core_dump_and_config_check L2211 WARNING| Core dump or config check failed for test_lossless_response_to_external_pause_storms.py, results: {"core_dump_check": {"new_core_dumps": {"sonic-s6100-dut": []}, "pass": true}, "config_db_check": {"cur_only_config": {"sonic-s6100-dut": {"null": {}}}, "inconsistent_config": {"sonic-s6100-dut": {"null": {}}}, "pre_only_config": {"sonic-s6100-dut": {"null": {"VLAN_MEMBER": {"Vlan2|Ethernet8": {"tagging_mode": "untagged"}, "Vlan2|Ethernet0": {"tagging_mode": "untagged"}, "Vlan2|Ethernet12": {"tagging_mode": "untagged"}, "Vlan2|Ethernet4": {"tagging_mode": "untagged"}}}}}, "pass": false}}
=============================================================================================================== warnings summary ================================================================================================================
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests.common.plugins.loganalyzer
self.import_plugin(import_spec)
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests.common.plugins.sanity_check
self.import_plugin(import_spec)
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545
/usr/local/lib/python2.7/dist-packages/_pytest/config/init.py:545: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests.common.dualtor
self.import_plugin(import_spec)
snappi_tests/dinesh_response_time_pr/test_lossless_response_to_external_pause_storms.py::test_lossless_response_to_external_pause_storms_test[linecard_configuration_set0-non_chassis_single_line_card]
/usr/local/lib/python2.7/dist-packages/pytest_ansible/module_dispatcher/v28.py:81: UserWarning: provided hosts list is empty, only localhost is available
warnings.warn("provided hosts list is empty, only localhost is available")
-- Docs: https://docs.pytest.org/en/latest/warnings.html
------------------------------------------------------------------------------------------------------------ live log sessionfinish -------------------------------------------------------------------------------------------------------------
19:55:25 init.pytest_terminal_summary L0064 INFO | Can not get Allure report URL. Please check logs
==================== 1 passed, 4 warnings in 207.56 seconds ====================
INFO:root:Can not get Allure report URL. Please check logs