Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

e2e: false failures fixes #16262

Merged
merged 1 commit into from
Jun 14, 2023
Merged

e2e: false failures fixes #16262

merged 1 commit into from
Jun 14, 2023

Conversation

yevh-berdnyk
Copy link
Contributor

No description provided.

@yevh-berdnyk yevh-berdnyk requested a review from churik as a code owner June 13, 2023 16:55
@yevh-berdnyk yevh-berdnyk self-assigned this Jun 13, 2023
@status-im-auto
Copy link
Member

status-im-auto commented Jun 13, 2023 •
edited
Loading

Jenkins Builds

Click to see older builds (4)
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 237ee29 #1 2023-06-13 17:00:59 ~5 min android-e2e 🤖apk 📲
✔️ 237ee29 #1 2023-06-13 17:01:23 ~5 min android 🤖apk 📲
✔️ 237ee29 #1 2023-06-13 17:01:55 ~6 min ios 📱ipa 📲
✔️ 237ee29 #1 2023-06-13 17:03:34 ~8 min tests 📄log
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ be61818 #3 2023-06-13 22:28:57 ~5 min android 🤖apk 📲
✔️ be61818 #3 2023-06-13 22:29:15 ~5 min android-e2e 🤖apk 📲
✔️ be61818 #3 2023-06-13 22:29:22 ~6 min ios 📱ipa 📲
✔️ be61818 #3 2023-06-13 22:32:38 ~9 min tests 📄log
✔️ cfefc2d #4 2023-06-13 23:57:01 ~5 min ios 📱ipa 📲
✔️ cfefc2d #4 2023-06-13 23:57:09 ~6 min android 🤖apk 📲
✔️ cfefc2d #4 2023-06-13 23:57:21 ~6 min android-e2e 🤖apk 📲
✔️ cfefc2d #4 2023-06-13 23:58:39 ~7 min tests 📄log

@yevh-berdnyk yevh-berdnyk force-pushed the tests/false-failures-fixes branch 2 times, most recently from 5793c6b to be61818 Compare June 13, 2023 22:23
@status-im-auto
Copy link
Member

79% of end-end tests have passed

Total executed tests: 33
Failed tests: 7
Passed tests: 26

IDs of failed tests: 702732,702783,702733,702855,702731,702786,702894

Failed tests (7)

Click to expand
  • Rerun failed tests

    • Class TestCommunityMultipleDeviceMerged:

    1. test_community_mentions_push_notification, id: 702786

    # STEP: Admin gets push notification with the mention and tap it
    Device 1: Getting PN by 'user_1' 

    critical/test_public_chat_browsing.py:859: in test_community_mentions_push_notification
    self.errors.verify_no_errors()
base_test_case.py:182: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Push notification with the mention was not received by admin



    Device sessions

    2. test_community_contact_block_unblock_offline, id: 702894

    Device 1: Looking for a message by text: Hurray! unblocked
    Device 1: Find ChatElementByText by xpath: //*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item'] 

    critical/test_public_chat_browsing.py:742: in test_community_contact_block_unblock_offline
    chat_element.find_element()
../views/chat_view.py:134: in find_element
    self.wait_for_visibility_of_element(20)
../views/base_element.py:135: in wait_for_visibility_of_element
    raise TimeoutException(
 Device 1: ChatElementByText by xpath:`//*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` is not found on the screen after wait_for_visibility_of_element



    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_pin_messages, id: 702732 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783

    # STEP: Device1 goes back online and checks that 1-1 chat will be fetched
    Device 1: Looking for a message by text: test message 

    critical/chats/test_1_1_public_chats.py:1253: in test_1_1_chat_is_shown_message_sent_delivered_from_offline
    self.errors.verify_no_errors()
base_test_case.py:182: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Message status was not delivered after back up online, it is "Sending"!

    [[Issue with messages not being sent for a long time]]

    Device sessions

    2. test_1_1_chat_text_message_delete_push_disappear, id: 702733

    Device 2: Find Text by xpath: //*[starts-with(@text,'smth I should edit')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']
    Device 2: Tap on found: Text 

    critical/chats/test_1_1_public_chats.py:1162: in test_1_1_chat_text_message_delete_push_disappear
    self.chat_2.chat_element_by_text(message_after_edit_1_1).wait_for_status_to_be("Delivered")
../views/chat_view.py:228: in wait_for_status_to_be
    raise TimeoutException("Message status was not changed to %s, it's %s" % (expected_status, current_status))
 Message status was not changed to Delivered, it's Sending

    [[Message is being in status 'Sending' for a long time: https://github.com//issues/15385]]

    Device sessions

    3. test_1_1_chat_edit_message, id: 702855

    Device 2: Find Text by xpath: //*[starts-with(@text,'Message before edit 1-1')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='message-status']/android.widget.TextView
    Device 2: Text is Sent 

    critical/chats/test_1_1_public_chats.py:1142: in test_1_1_chat_edit_message
    self.chat_2.chat_element_by_text(message_before_edit_1_1).wait_for_status_to_be("Delivered")
../views/chat_view.py:228: in wait_for_status_to_be
    raise TimeoutException("Message status was not changed to %s, it's %s" % (expected_status, current_status))
 Message status was not changed to Delivered, it's Sent

    [[Message is being in status 'Sending' for a long time: https://github.com//issues/15385]]

    Device sessions

    4. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Passed tests (26)

    Click to expand

    Class TestActivityMultipleDevicePR:

    1. test_navigation_jump_to, id: 702936
    Device sessions

    2. test_activity_center_mentions, id: 702957
    Device sessions

    3. test_activity_center_admin_notification_accept_swipe, id: 702958
    Device sessions

    4. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    2. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    3. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    4. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    5. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    2. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_unread_messages_badge, id: 702841
    Device sessions

    2. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    3. test_community_several_images_send_reply, id: 703194
    Device sessions

    4. test_community_message_send_check_timestamps_sender_username, id: 702838
    Device sessions

    5. test_community_message_edit, id: 702843
    Device sessions

    6. test_community_message_delete, id: 702839
    Device sessions

    7. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    8. test_community_one_image_send_reply, id: 702859
    Device sessions

    9. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    10. test_community_leave, id: 702845
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    2. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    3. test_restore_multiaccount_with_waku_backup_remove_switch, id: 703133
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_join_send_text_messages_push, id: 702807
    Device sessions

    2. test_group_chat_offline_pn, id: 702808
    Device sessions

    @yevh-berdnyk yevh-berdnyk force-pushed the tests/false-failures-fixes branch from be61818 to cfefc2d Compare June 13, 2023 23:50
    @status-im-auto
    Copy link
    Member

    50% of end-end tests have passed

    Total executed tests: 2
Failed tests: 1
Passed tests: 1

    IDs of failed tests: 702894

    Failed tests (1)

    Click to expand
  • Rerun failed tests

    • Class TestCommunityMultipleDeviceMerged:

    1. test_community_contact_block_unblock_offline, id: 702894

    Device 1: Looking for a message by text: Hurray! unblocked
    Device 1: Find `ChatElementByText` by `xpath`: `//*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` 

    critical/test_public_chat_browsing.py:742: in test_community_contact_block_unblock_offline
    chat_element.find_element()
../views/chat_view.py:134: in find_element
    self.wait_for_visibility_of_element(20)
../views/base_element.py:135: in wait_for_visibility_of_element
    raise TimeoutException(
 Device 1: ChatElementByText by xpath:`//*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` is not found on the screen after wait_for_visibility_of_element



    Device sessions

    Passed tests (1)

    Click to expand

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_mentions_push_notification, id: 702786
    Device sessions

    @yevh-berdnyk yevh-berdnyk merged commit cfefc2d into develop Jun 14, 2023
    @yevh-berdnyk yevh-berdnyk deleted the tests/false-failures-fixes branch June 14, 2023 00:21
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Reviewers

    @pavloburykh pavloburykh pavloburykh approved these changes

    @churik churik Awaiting requested review from churik churik is a code owner

    Assignees

    @yevh-berdnyk yevh-berdnyk

    Labels
    tests
    Projects
    No open projects
    Legacy QA Automation Project
    Archived in project
    Milestone
    No milestone
    Development

    Successfully merging this pull request may close these issues.
    3 participants
    @yevh-berdnyk @status-im-auto @pavloburykh