Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SmokeTest Results 10.0.10RC2 #32565

Closed
6 tasks done
patrickjahns opened this issue Sep 4, 2018 · 9 comments
Closed
6 tasks done

SmokeTest Results 10.0.10RC2 #32565

patrickjahns opened this issue Sep 4, 2018 · 9 comments
Assignees
Labels

Comments

@patrickjahns
Copy link
Contributor

patrickjahns commented Sep 4, 2018

Some scenarios to consider:

Smoke test

Tester assigned: @davitol

Previous requirements

Prepare two servers with ssl activated and trusted certificates.

Enable LDAP and external storage apps.

Have a LDAP server ready to be used with owncloud.

Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.

Testing setup

TestID Test Case Expected Result Result Related Comment
1 Enable encryption app and encryption default module Encryption is enabled correctly ☑️
2 Populate owncloud server with users and groups Users and groups are correctly created ☑️
3 Share a folder remotely using federated sharing with admin user of the other server. folder can be opened in recipient server without problems ☑️
4 Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar. Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists. ☑️
5 Set up two external storages different, disable encryption in one of them. No errors in this process ☑️

Testing functionality

TestID Test Case Expected Result Result Related Comment
1 Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2. Admin user in server #2 can see the file. ☑️
2 Open internet explorer or edge and upload a new avatar for a regular user not LDAP Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine. ☑️
3 Upload several files and folders inside external storages, open some. No problems uploading, files can be downloaded and opened. ☑️
4 Delete files inside both external storages. Recover some after from the trashbin. Files are correctly deleted and restored. ☑️
5 Using webdav upload a 100MiB file. No errors in this process ☑️
@ownclouders
Copy link
Contributor

GitMate.io thinks possibly related issues are #27778 (caldav/carddav syncing problem after upgrade to 10.0.0), #31830 (10.0.9RC1 - FINAL smoke test results), #31096 (10.0.8RC1 - FINAL smoke test results), #31922 (10.0.9RC2 Smoke Test results), and #29252 (Upgrade to 10.0.3 impossible).

@individual-it
Copy link
Member

individual-it commented Sep 12, 2018

Shibboleth smoke tests

  • ownCloud 10.0.10 RC2
  • user_ldap: 0.11.0
  • user_shibboleth: 3.2.0
Test Case Expected Result Result Related Comment
CLI commands
Set Shibboleth mode to Not Active using shibboleth:mode notactive command. ✔️
Set Shibboleth mode to SSO using shibboleth:mode ssoonly command. ✔️
Set Shibboleth mode to Autoprovision using shibboleth:mode autoprovision command. ✔️
Set Shibboleth mapping fields using shibboleth:mapping command. setting ./occ shibboleth:mapping -d "uid" sets the value also in the webUI but seems not to have any effect to the displayName
WebUI
Check User Authentication section appears in Settings/Admin menu ✔️
Set Shibboleth mode to Not Active using the dropdown menu and check its value via CLI ✔️
Set Shibboleth mode to Autoprovision using the dropdown menu and check its value via CLI ✔️
Set Shibboleth mode to SSO using the dropdown menu and check its value via CLI ✔️
Autoprovision Mode
Set Shibboleth mode to Autoprovision and log in with a Shib user ✔️
Try to log out from user's oC session and check how ownCloud behaves message is shown saying "You are currently logged in using Shibboleth authentication. You must close your browser to log out of ownCloud." ✔️
SSO Mode
Set Shibboleth mode to SSO and log in with a Shib user ✔️
Set Shibboleth mode to SSO and log in with a Shib user that not fit case sensitive with the LDAP backend The user should be able to log in due to it is case insensitive ✔️
Try to log out from user's oC session and check how ownCloud behaves message is shown saying "You are currently logged in using Shibboleth authentication. You must close your browser to log out of ownCloud." ✔️
Not Active Mode
Set Shibboleth mode to Not Active and check that Shib users cannot log in anymore ✔️

@individual-it individual-it self-assigned this Sep 12, 2018
@davitol davitol changed the title SmokeTest Results 10.0.10RC1 SmokeTest Results 10.0.10RC2 Sep 12, 2018
@individual-it
Copy link
Member

individual-it commented Sep 13, 2018

LDAP smoke tests

  • run all LDAP acceptance tests with ownCloud RC2
  • run all core API acceptance tests tagged @TestAlsoOnExternalUserBackend with ownCloud RC2
  • run all core webUI acceptance tests tagged @TestAlsoOnExternalUserBackend with ownCloud RC2
Test Case Expected Result Result Related Comment
ldap:test-config
Run occ command ldap:test-config with a valid configID Access fine ✔️ The configuration is valid and the connection could be established!
Run occ command ldap:test-config with a wrong host (the host changed from a valid configuration) Lost connection to LDAP server ✔️
Run occ command ldap:test-config with empty password The configuration is invalid. Please have a look at the logs for further details ✔️
Run occ command ldap:test-config with invalid configID ERROR: Invalid configID ✔️
ldap:show-config
Run occ command ldap:show-config with no parameters Show all configurations available ✔️
Run occ command ldap:show-config with valid configID Show only the specified configuration ✔️
Run occ command ldap:show-config with invalid configID ERROR: Invalid configID ✔️
Run occ command ldap:show-config with show-password flag ldapAgentPassword shows the password in the result ✔️
Run occ command ldap:show-config without show-password flag ldapAgentPassword hides the password in the result (uses “****”) ✔️
ldap:set-config
Run occ command ldap:set-config with invalid configID ERROR: Invalid configID ✔️
Run occ command ldap:set-config with valid configID The config is set ✔️
ldap:search
Run occ command ldap:search with valid configuration and no params (just the search one) Show results (currently 15 or less) ✔️
Run occ command ldap:search with valid configuration and shortes limit Show results ✔️
Run occ command ldap:search with offset multiple of limit (both positive) Show results ✔️
Run occ command ldap:search Group without search Show groups (currently 15 or less) ✔️
ldap:check-user
Run occ command ldap:check-user with a good oC user id Show success message ✔️
Run occ command ldap:check-user with a wrong oC user id ERROR: ldap user not recognized ✔️
Run occ command ldap:check-user with a good oC user id + 1 disabled configuration ERROR: Cannot check user existence ✔️
ldap:create-empty-config
Run occ command ldap:create-empty-config Creates an empty LDAP configuration ✔️
ldap:delete-config
Run occ command ldap:delete-config Deletes an existing LDAP configuration ✔️
user:sync
Run occ command sudo -u www-data ./occ user:sync "OCA\User_LDAP\User_Proxy" This command syncs users stored in LDAP external backend service ✔️

@jesmrec
Copy link

jesmrec commented Sep 13, 2018

Smoke test Android [DONE]

Device & Android version: Nexus 5X v8.1.0
Android app version: 2.8.0 stable
Server version: 10.0.10RC2
OAuth2 version: 0.2.3

Login

Test Case Expected Result Result Related Comment
Login with one account (HTTPS) It is possible to access
Login with one account (HTTP) It is possible to access
Login with one account OAuth2 It is possible to access

Folder

TestID Test Case Steps Expected Result Result Related Comment
1 Create a new folder 1. Tap on create a new folder The folder is created ✅ basic
✅ OAuth2
2 Create a folder with special character 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)
The folder is created with special character ✅ basic
✅ OAuth2
3 Rename a folder 1. Create a new folder
2. Rename the folder
Folder is renamed ✅ basic
✅ OAuth2
4 Move a folder 1. Create a new folder
2. Move the folder
Folder is moved to the specifield location ✅ basic
✅ OAuth2
5 Upload a file into a folder 1. Create a new folder
2. Upload a file
File is uploaded into the folder ✅ basic
✅ OAuth2
6 Delete a folder 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder
2. The files are downloaded
3. The folder is removed
✅ basic
✅ OAuth2
7 Copy Folder 1. Long press to copy a folder
2. Select a location to paste
The folder and all its content is copied in the location, and remains too in the original ✅ basic
✅ OAuth2
8 Share the folder by link 1. Create a new folder
2. Long press to share the folder by link
The link is generated and works ✅ basic
✅ OAuth2
9 Share the folder by link with pass 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password
The link is generated and only works if the correct password is typed ✅ basic
✅ OAuth2
10 Unshare the folder by link 1. Unshare the folder of previous test cases The link is no more available ✅ basic
✅ OAuth2
11 Share the folder with users or groups 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the folder ✅ basic
✅ OAuth2
12 Unshare the folder with users or groups 1. Unshare the folder in the previous test case The folder is not more available for the sharees ✅ basic
✅ OAuth2
13 Sync a folder 1. Create a folder
2. In web app, upload some files in the folder
3. Long press to sync the folder
The folder is sync with the content on server ✅ basic
✅ OAuth2

File

TestID Test Case Steps Expected Result Result Related Comment
1 Upload a new file 1. Upload a new file The file is uploaded ✅ basic
✅ OAuth2
2 Upload a file with special character 1. Upload a new file (e.g f%&¨) The file is uploaded ✅ basic
✅ basic
✅ OAuth2
3 Rename a file 1. Create a new file
2. Rename the file
The file is renamed ✅ basic
✅ OAuth2
4 Move a file 1. Create a new file
2. Move the file
The file is renamed ✅ basic
✅ OAuth2
5 Copy a file 1. Create a new file
2. Copy the file
The file is copied to the selected location ✅ basic
✅ OAuth2
6 Delete a file 1. Create a new file
2. Delete the file
The file is deleted ✅ basic
✅ OAuth2
7 Share the file by link 1. Create a file
2. Long press to share the file by link
The link is generated and works ✅ basic
✅ OAuth2
8 Share the file by link with pass 1. Create a file
2. Long press to share the file by link
3. Set a password
The link is generated and works when the correct pass is typed ✅ basic
✅ OAuth2
9 Unshare the file by link 1. Unshare the file of previous test cases The link is no more available ✅ basic
✅ OAuth2
10 Share the file with users or groups 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the file ✅ basic
✅ OAuth2
11 Unshare the file with users or groups 1. Unshare the file in the previous test case The file is not more available for the sharees ✅ basic
✅ OAuth2
12 Download a file 1. Tap to download a file The file is downloaded and marked with green arrow ✅ basic
✅ OAuth2
13 Av Offline file 1. Long press to set as Av Offline a file The file is downloaded and set as Av Offline with the yellow arrow ✅ basic
✅ OAuth2
14 Av Offline file 1. Long press to unset an Av Offline a Av Offline file The file has no more the yellow arrow ✅ basic
✅ OAuth2

@jesmrec
Copy link

jesmrec commented Sep 13, 2018

Smoke test iOS [DONE]

Device & iOS version: iPhone 6SPlus v11
iOS app version: 3.8.0
Server version: 10.0.10RC2
OAuth2 version: 0.2.3

Login

Test Case Expected Result Result Related Comment
Login with one account (HTTPS) It is possible to access
Login with one account (HTTP) It is possible to access

Folder

TestID Test Case Steps Expected Result Result Related Comment
1 Create a new folder 1. Tap on create a new folder The folder is created ✅ OAuth
✅ basic
2 Create a folder with special character 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)
The folder is created with special character ✅ OAuth
✅ basic
3 Rename a folder 1. Create a new folder
2. Rename the folder
Folder is renamed ✅ OAuth
✅ basic
4 Move a folder 1. Create a new folder
2. Move the folder
Folder is moved to the specifield location ✅ OAuth
✅ basic
5 Upload a file into a folder 1. Create a new folder
2. Upload a file
File is uploaded into the folder ✅ OAuth
✅ basic
6 Delete a folder 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder
2. The files are downloaded
3. The folder is removed
✅ OAuth
✅ basic
7 Copy Folder 1. Long press to copy a folder
2. Select a location to paste
The folder and all its content is copied in the location, and remains too in the original NA
8 Share the folder by link 1. Create a new folder
2. Long press to share the folder by link
The link is generated and works ✅ OAuth
✅ basic
9 Share the folder by link with pass 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password
The link is generated and only works if the correct password is typed ✅ OAuth
✅ basic
10 Unshare the folder by link 1. Unshare the folder of previous test cases The link is no more available ✅ OAuth
✅ basic
11 Share the folder with users or groups 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the folder ✅ OAuth
✅ basic
12 Unshare the folder with users or groups 1. Unshare the folder in the previous test case The folder is not more available for the sharees ✅ OAuth
✅ basic

File

TestID Test Case Steps Expected Result Result Related Comment
1 Upload a new file 1. Upload a new file The file is uploaded ✅ OAuth
✅ basic
2 Upload a file with special character 1. Upload a new file (e.g f%&¨) The file is uploaded ✅ OAuth
✅ basic
3 Rename a file 1. Create a new file
2. Rename the file
The file is renamed ✅ OAuth
✅ basic
4 Move a file 1. Create a new file
2. Move the file
The file is renamed ✅ OAuth
✅ basic
5 Copy a file 1. Create a new file
2. Copy the file
The file is copied to the selected location NA
6 Delete a file 1. Create a new file
2. Delete the file
The file is deleted ✅ OAuth
✅ basic
7 Share the file by link 1. Create a file
2. Long press to share the file by link
The link is generated and works ✅ OAuth
✅ basic
8 Share the file by link with pass 1. Create a file
2. Long press to share the file by link
3. Set a password
The link is generated and works when the correct pass is typed ✅ OAuth
✅ basic
9 Unshare the file by link 1. Unshare the file of previous test cases The link is no more available ✅ OAuth
✅ basic
10 Share the file with users or groups 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with
The user/group can access to the file ✅ OAuth
✅ OAuth
✅ basic
11 Unshare the file with users or groups 1. Unshare the file in the previous test case The file is not more available for the sharees ✅ OAuth
✅ basic
12 Download a file 1. Tap to download a file The file is downloaded and marked with green tick ✅ OAuth
✅ basic
13 Av Offline file 1. Long press to set as av offline a file The file is downloaded and set as av off with the yellow arrow ✅ OAuth
✅ basic
14 Av Offline file 1. Long press to set as no av offline a file The file has no more the yellow arrow ✅ OAuth
✅ basic

@davitol
Copy link
Contributor

davitol commented Sep 13, 2018

Test Plan wnd:listen and process-queue

Previous requirements

Have a WND mountPoint configured

Testing functionality

Test Case Expected Result Result Related Comment
Run WND:listen command against a WND mountpoint with Log-in Credentials, save in session The command should run OK and start listening
Run WND:listen command against a WND mountpoint with Log-in Credentials, save in database The command should run OK and start listening
Run WND:listen command against a WND mountpoint with user entered, store in database The command should run OK and start listening
Run WND:listen command against a WND mountpoint with Global Credentials The command should run OK and start listening
Run WND:listen command against a WND mountpoint with username and password credentials The command should run OK and start listening
Run wnd:process-queue command against a WND mountpoint with Log-in Credentials, save in session An error should be thrown.
Run wnd:process-queue command against a WND mountpoint with Log-in Credentials, save in database The command should run OK and start processing the queue
Run wnd:process-queue command against a WND mountpoint with user entered, store in database The command should run OK and start processing the queue
Run wnd:process-queue command against a WND mountpoint with Global Credentials The command should run OK and start start processing the queue
Run wnd:process-queue command against a WND mountpoint with username and password credentials The command should run OK and start processing the queue
Upload a file from the Desktop Client to a WND mountpoint The file should not be downloaded again #32552
Modify a file/folder in the WND backend The file should change in ownCloud and in the Desktop Client folder
Rename a file/folder in the WND backend The file should change in ownCloud and in the Desktop Client folder
Delete a file/folder in the WND backend The file should change in ownCloud and in the Desktop Client folder
Change the permissions of a file in the WND backend The file should change in ownCloud and in the Desktop Client folder

Issues to be taken into account

Owncloud Server Unsyncs all data from client and then resyncs #32552
FIle is deleted when renaming the file in a SMB mountpoint https://github.com/owncloud/windows_network_drive/issues/193

@davitol
Copy link
Contributor

davitol commented Sep 14, 2018

'Guest App' Test Plan

  • Run Testplan with encryption enabled

Testing functionality

Test Case Expected Result Result Related Comment
CLI commands
Enable Guest app via CLI using occ app:enable guests The apps is enabled
Disable Guest app via CLI using occ app:disable guests The apps is disabled
Add Guest User in sharetabview
Create a guest user via email
Create a guest user via email sharing from an LDAP user
Try to create a guest user via email when a server email is not set or it is invalid Guest option is not shown
Try to create a guest user via email with an invalid email format An error message should be shown
Try to create a guest user via email with an already used email Guest option is not shown
Try to create a guest user via email already registered by email A warning about the token is invalid should be shown
Try to create a guest user via email with an already used User Search Attribute set in LDAP wizard Guest option is not shown
Create a guest user via email using a password that fits password policy Check that the user receives the email and can register into oC
Create a guest user via email using a password that doesn't fit password policy Check that the user receives the email and cannot register into oC. A warning related to password policy should be shown
Users Menu
Delete a guest user in user's menu The user is deleted and no longer available in oC. Check that user disappears from sharetabviews
Try to create a regular user in users menu adding it to the guest_group The user should not be created. A warning should be shown owncloud/guests#91
Change the guest user's password in users menu The new password is set for the guest user
Guest User account
Log in the guest user account Check that the shared file/folder appears with the right permissions
Log in the guest user account Edit/download/Rename file
Settings page
Change Guest Group name The group name for guest is changed. Check this change in Users Page and the shares are kept
Set Guest Group name as empty A warning error should be shown and the previous name should be kept
Limit guest access to an app whitelist checked, modify the list and save Check that only apps listed are available for guests users
WebUI and browsers
Check that guests menu in sharing section works fine using FireFox as browser
Check that guests menu in sharing section works fine using Chrome as browser
Check that guests menu in sharing section works fine using Safari as browser

@davitol
Copy link
Contributor

davitol commented Sep 14, 2018

Impersonate Test Plan

Test Case Expected Result Result Related Comment
Enable the app. No problems found.
As admin create a group 'group1' add three members 'user1', 'user2', 'user3'. Make 'user1' group admin of 'group1'. Login as 'user1', go to the users view. Impersonate 'user2'. 'user1' can impersonate 'user2'. See his files. Behave like him. Like if he were logged in.
Check that a user who is not group admin cannot impersonate anyone.
As admin create a group 'group1' add four members 'user1', 'user2', 'user3' and 'admin' being admin user of the server. Make 'user1' group admin of 'group1'. Login as 'user1', go to the users view. Impersonate 'admin'. Super admin cannot be impersonated.
When impersonating a user, a warning appears adverting that you have logged as another user. a warning appears.
Check that impersonate options appears in the correct settings panel.
Interaction with other Apps
Having ldap set up, enable impersonation for an ldap group. Make a user group admin. Using that user impersonate one of the other members of the ldap group. Users can be impersonated without problems.
A guest user cannot impersonate other users.
A guest user can be impersonated / can logout
As admin, log in using a app password and impersonate a user
Browsers
Check that all the UI elements are usable when browsing with safari.
Check that all the UI elements are usable when browsing with chrome.
Check that all the UI elements are usable when browsing with firefox.

@davitol
Copy link
Contributor

davitol commented Sep 14, 2018

No blocker issue was found so let's close this ticket and build RC4

@davitol davitol closed this as completed Sep 14, 2018
@lock lock bot locked as resolved and limited conversation to collaborators Sep 14, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

5 participants