QSfera/docs/ocis/development/beta-testplan.md

title, date, weight, geekdocRepo, geekdocEditPath, geekdocFilePath

title	date	weight	geekdocRepo	geekdocEditPath	geekdocFilePath
Beta testplan	2022-03-24T00:00:00+00:00	37	https://github.com/owncloud/ocis	edit/master/docs/ocis/development	beta-testplan.md

Beta Testing

This document is supposed to give you some ideas how and what to test on ocis. It's not ment to be an extensive list of all tests to be done, rather it should help you, as beta-tester, to get started and enable you to get creative and create own test-cases. Derive from these examples, be creative, do unusual and unconventional things, to try to break things.

One option to create new test-cases and to stress the system is to examine what the API acceptance-tests or the web-UI does, examine the requests and do something a bit different with curl. This is also a good way to find out how APIs work that are not already fully documented.

Some cases have suggested setup steps, but feel free to use other setups. This can include:

• different deployment methods (e.g. running compiled binary, docker-container, docker-compose setup)
• different identity managers (e.g. different external LDAP, internal IDM) TODO documentation link
• different reverse proxies TODO documentation link
• different IdPs TODO documentation link
• different storage systems (cephfs, decompose fs, decompose fs on NFS, EOS, S3 ) are that the things we want to support?

It's a good idea to test ocis in the same environment where you are planning to use it later (with the LDAP server, storage system, etc. of your organisation).

Testplan

user / groups from LDAP

Prerequisite:

• connect ocis to your preferred LDAP server
• create users and groups in LDAP
• start ocis with basic auth OCIS_INSECURE=true PROXY_ENABLE_BASIC_AUTH=true bin/ocis server

documentations resources:

• configure ocis with LDAP TODO link documentation
• sharing API is compatible to ownCloud 10

Test Case	Expected Result	Example / Comment
share file / folder to a group	member of the group can access shared item
share file / folder to a group, remove member from group in LDAP	removed member should not have access to the shared item
share file / folder to a group with different permissions, as receiver try to violate the permissions	receiver should not be able to violate the permissions
try to login with wrong credentials	login should not be possible
set a quota in LDAP, upload files till the quota is exceeded	upload should work till quota is full, uploads should not work when quota is full
try to access files / folders of other users	access should not be possible
try to share with non-existing users and groups	sharing should not be possible
try to share with user/groups-names that contain special characters	sharing should be possible, access shares with that user does not create any problems

other sharing

should be tried in various ways and in different environment

documentations resources:

• sharing API is compatible to ownCloud 10

Test Case	Expected Result	Example / Comment
share a file/folder with the same name from different users	receiver can accept and access both file/folders and distinguish them	known bug
share a file/folder with the same name but different permissions from different users	receiver can access both file/folders according to the permissions	known bug
share a file/folder with the same name but different locations from one user	receiver can accept and access both file/folders and distinguish them	known bug
share a file/folder back to the sharer	sharing back should not be possible
re-share a file/folder with different permissions	sharing with lower permissions is possible, but not with higher
decline received share	share should be gone

parallel deployment

• setup oC10 and ocis is parallel TODO documentation link
• create users and groups in LDAP

Test Case	Expected Result	Example / Comment
share file / folder to a group in one implementation (use different permissions), access the items with the other implementation, try to violate the permissions	receiver should not be able to violate the permissions	TODO curl commands
share file / folder to a group, remove member from group in LDAP, try to access items with the removed member from both implementations	removed member should not have access to the shared item	TODO curl commands

Spaces

Prerequisite:

• create a new user TODO curl commands
• give the user the "Admin" role TODO curl commands

Test Case	Expected Result	Example / Comment
create a space	space should exist	TODO curl commands
create a space with special characters as a name & description	space should exist	TODO curl commands / what are valid characters for space name/ description?
create a space, delete the space	space should not exist	TODO curl commands
create a space, share the space with a user	space should be accessible	TODO curl commands
create a space, share the space with a group	space should be accessible, space content is shared among all users	TODO curl commands
create a space, share the space with a group, disable the space	space should not be accessible	TODO curl commands
create a space, disable the space, try to share the space	sharing the space should not be possible	TODO curl commands
create & share a space with a group with viewer role, do CRUD file/folder operations	space content is readable but neither space not content should not be writable	TODO curl commands
create & share a space with a group with editor role, do CRUD file/folder operations	space and content should be writable	TODO curl commands
create a space, try CRUD file/folder operations on the space with a user that its not shared with	space and content should not be accessible	TODO curl commands
create a space with a quota, share the space, upload files till the quota is exceeded	upload should work till quota is full, uploads should not work when quota is full	TODO curl commands
share file/folders from inside a space (see other sharing section)

Web

Prerequisite:

• connect ocis to your preferred LDAP server
• create users and groups in LDAP
• Use your preferred browser

Test Case	Expected Result	Comment
Login with the created user	Admin logs in.
Create a text file.	Text editor can open, file is saved.
Create a text file with special characters as name	file is created if the name is legal otherwise an error is displayed
Modify a text file.	File can be modified, no problems found.
Rename a file.	File is renamed.
Upload a file.	File is uploaded, no problems found.
Upload multiple files at once.	Files are uploaded, no problems found.
delete all content of a folder at once.	Folder is cleanded, items are visible in the trashbin
Overwrite a file by uploading a new version.	File is uploaded and overwritten, file versions are displayed
Overwrite a file by uploading a new version, restore the original version.	File is restored correctly
upload a huge file	File is uploaded, no problems found.
upload a huge file, cancel the upload, restart the upload	File is uploaded, no problems founnd.
Remove a file.	File is removed correctly, it appears in the trashbin.
Restore the deleted file from trashbin	File is restores correctly
Remove multiple files that have the same name but are located in different folders	Files are removed correctly, they appear in the trashbin.
Restore some of the deleted files from trashbin	Files are restored correctly in the correct folders.
Restore some of the deleted files from trashbin, but delete the original containing folder before	Files are restored correctly
Clean files from the trashbin	files are permanetly deleted
Create a lot of files, delete a lot of files, empty the trashbin	trashbin is cleaned
Move a file inside a folder.	There are not problems on the process.
Move a file inside a folder that already contains a file with the same name	File is not moved, content in the destination is not overwritten
Create a folder.	Folder is created, no MKCOL problems appear.
Create a folder with special characters as name	Folder is created if the name is legal otherwise an error is displayed
Create a folder with a name of an already existing file/folder	Folder is not created, an error is displayed
Create a folder with a lot of subfolders, use special characters in the name	Folder is created, no MKCOL problems appear.
Delete a folder.	Folder is removed.
Move a folder inside another.	No problems while moving the folder.
open images in mediaviewer	files are displayed correctly.
open videos in mediaviewer	files are displayed correctly.
switch through videos and images in mediaviewer	files are displayed correctly.
Share a file by public link.	Link is created and can be accessed.
Share a folder by public link.	Link is created and can be accessed.
Share a file with another user.	It is shared correctly.
Share a folder with another user.	It is shared correctly.
Share a file with a group.	It is shared correctly.
Share a folder with a group.	It is shared correctly.
Share a folder with userB giving edit permissions. As userB do CRUD operations on items inside the received folder	userB doesn't find any problem while interacting with files.
Use your mobile device to access the UI	All elements reachable

Desktop Client

Prerequisite:

• connect ocis to your preferred LDAP server
• create users and groups in LDAP
• use your preferred OS for the desktop client

Test Case	Expected Result	Comment
Set up two clients with the same user. Change files, add some, delete some, move some, create folders.	Changes sync properly in both clients without errors.
Share a file using contextual menu with userB.	Option to share appears in the contextual menu and file is correctly shared.

Mobile Clients (iOS || Android)

Prerequisite:

• connect ocis to your preferred LDAP server
• create users and groups in LDAP

Test Case	Expected Result	Comment
Connect to server, see files, download one.	No problems while downloading.
Upload a file using mobile client.	No problems while uploading.
Share a file with userB using mobile client.	File is correctly shared.

other WebDAV clients

Prerequisite:

• start ocis with basic auth OCIS_INSECURE=true PROXY_ENABLE_BASIC_AUTH=true bin/ocis server

Test Case	Expected Result	Comment
use ocis as webDAV external storage in ownCloud 10	resource access works
use ocis as webDAV external storage in ownCloud 10	resource access works
access webDAV with your file-manager	that will not give you a good UX, but ocis should not crash	Urls: https://<ocis-server>/remote.php/webdav & https://<ocis-server>/remote.php/dav/files/<username>
access webDAV with the "remote-files" function of LibreOffice	files are accessible and can be written back

Tips for testing

WebDav

WebDav is accessible under two different path

• https://<ocis-server>/remote.php/webdav
• https://<ocis-server>/remote.php/dav/files/<username>

WebDav specifications can be found on http://webdav.org/

here some general WebDav requests examples:

variable declaration:

SERVER_URI=https://localhost:9200
API_PATH=remote.php/webdav
USER=admin
PASSWORD=admin

• list content of root folder: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/" -X PROPFIND
• list content of sub-folder: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/f1" -X PROPFIND
• create a folder: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/folder" -X MKCOL
• delete a resource: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/folder" -X DELETE
• rename / move a resource: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/folder" -X MOVE -H "Destination: $SERVER_URI/$API_PATH/renamed"
• copy a resource: curl -k -u $USER:$PASSWORD "$SERVER_URI/$API_PATH/folder" -X COPY -H "Destination: $SERVER_URI/$API_PATH/folder-copy"

decode HTTPS traffic with wireshark

To decode the HTTPS traffic we need the keys that were used to encrypt the traffic. Those keys are kept secret by the clients, but we can request the clients to save them in a specific file, so that wireshark can use them to decrypt the traffic again.

1. create key file: touch /tmp/sslkey.log
2. start wireshark
3. set log filename
   • navigate to Edit=>Preferences=>Protocols=>TLS
   • in the field (Pre)-Master-Secret log filename enter /tmp/sslkey.log
4. decode as HTTP
   • navigate to Analyze=>Decode As...
   • click the + button
   • set Field: TLS Port; Value=9200; Type: Integer, base 10; Default (none); Current HTTP (adjust the port if you are using another one than 9200)
5. start recording
   • use port 9200 as capture filter to only record ocis packages
   • use http as display filter to see only decoded traffic
6. run test-software with SSLKEYLOGFILE=/tmp/sslkey.log as env. variable e.g.
   • curl: SSLKEYLOGFILE=/tmp/sslkey.log curl -k -u admin:admin https://localhost:9200/ocs/v1.php/cloud/users
   • Browser: SSLKEYLOGFILE=/tmp/sslkey.log firefox
   • LibreOffice: SSLKEYLOGFILE=/tmp/sslkey.log libreoffice
   • acceptance tests: SSLKEYLOGFILE=/tmp/sslkey.log make test-acceptance-api ...

format output

• piping xml results to xmllint gives you nice formats. E.g. curl -k --user marie:radioactivity "https://localhost:9200/ocs/v1.php/apps/files_sharing/api/v1/shares" | xmllint --format -
• piping json results to jq gives you nice formats. E.g. curl -k --user marie:radioactivity "https://localhost:9200/ocs/v1.php/apps/files_sharing/api/v1/shares?format=json" | jq

create corner cases

• Big List of Naughty Strings