-
Notifications
You must be signed in to change notification settings - Fork 687
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Release SecureDrop 0.10.0 #3849
Comments
Note to self (and others wishing to test upgrade path on HW) - ansible playbook to set instance up to use apt-test. instead of apt. is here: |
0.10.0 QA ChecklistFor both upgrades and fresh installs, here is a list of functionality that requires testing. You can use this for copy/pasting into your QA report. Feel free to edit this message to update the plan as appropriate. If you have submitted a QA report already for a 0.10.0 release candidate with successful basic server testing and application acceptance testing sections, then you can skip these sections in subsequent reports, unless otherwise indicated by the Release Manager. This is to ensure that you focus your QA effort on the 0.10.0-specific changes as well as changes since the previous release candidate. Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
PreflightThese tests should be performed the day of release prior to live debian packages on apt.freedom.press Basic testing
Tails
|
0.10.0 QA ChecklistFor both upgrades and fresh installs, here is a list of functionality that requires testing. You can use this for copy/pasting into your QA report. Feel free to edit this message to update the plan as appropriate. If you have submitted a QA report already for a 0.10.0 release candidate with successful basic server testing and application acceptance testing sections, then you can skip these sections in subsequent reports, unless otherwise indicated by the Release Manager. This is to ensure that you focus your QA effort on the 0.10.0-specific changes as well as changes since the previous release candidate. Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
PreflightThese tests should be performed the day of release prior to live debian packages on apt.freedom.press Basic testing
Tails
|
0.10.0 QA Checklist (Completed)Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
|
Guys, I’m thinking this is an indication that SecureDrop 0.10 will ship soon.
Rob
From: mickael e. [mailto:[email protected]]
Sent: Wednesday, October 17, 2018 11:49 AM
To: freedomofpress/securedrop <[email protected]>
Cc: Subscribed <[email protected]>
Subject: [EXTERNAL] Re: [freedomofpress/securedrop] Release SecureDrop 0.10.0 (#3849)
0.10.0 QA Checklist
Environment
* Install target: Intel NUC5PYH
* Tails version: 3.9
* Test Scenario: clean install
* SSH over Tor: disabled
* Release candidate: 0.10.0-rc2
Basic Server Testing
* [X] I can access both the source and journalist interfaces
* [X] I can SSH into both machines over Tor
* [X] AppArmor is loaded on app
* [X] AppArmor is loaded on mon
* [X] Both servers are running grsec kernels
* [X] iptables rules loaded
* [X] OSSEC emails begin to flow after install
* [X] OSSEC emails are decrypted to correct key and I am able to decrypt them
Command Line User Generation
* [X] Can successfully add admin user and login
Administration
* [ ] I have backed up and successfully restored the app server following the documentation here: https://docs.securedrop.org/en/latest/backup_and_restore.html
* [ ] If doing upgrade testing, make a backup on 0.9.x and restore this backup on 0.10.0. Confirm that no further action is necessary and that (#3737<#3737>) worked correctly.
Application Acceptance Testing
Source Interface
Landing page base cases
* [X] JS warning bar does not appear when using Security Slider high
* [X] JS warning bar does appear when using Security Slider Low
First submission base cases
* [X] On generate page, refreshing codename produces a new 7-word codename
* [X] On submit page, empty submissions produce flashed message
* [X] On submit page, short message submitted successfully
* [X] On submit page, file greater than 500 MB produces "The connection was reset" in Tor Browser quickly before the entire file is uploaded
* [X] On submit page, file less than 500 MB submitted successfully
Returning source base cases
* [X] Nonexistent codename cannot log in
* [X] Empty codename cannot log in
* [X] Legitimate codename can log in
* [X] Returning user can view journalist replies - need to log into journalist interface to test
Journalist Interface
Login base cases
* [X] Can log in with 2FA tokens
* [X] incorrect password cannot log in
* [X] invalid 2fa token cannot log in
* [X] 2fa immediate reuse cannot log in
Index base cases
* [X] Filter by codename works
* [X] Starring and unstarring works
* [X] Click select all selects all submissions
* [X] Selecting all and clicking "Download" works
Individual source page
* [X] You can submit a reply and a flashed message and new row appears
* [X] You cannot submit an empty reply
* [X] Clicking "Delete Source And Submissions" and the source and docs are deleted
* [X] You can click on a document and successfully decrypt using application private key
Basic Tails Testing
Updater GUI
After updating to this release candidate and running securedrop-admin tailsconfig
* [ ] The Updater GUI appears on boot
* [ ] Updating occurs without issue after ensuring there were no staged changes
0.10.0-specific changes
* [X] OSSEC agent and server is 3.0.0 (#3701<#3701>)
* [ ] Upgrade test: ensure that OSSEC alerts continue to flow after upgrade
* [X] Fresh install: ensure that OSSEC alerts flow without issue
* [ ] (Upgrade only) Latest kernel version is selected for boot on a previously downgraded instance (#3857<#3857>)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<#3849 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AKBwx3HZ1J8oIARHc8QaZuo26FLhiC1Dks5ul1F_gaJpZM4XK_dU>.
|
@robzim 🤞 |
0.10.0 QA ChecklistFor both upgrades and fresh installs, here is a list of functionality that requires testing. You can use this for copy/pasting into your QA report. Feel free to edit this message to update the plan as appropriate. If you have submitted a QA report already for a 0.10.0 release candidate with successful basic server testing and application acceptance testing sections, then you can skip these sections in subsequent reports, unless otherwise indicated by the Release Manager. This is to ensure that you focus your QA effort on the 0.10.0-specific changes as well as changes since the previous release candidate. Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
PreflightThese tests should be performed the day of release prior to live debian packages on apt.freedom.press Basic testing
Tails
|
0.10.0 QA ChecklistFor both upgrades and fresh installs, here is a list of functionality that requires testing. You can use this for copy/pasting into your QA report. Feel free to edit this message to update the plan as appropriate. If you have submitted a QA report already for a 0.10.0 release candidate with successful basic server testing and application acceptance testing sections, then you can skip these sections in subsequent reports, unless otherwise indicated by the Release Manager. This is to ensure that you focus your QA effort on the 0.10.0-specific changes as well as changes since the previous release candidate. Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
0.10.0-rc3-specific changes
Preflight
These tests should be performed the day of release prior to live debian packages on apt.freedom.press Basic testing
Tails
|
0.10.0 QA ChecklistPerformed a limited upgrade test on two (2) 1U form-factor servers, specifically to confirm upgrade to latest kernel from rolled back kernel (3.14.79-grsec). Testing was a success. Did not perform the general application testing steps, since those are well covered already by the reports above. Environment
Basic Server Testing
Relevant terminal outputFor validating kernel -> downgrade -> upgrade process. Manually activated virtualenv, then ran through a few steps for informative output. Confirming the latest kernels are running on 0.9.1:
Display hardware type for each server, to aid debugging if problems arise:
Followed the docs and manually rolled back both servers to 3.14.79-grsec. Worked:
Ran QA playbook, cron-apt command, then rebooted via CLI to test the kernel update procedure.
Success! |
0.10.0-rc4 (Completed)Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
0.10.0-rc3-specific changes
0.10.0-rc4-specific changes
|
0.10.0 QA ChecklistFor both upgrades and fresh installs, here is a list of functionality that requires testing. You can use this for copy/pasting into your QA report. Feel free to edit this message to update the plan as appropriate. If you have submitted a QA report already for a 0.10.0 release candidate with successful basic server testing and application acceptance testing sections, then you can skip these sections in subsequent reports, unless otherwise indicated by the Release Manager. This is to ensure that you focus your QA effort on the 0.10.0-specific changes as well as changes since the previous release candidate. Environment
Basic Server Testing
Command Line User Generation
Administration
Application Acceptance TestingSource InterfaceLanding page base cases
First submission base cases
Returning source base cases
Journalist InterfaceLogin base cases
Index base cases
Individual source page
Basic Tails TestingUpdater GUIAfter updating to this release candidate and running
0.10.0-specific changes
0.10.0-rc3-specific changes
0.10.0-rc4-specific changes
Preflight
These tests should be performed the day of release prior to live debian packages on apt.freedom.press Basic testing
Tails
|
This is a tracking issue for the upcoming release of SecureDrop 0.10.0 - tasks may get added or modified.
Feature freeze: October 9, 2018
String freeze: October 16, 2018
Pre-release announcement: October 16, 2018
Release date: October 23, 2018
SecureDrop maintainers and testers: As you QA 0.10.0, please report back your testing results as comments on this ticket. File GitHub issues for any problems found, tag them "QA: Release", and associate them with the 0.10.0 milestone for tracking (or ask a maintainer to do so).
Test debian packages will be posted on https://apt-test.freedom.press signed with the test key. An Ansible playbook testing the upgrade path is here.
Prepare release candidate (0.10.0~rc1)
0.10.0~rc1
on test apt serverWe merged in two important fixes prior to building debs for
rc1
so stopped herePrepare release candidate (0.10.0~rc2)
0.10.0~rc2
on test apt server - @emkllPrepare release candidate (0.10.0~rc3)
0.10.0~rc3
on test apt server - @emkllPrepare release candidate (0.10.0~rc4)
0.10.0~rc4
on test apt server - @emkll[we will add checklists for rc5 release candidates and later as we proceed through the release process]
Test plan to be posted during business hours Pacific time on Wednesday, October 10th.
QA Matrix for 0.10.0
Test Plan for 0.10.0
After each test, please update the QA matrix and post details for Basic Server Testing, Application Acceptance Testing and 0.10.0-specific testing below in comments to this ticket.
Final release
linux-image
,linux-firmware
, andtor
packages) to apt test - @conorschPost release
develop
- @redshiftzerodevelop
in prep for 0.11.0 release - @redshiftzeroThe text was updated successfully, but these errors were encountered: