The following table is intended to list different test phases and the corresponding frequency, method and coverage with them
Testing Process
Test Phase | Frequency | Method | Coverage |
|---|---|---|---|
BVT (Build Verification Test) | Weekly | Automated | Basic operations in Writer, Calc and Impress |
FVT (Function Verification Test) | AOO 4.1 development phase | Manual | 1. Basic, advanced, complicated operations in Writer, Calc and Impress, including features in 4.1 Proposed Release Contents in AOO 4.1 Release Planning 2. Impact area testing by changes/fixes made |
| Full Pass Regression | AOO 4.1 after Beta release | Manual | 1. Basic, advanced operations in Writer, Calc and Impress, including features in 4.1 Proposed Release Contents in AOO 4.1 Release Planning 2. Impact area testing by changes/fixes made |
| Final Regression | Merged with FPR | Manual | Ditto |
| RC Acceptance Test | AOO 4.1 after RC release | Manual | 1. Basic operations in Writer, Calc and Impress |
PVT | Monthly | Automated | 1. Basic operation like new/load/save/close in Writer, Calc and Impress, to collect the consumed time/memory/handle 2. GUI source code from our subversion repository: https://svn.apache.org/repos/asf/openoffice/trunk/test/ |
AVT | AOO 4.1 development phase | Automate/Manual | Compliance with ACC checklist (IBM software accessibility checklist) |
The following table list the test platforms and the coverage rate in different test phases
Testing Platforms
Platform | Coverage (FVT) | Coverage (FPR, FR and RCAT) | Coverage (PVT) |
|---|---|---|---|
Windows 7 | 25% | 15% | 100% |
Windows 8 | 25% | 15% | |
Redhat Linux 32bit | 10% | 5% | |
Redhat Linux 64bit | 30% | 20% | |
Ubuntu Linux 64bit | 30% | 20% | 100% |
Mac OS X 10.8/10.9 | 30% | 25% | |
Total | 150% | 100% | 100% + |
The following table is intended to collect and document testing to new features, enhancements or other working areas related to the AOO 4.1 release testing
The status can be tracked highlevel for example by using the colors ok/done, in progress and open/missing .
More detailed testing material(test scenarios / steps) can be found in Testlink, defects found during testing can be found in Bugzilla
Testing Contents
| Priority | Item | Feature/Enhancement | Testing way | Volunteer(s) | Status | Comment |
|---|---|---|---|---|---|---|
| 1 | Accessibility support (iAccessibiltiy2 support to improve the usability) | New Feature | Test with ACC checklist based on BVT scenarios Create and execute test cases in Teslink, | Liu Ping Tan | Done | |
Patch Mechanism in Windows | New Feature |
|
|
|
| |
AOO Security Features without Mozilla |
|
|
|
| ||
Icon update | Enhancement | https://cwiki.apache.org/confluence/display/OOOUSERS/AOO4.1+-+Desktop+Icons |
|
|
| |
| 1 | In-place editing of Input Fields | Enhancement | I am working on a solution for issue 33737 [1] and I am making good progress. | Liu Ping Tan | ||
Integrating OOXML enhancement from the OSBA patch | New Feature |
|
|
| ||
1 | use case 4 - comments/annotations on text ranges | Yu Zhen Fan | In Progress | |||
genLang / New translation workflow |
| No test from QA |
|
|
| |
build.pl / central Makefile instead of build.pl |
| No test from QA |
|
|
| |
Mac / 64bit OSX Support |
|
| Volunteers |
| ||
new MacOS Mavericks OS Support |
| Repeat basic functional test |
| Done |
| |
| 1 | Existing functions in 3 Apps (FVT) | Legacy Feature | Execute test cases in Teslink, | In Progress | ||
Create test documents in OOXML format | Enhancement | Create test cases in Testlink Upload test documents to svn | Yu Zhen Fan Liu Ping Tan Jing Long Wu | In Progress | ||
Presentation template validation | Legacy Feature | 1. Import a template to AOO to see if it displays well without any mess 2. Create a new presentation with this template in AOO to see if it works 3. Apply this template to an existing presentation in AOO to see if it work (pay particular attention to the Styles and check how they are applied in the templates, particularly with paragraph, bullets, numbering etc.) | Yu Zhen Fan | In Progress | ||
Develop manual test cases for Base | Enhancement | Create test cases in Testlink | Yu Zhen Fan and Volunteers | In Progress | ||
Get more people who have interest to be familiar with the test automation | N/A | Document test guidance | Liu Ping Tan and Volunteers | In Progress |