Added by Michael Baessler, last edited by Adam Lally on Dec 07, 2007
()
Test Plan for UIMA Version 2.2.1
This page documents the planned testing for the 2.2.1 release.
Test Schedule
Testing is planned starting November 20, 2007, for approx. 1 week.
| Date(s) | Task |
|---|---|
| Nov. 21 |
Code Freeze, bug fixes only |
| Nov. 22 |
Start test phase |
| Dec. 7 |
End of test, start release vote |
| Dec. 11 |
Start vote on general@incubator.a.o |
| Dec. 20 |
Target release date |
Documentation Review
Check Jira issues for necessary documentation updates:
| Key | Summary | Assignee | Documentation Update? |
Status | Res |
| UIMA-545 | DescEditor plugin exception with GNU libgcj 4.1.2 | Thilo Goetz | Done
|
Closed | Fixed |
| UIMA-583 | update documentation for adding PEARs to aggregate AEs | Michael Baessler | Done
|
Closed | Fixed |
| UIMA-74 | make Eclipse plugins into features that can be installed by Eclipse update mechanism | Marshall | Done
|
Closed | Fixed |
| UIMA-574 | CAS heap size is just increased by the initial heap size and is not doubled until a threshold is reached | Thilo Goetz | Done
|
Closed | Fixed |
| UIMA-589 | The AnalysisEngine Descriptor editor disallows certain chars in Sofa names which documentation says are valid | Marshall Schor | Docs were OK, code was fixed
|
Closed | Fixed |
| UIMA-301 | CAS APIs should make it easier to deal with arrays of unknown element type | Thilo Goetz | In javadocs
|
Closed | Fixed |
| UIMA-630 | Make TypeSystemUtils.isIdentifier() public so it can be accessed by client code | Thilo Goetz | In javadocs
|
Closed | Fixed |
| UIMA-608 | Move to Java 1.5 | Michael Baessler | Done
|
Closed | Fixed |
UIMA framework tests
Components where we have fixed issues are marked green and have to be tested.
| Component |
Test case | Description |
Tester |
Platform |
Test level name | % complete | Comments |
|---|---|---|---|---|---|---|---|
| Installation | UIMA_uimaj_Install_001
|
Installation verification testInstall release package on a clean machine, check if the path adjustment works correctly |
Michael |
Linux Windows |
2.2.1-03 | 100% 100% |
|
| Installation | UIMA_uimaj_Install_002 |
Try migration, following documentation and using tool, with existing components |
Linux Windows |
||||
| Installation | UIMA_uimaj_Install_003
|
Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms. Test with different JVM vendors and JVM versions (Java 5 and Java 6) |
Thilo |
Linux Windows |
2.2.1-03 |
100% | Tested with various JVMs (1.5 and 1.6, Sun and IBM) on Linux and Windows. Need to retest on Linux as one test case failed there. Michael: I retested the source package on Linux |
| CPM |
UIMA_uimaj_CPM_001
|
Running a CPE with TAE in Local Deployment Mode |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| CPM | UIMA_uimaj_CPM_002
|
Running a CPE with TAE in Remote Deployment Mode |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| CPM | UIMA_uimaj_CPM_003
|
Runing a CPE with mixed deployment modes | Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| CPM | UIMA_uimaj_CPM_004
|
Introduce a TAE that crashes. Test CPM error handling options |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| Core | UIMA_uimaj_Core_001 |
UIMA remoting with SOAP Test UIMA remote analysis engines using the SOAP protocol |
Eddie |
Linux Windows |
2.2.1-04 |
0 100% |
|
| Core | UIMA_uimaj_Core_002 |
UIMA remoting with Vinci Test UIMA remote analysis engines using the Vinci protocol 1) Test the provided Vinci examples from the UIMA SDK on the local machine. (start Vinci server, deploy Vinci service, access Vinci service) 2) Access a deployed Vinci service from a remote maschine. |
Eddie |
Linux Windows MacOSX |
2.2.1-04 |
0 0 100% |
|
| Core | UIMA_uimaj_Core_003
|
Run SofA primitive and aggregate analysis engines, run using CPE with CollectionReader, CasInitializer, CasConsumer. Test sofa mapping. Test sofa creation, defaulting, multi-sofa Cas operation. Run as simple aggregate, as well as CPE. |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| Core | UIMA_uimaj_Core_004 |
Test CAS multiplier component |
Eddie |
Linux Windows |
2.2.1-04 |
0 100% |
|
| Core | UIMA_uimaj_Core_005 |
Test UIMA custom flow using the FlowController |
Eddie |
Linux Windows |
2.2.1-04 |
0 100% |
|
| Core | UIMA_uimaj_core_006 | Test UIMA PEAR runtime 1) install PEARs with the PEAR installer and use the created PEAR descriptor file to run the installed PEAR package (use a PEAR package that needs CLASSPATH and DATAPATH settings; use a PEAR package that use JCAS cover classes) 2) create and aggregate analysis engine descriptor where some of the delegates are PEAR descriptor files from the installed PEAR packages (use PEAR packages where two PEAR files modifies the DocumentAnnotation in different ways using JCAS classes) |
Michael |
Windows Linux |
2.2.1-03 |
100% 100% |
|
| Tooling | UIMA_uimaj_Tooling_001
|
Test Cas Visual Debugger | Thilo |
Windows, Linux |
2.2.1-03 |
30% 0% |
I don't think I'll get around to testing more than that. Since nothing changed in the code it's not critical. |
| Tooling | UIMA_uimaj_Tooling_002 |
Test Document Analyzer |
Adam | Linux Windows |
2.2.1-06 |
100% 100% |
|
| Tooling | UIMA_uimaj_Tooling_003 |
Test Pear Installer |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| Tooling | UIMA_uimaj_Tooling_004 |
Test Pear Merger 1) Merge two or more PEAR files using the command line PEAR merger tooling. Install and run the merged PEAR file with the PEAR installer. Run the PEAR file using the created PEAR descriptor. 2) Merge two PEAR files where both use JCAS cover classes. 3) Merge two PEAR files where both have different UIMA DATAPATH settings. 4) Merge two PEAR files where one of them has a $main_root variable in the descriptor settings. |
Michael |
Windows Linux |
2.2.1-03 | 100% 100% |
|
| Tooling | UIMA_uimaj_Tooling_005 |
Test Annotation Viewer |
Michael |
Windows Linux |
2.2.1-06 |
80% 80% |
Did some basic tests for the main functions. Code doesn't change for 2.2.1 release. Know issues: UIMA-518 - not fixed for 2.2.1 |
| Tooling | UIMA_uimaj_Tooling_006 |
Test CPE Configurator |
Adam |
Linux Windows |
2.2.1-06 |
100% 100% |
|
| Tooling | UIMA_uimaj_Tooling_007 |
Test command line pear packager Test all three command line packaging modes. Use for the packaging test a component that has classpath, datapath and env var settings. 1) create a complete PEAR package 2) just create the PEAR installation descriptor 3) just package a PEAR file |
Michael |
Linux Windows |
2.2.1-03 | 100% 100% |
|
| EclipsePlugins | UIMA_uimaj_EclipsePlugins_001
|
Test CDE (Component Descriptor Editor) |
Marshall | Eclipse 3.2, 3.3 Linux Windows |
03, 06 | 50% 80% |
Didn't try everything, but all major things seem to work (won't get beyond 80%) |
| EclipsePlugins | UIMA_uimaj_EclipsePlugins_002
|
Test JCasGen generation | Marshall | Eclipse 3.3 Linux Windows |
03, 06 | 80% 100% |
|
| EclipsePlugins | UIMA_uimaj_EclipsePlugins_003
|
Test Pear packager 1) Test pear packaging with classpath, datapath and environment variable settings. |
Michael |
Eclipse 3.3.0 Windows Linux |
2.2.1-04 | 100% 100% |
using the eclipse update site files to install the plugin. |
| EclipsePlugins | UIMA_uimaj_EclipsePlugins_004
|
Test UIMA Update Site for Eclipse. Install into 3.2 and 3.3 versions using update mechanism. Verify dependencies are loaded (install before EMF, verify EMF is loaded). Try both large and small Eclipse downloads. |
Marshall | Eclipse 3.2, 3.3, small/large Windows Linux |
2.2.1-03 | 100% 100% |
tried on linux and windows, small distr for 3.3.1.1, and large distr for 3.2. Mirroring issue identified, not being fixed for this release. |
| Examples |
UIMA_uimaj_Examples_001 |
Test provided UIMA examples |
Linux Windows |
Adam: will test UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing. |
|||
| |
|
|
|
|
|
|
Documentation
No special documentation testing/reading for this bugfix release necessary. The important documentation changes are covered by the
JIRA issue documentation review list above.