Test Plan for UIMA Version 2.2.1
This page documents the planned testing for the 2.2.1 release.
Test Schedule
Testing is planned starting November 20, 2007, for approx. 1 week.
Date(s) |
Task |
---|---|
Nov. 21 |
Code Freeze, bug fixes only |
Nov. 22 |
Start test phase |
Dec. 7 |
End of test, start release vote |
Dec. 11 |
Start vote on general@incubator.a.o |
Dec. 20 |
Target release date |
Documentation Review
Check Jira issues for necessary documentation updates:
Key |
Summary |
Assignee |
Documentation Update? |
Status |
Res |
UIMA-545 |
DescEditor plugin exception with GNU libgcj 4.1.2 |
Thilo Goetz |
Done |
Closed |
Fixed |
UIMA-583 |
update documentation for adding PEARs to aggregate AEs |
Michael Baessler |
Done |
Closed |
Fixed |
UIMA-74 |
make Eclipse plugins into features that can be installed by Eclipse update mechanism |
Marshall |
Done |
Closed |
Fixed |
UIMA-574 |
CAS heap size is just increased by the initial heap size and is not doubled until a threshold is reached |
Thilo Goetz |
Done |
Closed |
Fixed |
UIMA-589 |
The AnalysisEngine Descriptor editor disallows certain chars in Sofa names which documentation says are valid |
Marshall Schor |
Docs were OK, code was fixed |
Closed |
Fixed |
UIMA-301 |
CAS APIs should make it easier to deal with arrays of unknown element type |
Thilo Goetz |
In javadocs |
Closed |
Fixed |
UIMA-630 |
Make TypeSystemUtils.isIdentifier() public so it can be accessed by client code |
Thilo Goetz |
In javadocs |
Closed |
Fixed |
UIMA-608 |
Move to Java 1.5 |
Michael Baessler |
Done |
Closed |
Fixed |
UIMA framework tests
Components where we have fixed issues are marked green and have to be tested.
Component |
Test case |
Description |
Tester |
Platform |
Test level name |
% complete |
Comments |
---|---|---|---|---|---|---|---|
Installation |
UIMA_uimaj_Install_001 |
Installation verification testInstall release package on |
Michael |
Linux |
2.2.1-03 |
100% |
|
Installation |
UIMA_uimaj_Install_002 |
Try migration, following documentation and using tool, with existing components |
|
Linux |
|
|
|
Installation |
UIMA_uimaj_Install_003 |
Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms. |
Thilo |
Linux |
2.2.1-03 |
100% |
Tested with various JVMs (1.5 and 1.6, Sun and IBM) on Linux and Windows. Need to retest on Linux as one test case failed there. |
CPM |
UIMA_uimaj_CPM_001 |
Running a CPE with TAE in Local Deployment Mode |
Adam |
Linux |
2.2.1-06 |
100% |
|
CPM |
UIMA_uimaj_CPM_002 |
Running a CPE with TAE in Remote Deployment Mode |
Adam |
Linux |
2.2.1-06 |
100% |
|
CPM |
UIMA_uimaj_CPM_003 |
Runing a CPE with mixed deployment modes |
Adam |
Linux |
2.2.1-06 |
100% |
|
CPM |
UIMA_uimaj_CPM_004 |
Introduce a TAE that crashes. |
Adam |
Linux |
2.2.1-06 |
100% |
|
Core |
UIMA_uimaj_Core_001 |
UIMA remoting with SOAP |
Eddie |
Linux |
2.2.1-04 |
0 |
|
Core |
UIMA_uimaj_Core_002 |
UIMA remoting with Vinci |
Eddie |
Linux |
2.2.1-04 |
0 |
|
Core |
UIMA_uimaj_Core_003 |
Run SofA primitive and aggregate analysis engines, run using CPE |
Adam |
Linux |
2.2.1-06 |
100% |
|
Core |
UIMA_uimaj_Core_004 |
Test CAS multiplier component |
Eddie |
Linux |
2.2.1-04 |
0 |
|
Core |
UIMA_uimaj_Core_005 |
Test UIMA custom flow using the FlowController |
Eddie |
Linux |
2.2.1-04 |
0 |
|
Core |
UIMA_uimaj_core_006 |
Test UIMA PEAR runtime |
|
Windows |
2.2.1-03 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_001 |
Test Cas Visual Debugger |
Thilo |
Windows, Linux |
2.2.1-03 |
30% |
I don't think I'll get around to testing more than that. Since nothing changed in the code it's not critical. |
Tooling |
UIMA_uimaj_Tooling_002 |
Test Document Analyzer |
Adam |
Linux |
2.2.1-06 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_003 |
Test Pear Installer |
Adam |
Linux |
2.2.1-06 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_004 |
Test Pear Merger |
Michael |
Windows |
2.2.1-03 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_005 |
Test Annotation Viewer |
Michael |
Windows |
2.2.1-06 |
80% |
Did some basic tests for the main functions. Code doesn't change for 2.2.1 release. |
Tooling |
UIMA_uimaj_Tooling_006 |
Test CPE Configurator |
Adam |
Linux |
2.2.1-06 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_007 |
Test command line pear packager |
Michael |
Linux |
2.2.1-03 |
100% |
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_001 |
Test CDE (Component Descriptor Editor) |
Marshall |
Eclipse 3.2, 3.3 |
03, 06 |
|
Didn't try everything, but all major things seem to work (won't get beyond 80%) |
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_002 |
Test JCasGen generation |
Marshall |
Eclipse 3.3 |
03, 06 |
|
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_003 |
Test Pear packager |
Michael |
Eclipse 3.3.0 |
2.2.1-04 |
100% |
using the eclipse update site files to install the plugin. |
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_004 |
Test UIMA Update Site for Eclipse. |
Marshall |
Eclipse 3.2, 3.3, small/large |
2.2.1-03 |
|
tried on linux and windows, small distr for 3.3.1.1, and large distr for 3.2. Mirroring issue identified, not being fixed for this release. |
Examples |
UIMA_uimaj_Examples_001 |
Test provided UIMA examples |
|
Linux |
|
|
Adam: will test UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing. |
|
|
|
|
|
|
|
|
Documentation
No special documentation testing/reading for this bugfix release necessary. The important documentation changes are covered by the
JIRA issue documentation review list above.