Test Plan for UIMA Version 2.2.1

This page documents the planned testing for the 2.2.1 release.

Test Schedule

Testing is planned starting November 20, 2007, for approx. 1 week.

Date(s)

Task

Nov. 21

Code Freeze, bug fixes only

Nov. 22

Start test phase

Dec. 7

End of test, start release vote

Dec. 11

Start vote on general@incubator.a.o

Dec. 20

Target release date

Documentation Review

Check Jira issues for necessary documentation updates: 

Key

Summary

Assignee

Documentation Update?

Status

Res

UIMA-545

DescEditor plugin exception with GNU libgcj 4.1.2

Thilo Goetz

Done

Closed

Fixed

UIMA-583

update documentation for adding PEARs to aggregate AEs

Michael Baessler

Done

Closed

Fixed

UIMA-74

make Eclipse plugins into features that can be installed by Eclipse update mechanism

Marshall

Done

Closed

Fixed

UIMA-574

CAS heap size is just increased by the initial heap size and is not doubled until a threshold is reached

Thilo Goetz

Done

Closed

Fixed

UIMA-589

The AnalysisEngine Descriptor editor disallows certain chars in Sofa names which documentation says are valid

Marshall Schor

Docs were OK, code was fixed

Closed

Fixed

UIMA-301

CAS APIs should make it easier to deal with arrays of unknown element type

Thilo Goetz

In javadocs

Closed

Fixed

UIMA-630

Make TypeSystemUtils.isIdentifier() public so it can be accessed by client code

Thilo Goetz

In javadocs

Closed

Fixed

UIMA-608

Move to Java 1.5

Michael Baessler

Done

Closed

Fixed

UIMA framework tests

Components where we have fixed issues are marked green and have to be tested.

Component

Test case

Description

Tester 

Platform      

Test level name

% complete

Comments

Installation

UIMA_uimaj_Install_001

Installation verification testInstall release package on
a clean machine, check if the
path adjustment works correctly

Michael

Linux
Windows

2.2.1-03

100%
100%

 

Installation

UIMA_uimaj_Install_002

Try migration, following documentation and using tool, with existing components

 

Linux
Windows

 

 

 

Installation

UIMA_uimaj_Install_003

Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms.
Test with different JVM vendors and JVM versions (Java 5 and Java 6)

Thilo

Linux
Windows

2.2.1-03

100%

Tested with various JVMs (1.5 and 1.6, Sun and IBM) on Linux and Windows.  Need to retest on Linux as one test case failed there.
Michael: I retested the source package on Linux

CPM

UIMA_uimaj_CPM_001

Running a CPE with TAE in Local Deployment Mode

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

UIMA_uimaj_CPM_002

Running a CPE with TAE in Remote Deployment Mode 

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

UIMA_uimaj_CPM_003

Runing a CPE with mixed deployment modes

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

UIMA_uimaj_CPM_004

Introduce a TAE that crashes. 
Test CPM error handling options

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Core

UIMA_uimaj_Core_001

UIMA remoting with SOAP
Test UIMA remote analysis engines using the SOAP protocol

Eddie

Linux
Windows

2.2.1-04

0
100%


Core

UIMA_uimaj_Core_002

UIMA remoting with Vinci

Test UIMA remote analysis engines using the Vinci protocol

1) Test the provided Vinci examples from the UIMA SDK on the local machine. (start Vinci server, deploy Vinci service, access Vinci service)

2) Access a deployed Vinci service from a remote maschine.

Eddie

Linux
Windows
MacOSX

2.2.1-04

0
0
100%

 

Core

UIMA_uimaj_Core_003

Run SofA primitive and aggregate analysis engines, run using CPE
with CollectionReader, CasInitializer, CasConsumer.

Test sofa mapping.  Test sofa creation, defaulting, multi-sofa Cas operation. 
Run as simple aggregate, as well as CPE.

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Core

UIMA_uimaj_Core_004

Test CAS multiplier component

Eddie

Linux
Windows

2.2.1-04

0
100%

 

Core

UIMA_uimaj_Core_005

Test UIMA custom flow using the FlowController

Eddie

Linux
Windows 

2.2.1-04

0
100%


Core

UIMA_uimaj_core_006

Test UIMA PEAR runtime

1) install PEARs with the PEAR installer and use the created PEAR descriptor file to run the installed PEAR package (use a PEAR package that needs CLASSPATH and DATAPATH settings; use a PEAR package that use JCAS cover classes)

2) create and aggregate analysis engine descriptor where some of the delegates are PEAR descriptor files from the installed PEAR packages (use PEAR packages where two PEAR files modifies the DocumentAnnotation in different ways using JCAS classes)


  Michael
 

Windows
Linux

2.2.1-03  
 

100%
100%

 

Tooling

UIMA_uimaj_Tooling_001

Test Cas Visual Debugger

Thilo

Windows, Linux

2.2.1-03

30%
0%

I don't think I'll get around to testing more than that.  Since nothing changed in the code it's not critical.

Tooling

UIMA_uimaj_Tooling_002

Test Document Analyzer

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Tooling

UIMA_uimaj_Tooling_003

Test Pear Installer

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Tooling

UIMA_uimaj_Tooling_004

Test Pear Merger

1) Merge two or more PEAR files using the command line PEAR merger tooling. Install and run the merged PEAR file with the PEAR installer. Run the PEAR file using the created PEAR descriptor.

2) Merge two PEAR files where both use JCAS cover classes.

3) Merge two PEAR files where both have different UIMA DATAPATH settings.

4) Merge two PEAR files where one of them has a $main_root variable in the descriptor settings.

Michael

Windows
Linux

2.2.1-03

100%
100%

 

Tooling

UIMA_uimaj_Tooling_005

Test Annotation Viewer

Michael

Windows
Linux

2.2.1-06

80%
80%

Did some basic tests for the main functions. Code doesn't change for 2.2.1 release.
Know issues: UIMA-518 - not fixed for 2.2.1

Tooling

UIMA_uimaj_Tooling_006

Test CPE Configurator

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Tooling

UIMA_uimaj_Tooling_007

Test command line pear packager

Test all three command line packaging modes. Use for the packaging test a component that has classpath, datapath and env var settings.

1) create a complete PEAR package

2) just create the PEAR installation descriptor

3) just package a PEAR file

Michael

Linux
Windows

2.2.1-03

100%
100%

 

EclipsePlugins

UIMA_uimaj_EclipsePlugins_001

Test CDE (Component Descriptor Editor)

Marshall

Eclipse 3.2, 3.3
Linux
Windows

03, 06


50%
80%

Didn't try everything, but all major things seem to work (won't get beyond 80%)

EclipsePlugins

UIMA_uimaj_EclipsePlugins_002

Test JCasGen generation

Marshall

Eclipse 3.3
Linux
Windows

03, 06


80%
100%

 

EclipsePlugins

UIMA_uimaj_EclipsePlugins_003

Test Pear packager

1) Test pear packaging with classpath, datapath and environment variable settings.

Michael

Eclipse 3.3.0
Windows
Linux

2.2.1-04

100%
100%

using the eclipse update site files to install the plugin.

EclipsePlugins

UIMA_uimaj_EclipsePlugins_004

Test UIMA Update Site for Eclipse.
Install into 3.2 and 3.3 versions using update mechanism. Verify dependencies are loaded (install before EMF,
verify EMF is loaded). Try both large and small Eclipse downloads.

Marshall

Eclipse 3.2, 3.3, small/large
Windows
Linux

2.2.1-03



100%
100%

tried on linux and windows, small distr for 3.3.1.1, and large distr for 3.2. Mirroring issue identified, not being fixed for this release.

Examples

UIMA_uimaj_Examples_001

Test provided UIMA examples

 

Linux
Windows

 

 

Adam: will test UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing.






 



Documentation

No special documentation testing/reading for this bugfix release necessary. The important documentation changes are covered by the
JIRA issue documentation review list above.

  • No labels