Child pages
  • TestPlan2.2.1

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

Component

Test case

Description

Tester 

Platform      

Test level name

% complete

Comments

Installation

Background Color
colorgreen
UIMA_uimaj_Install_001

Installation verification testInstall release package on
a clean machine, check if the
path adjustment works correctly

Michael

Linux
Windows

2.2.1-03

100%
100%

 

Installation

UIMA_uimaj_Install_002

Try migration, following documentation and using tool, with existing components

 

Linux
Windows

 

 

 

Installation

Background Color
colorgreen
UIMA_uimaj_Install_003

Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms.
Test with different JVM vendors and JVM versions (Java 5 and Java 6)

Thilo

Linux
Windows

2.2.1-03

100%

Tested with various JVMs (1.5 and 1.6, Sun and IBM) on Linux and Windows.  Need to retest on Linux as one test case failed there.
Michael: I retested the source package on Linux

CPM

Background Color
colorgreen
UIMA_uimaj_CPM_001

Running a CPE with TAE in Local Deployment Mode

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

Background Color
colorgreen
UIMA_uimaj_CPM_002

Running a CPE with TAE in Remote Deployment Mode 

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

Background Color
colorgreen
UIMA_uimaj_CPM_003

Runing a CPE with mixed deployment modes

Adam

Linux
Windows

2.2.1-06

100%
100%

 

CPM

Background Color
colorgreen
UIMA_uimaj_CPM_004

Introduce a TAE that crashes. 
Test CPM error handling options

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Core

UIMA_uimaj_Core_001

UIMA remoting with SOAP
Test UIMA remote analysis engines using the SOAP protocol

Eddie

Linux
Windows

2.2.1-04

0
100%


Core

UIMA_uimaj_Core_002

UIMA remoting with Vinci

Test UIMA remote analysis engines using the Vinci protocol

1) Test the provided Vinci examples from the UIMA SDK on the local machine. (start Vinci server, deploy Vinci service, access Vinci service)

2) Access a deployed Vinci service from a remote maschine.

Eddie

Linux
Windows
MacOSX

2.2.1-04

0
0
100%

 

Core

Background Color
colorgreen
UIMA_uimaj_Core_003

Run SofA primitive and aggregate analysis engines, run using CPE
with CollectionReader, CasInitializer, CasConsumer.

Test sofa mapping.  Test sofa creation, defaulting, multi-sofa Cas operation. 
Run as simple aggregate, as well as CPE.

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Core

UIMA_uimaj_Core_004

Test CAS multiplier component

Eddie

Linux
Windows

2.2.1-04

0
100%

 

Core

UIMA_uimaj_Core_005

Test UIMA custom flow using the FlowController

Eddie

Linux
Windows 

2.2.1-04

0
100%


Core

UIMA_uimaj_core_006

Test UIMA PEAR runtime

1) install PEARs with the PEAR installer and use the created PEAR descriptor file to run the installed PEAR package (use a PEAR package that needs CLASSPATH and DATAPATH settings; use a PEAR package that use JCAS cover classes)

2) create and aggregate analysis engine descriptor where some of the delegates are PEAR descriptor files from the installed PEAR packages (use PEAR packages where two PEAR files modifies the DocumentAnnotation in different ways using JCAS classes)


  Michael
 

Windows
Linux

2.2.1-03  
 

100%
100%

 

Tooling

Background Color
colorgreen
UIMA_uimaj_Tooling_001

Test Cas Visual Debugger

Thilo

Windows, Linux

2.2.1-03

30%
0%

I don't think I'll get around to testing more than that.  Since nothing changed in the code it's not critical.

Tooling

UIMA_uimaj_Tooling_002

Test Document Analyzer

Thilo
Adam

Linux
Windows

2.2.1-06

0% 100%
100%

 

Tooling

UIMA_uimaj_Tooling_003

Test Pear Installer

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Tooling

UIMA_uimaj_Tooling_004

Test Pear Merger

1) Merge two or more PEAR files using the command line PEAR merger tooling. Install and run the merged PEAR file with the PEAR installer. Run the PEAR file using the created PEAR descriptor.

2) Merge two PEAR files where both use JCAS cover classes.

3) Merge two PEAR files where both have different UIMA DATAPATH settings.

4) Merge two PEAR files where one of them has a $main_root variable in the descriptor settings.

Michael

Windows
Linux

2.2.1-03

100%
100%

 

Tooling

UIMA_uimaj_Tooling_005

Test Annotation Viewer

Michael

Windows
Linux

2.2.1-06

80%
80%

Did some basic tests for the main functions. Code doesn't change for 2.2.1 release.
Know issues: UIMA-518 - not fixed for 2.2.1

Tooling

UIMA_uimaj_Tooling_006

Test CPE Configurator

Adam

Linux
Windows

2.2.1-06

100%
100%

 

Tooling

UIMA_uimaj_Tooling_007

Test command line pear packager

Test all three command line packaging modes. Use for the packaging test a component that has classpath, datapath and env var settings.

1) create a complete PEAR package

2) just create the PEAR installation descriptor

3) just package a PEAR file

Michael

Linux
Windows

2.2.1-03

100%
100%

 

EclipsePlugins

Background Color
colorgreen
UIMA_uimaj_EclipsePlugins_001

Test CDE (Component Descriptor Editor)

Marshall

Eclipse 3.2, 3.3
Linux
Windows

03, 06


50%
80%

Didn't try everything, but all major things seem to work (won't get beyond 80%)

EclipsePlugins

Background Color
colorgreen
UIMA_uimaj_EclipsePlugins_002

Test JCasGen generation

Marshall

Eclipse 3.3
Linux
Windows

03, 06


80%
100%

 

EclipsePlugins

Background Color
colorgreen
UIMA_uimaj_EclipsePlugins_003

Test Pear packager

1) Test pear packaging with classpath, datapath and environment variable settings.

Michael

Eclipse 3.3.0
Windows
Linux

2.2.1-04

100%
100%

using the eclipse update site files to install the plugin.

EclipsePlugins

Background Color
colorgreen
UIMA_uimaj_EclipsePlugins_004

Test UIMA Update Site for Eclipse.
Install into 3.2 and 3.3 versions using update mechanism. Verify dependencies are loaded (install before EMF,
verify EMF is loaded). Try both large and small Eclipse downloads.

Marshall

Eclipse 3.2, 3.3, small/large
Windows
Linux

2.2.1-03



100%
100%

tried on linux and windows, small distr for 3.3.1.1, and large distr for 3.2. Mirroring issue identified, not being fixed for this release.

Examples

UIMA_uimaj_Examples_001

Test provided UIMA examples

 

Linux
Windows

 

 

Adam: will test UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing.






 



...