Test Plan for UIMA Version 2.2

This page documents the planned testing for the 2.2 release.

Test Schedule

Testing is planned starting June 25, 2007, for approx. 2 weeks.

Date(s)

Task

June 25

Code Freeze, bug fixes only

July 9

End of test, start release vote

July 10

Start vote on general@incubator.a.o

July 15

Target release date

Test Focus Areas

  • Classloader switching
  • Pear runtime

Documentation Review

Check Jira issues for necessary documentation updates: 

Key

Summary

Assignee

Documentation Update?

Status

Res

UIMA-32

CPE GUI doesn't parse ${CPM_HOME} variable

Adam Lally

no updates needed

Closed

Fixed

UIMA-53

Add Flow.aborted() method

Adam Lally

Done

Closed

Fixed

UIMA-194

Tools highlight incorrect annotation offsets due to XML serialization bug in Sun Java 1.4.2

Thilo Goetz

Added "Known Issues" section to overview_and_setup

Closed

Fixed

UIMA-219

Clean up XCASSerializer code to remove what's left of Sofa mapping support

Eddie Epstein

no updates needed

Open

UNRESOLVED

UIMA-238

make docbook build script skip build if output exists and target date is later than dependent source dates (normal "make" behavior)

Marshall Schor

no updates needed

Closed

Fixed

UIMA-258

improve names of the UIMA documentation PDF files

Marshall Schor

won't be fixed in this release

Open

UNRESOLVED

UIMA-269

Test PEAR Files don't run

Michael Baessler

no updates necessary

Closed

Fixed

UIMA-270

When CVD run with -desc option, status bar still says "(No AE Loaded)"

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-271

PEAR Installer doesn't enable "Install" button if PEAR file name is input by keyboard

Adam Lally

no updates needed

Closed

Fixed

UIMA-303

Problems with BoundedQueue.dequeue(timeout)

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-307

Fix CVD screenshots

Thilo Goetz

done

Open

UNRESOLVED

UIMA-309

Change version number to 2.2-SNAPSHOT (post-2.1.0 release)

Adam Lally

no updates needed

Closed

Fixed

UIMA-325

Enhance XMI Serializer to support merging multiple XMI documents into a single CAS

Adam Lally

no updates needed

Resolved

Fixed

UIMA-326

UIMA-72
Add Out-of-typesystem Data Support to XMI Serialization

Adam Lally

no updates needed

Closed

Fixed

UIMA-327

Flow Controller API extensions in support of more complex flow options

Adam Lally

Done

Closed

Fixed

UIMA-328

CDE - handle case of searching for impl Java class, but the project is not a Java project

Marshall Schor

won't be fixed in this release

Open

UNRESOLVED

UIMA-329

extractAndBuild scripts need to check for presence of JAI libraries

Thilo Goetz

no updates needed

Resolved

Fixed

UIMA-330

Calling reconfigure() on aggregate AE doesn't call reconfigure() on FlowController.

Adam Lally

no updates needed

Closed

Fixed

UIMA-331

Provide/extend a built-in flow controller that can be configured to do ParallellStep or to continue after error

Adam Lally

Done

Closed

Fixed

UIMA-336

Schema validation fails for service client descriptors

Adam Lally

no updates needed

Closed

Fixed

UIMA-338

Add method XMLParser.parseFlowControllerDescription

Adam Lally

no updates needed

Closed

Fixed

UIMA-339

Support MBean Name Prefix in the additional parameters map passed to produceAE

Adam Lally

Done

Resolved

Fixed

UIMA-341

Support <import> in CPE Descriptor

Adam Lally

Done

Closed

Fixed

UIMA-342

make jcasgen able to used other templates

Marshall Schor

no updates needed

Closed

Fixed

UIMA-343

UIMA-341
Framework support for import in CPE descriptor

Adam Lally

Done

Closed

Fixed

UIMA-344

UIMA-341
CPE GUI should create <import> elements instead of <include>

Adam Lally

Done

Closed

Fixed

UIMA-345

UIMA-341
Documentation for <import> in CPE Descriptor

Adam Lally

Done

Closed

Fixed

UIMA-347

Custom indexes defined in C++ annotators are ignored

Adam Lally

no updates needed

Closed

Fixed

UIMA-348

CollectionProcessComplete should execute in fixedFlow order if there is a fixedFlow

Adam Lally

Done

Closed

Fixed

UIMA-351

UIMA pear runtime

Michael Baessler

Done

Open

UNRESOLVED

UIMA-352

Allow custom service adapters to be plugged in

Adam Lally

Done

Closed

Fixed

UIMA-353

Expose ResourceManager.setCasManager

Adam Lally

no updates needed

Closed

Fixed

UIMA-354

UIMA datapath support for pear files

Michael Baessler

Done

Closed

Fixed

UIMA-355

Eclipse PDE nature for org.apache.uima.runtime project

Jörn Kottmann

no updates needed

Resolved

Fixed

UIMA-356

fix IBM dependency in CVD log properties file

Michael Baessler

no updates needed

Closed

Fixed

UIMA-358

Add JMX MBeans for CAS Pools

Adam Lally

no updates needed

Closed

Fixed

UIMA-359

Blob serialization problems

Eddie Epstein

no updates needed

Resolved

Fixed

UIMA-362

CVD UIMA about box is editable

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-363

add log level configuration possibility for CVD

Thilo Goetz

done

Closed

Fixed

UIMA-364

CDE add type button and other actions broken

Marshall Schor

no updates needed

Closed

Fixed

UIMA-365

call tae.destroy() in AnalysisEngine_implTest to close open file handles

Michael Baessler

no updates needed

Closed

Fixed

UIMA-366

Rename plugin directories from xxxxx.version to xxxx_version

Adam Lally

should mention in What's New

Closed

Fixed

UIMA-367

Deadlock can occur in MultiprocessingAnalysisEngine_impl.setResultSpecification

Marshall Schor

no updates needed

Closed

Fixed

UIMA-368

Allow setting logger config file and other JVM system properties in scripts/bat files

Adam Lally

Done

Closed

Fixed

UIMA-369

Use same test data as Java project

Eddie Epstein

no updates needed

Resolved

Fixed

UIMA-371

XMI serialization to UIMA C++

Eddie Epstein

 

Resolved

Fixed

UIMA-372

remove deprecated methods in testcases

Michael Baessler

no updates needed

Closed

Fixed

UIMA-374

CPE GUI left in bad state if you open a CPE descriptor that refers to a nonexistent component descriptor

Adam Lally

no updates needed

Closed

Fixed

UIMA-375

Paragraph on "Eclipse has a steep learning curve..." repeated inside one section

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-376

README refers to outdated GUI label

Adam Lally

no updates needed

Closed

Fixed

UIMA-377

add API to build PEAR packages

Michael Baessler

Done

Closed

Fixed

UIMA-378

CDE plugin: change some private members to protected that derived classes can work with them

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-380

runCPE utility should report initialization time and processing time separately

Adam Lally

no updates needed

Closed

Fixed

UIMA-381

Rename CVD packages to more intuitive name

Thilo Goetz

done

Closed

Fixed

UIMA-383

Duplicate operationalProperties element in example descriptor ex2/RoomNumberAnnotator.xml

Adam Lally

no updates needed

Closed

Fixed

UIMA-385

setUimaClasspath script has extra space at end of set PATH command, making last path entry invalid

Adam Lally

no updates needed

Closed

Fixed

UIMA-386

Switching to use correct class loader

Marshall Schor

Done

Resolved

Fixed

UIMA-387

XMI Serializer can write invalid control characters

Thilo Goetz

done

Reopened

UNRESOLVED

UIMA-388

When CollectionReader wrapped as CAS Multiplier, if a second process call comes in, call reconfigure

Adam Lally

no updates needed

(decided on uima-dev)

Closed

Fixed

UIMA-389

AnnotationBase.getSofa() throws ClassCastException

Adam Lally

no updates needed

Closed

Fixed

UIMA-392

Eclipse Plugin packaging not working correctly

Adam Lally

no updates needed

Closed

Fixed

UIMA-393

ibmUimaToApacheUIMA.sh migration script doesn't work

Adam Lally

no updates needed

Closed

Fixed

UIMA-394

sofa2jcasMap not be consistently set

Marshall Schor

no updates needed

Closed

Fixed

UIMA-396

Javadoc for Feature.isMultipleReferencesAllowed is incorrect

Adam Lally

no updates needed

Closed

Fixed

UIMA-397

JSR47Logger_implTest failing with Sun Java 6

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-400

Fix Eclipse plugin

Adam Lally

no updates needed

Closed

Fixed

UIMA-401

Make DocBook build work out of the box in Eclipse

Marshall Schor

Done

Closed

Fixed

UIMA-402

Adding Remote SOAP AE to Aggregate in CDE causes validation error

Marshall Schor

no updates needed

Closed

Fixed

UIMA-404

try to cast NoClassDefFoundError to Exception

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-406

Continue restructuring of CVD code

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-408

Make more CASImpl methods private, have clients use ll APIs.

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-409

Reorganization of TypeSystemImpl, CASImpl, FSClassRegistry, adding new CASMetadata class

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-410

Type priority test case failing with IBM JDK 1.5.0_5ea

Marshall Schor

no updates needed

Closed

Fixed

UIMA-411

PearInstallerTest fails when running from mvn install target - caused by class loading issues in the PEAR verification code

Michael Baessler

no updates needed

Closed

Fixed

UIMA-414

Component Descriptor Editor not marking editor as "changed" if an override is added to an existing parameter having overrides.

Marshall Schor

no updates needed

Closed

Fixed

UIMA-415

Component Descriptor Editor fails when removing parameter override

Marshall Schor

no updates needed

Closed

Fixed

UIMA-416

CVD should be able to read and write XMI documents

Thilo Goetz

done

Closed

Fixed

UIMA-418

add new UIMA analysis example descriptor

Michael Baessler

no updates needed

Closed

Fixed

UIMA-419

Reduce space used for casAddr to JCas object map by a factor of 4 or more

Marshall Schor

no updates needed

Closed

Fixed

UIMA-421

CVD broken after restructuring

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-422

update UIMA DocBook version and Date

Michael Baessler

done

Closed

Fixed

UIMA-424

update UIMA Framework version to 2.2

Adam Lally

no updates needed

Closed

Fixed

UIMA-425

CVD should have close method that doesn't shut down JVM

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-426

Component Descriptor Editor feature to edit parts which require other parts for context is broken - CDE wont start up

Marshall Schor

no updates needed

Closed

Fixed

UIMA-427

CVD throws NPE when descriptor file should be loaded

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-429

Running an AE in CVD resets the document text (making it scroll to the end).

Thilo Goetz

no updates needed

Open

UNRESOLVED

UIMA-435

Update runtime plugin manifest package list for CVD package name change

Adam Lally

no updates needed

Closed

Fixed

UIMA-436

Eclipse Runtime Plugin: add line to permit Fragments to add to API for other tooling

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-437

Annotators are not prevented from calling CAS.release()

Adam Lally

no updates needed

Closed

Fixed

UIMA-439

Docbooks: support scale= in pdfs, convert to 0.93 FOP, fix scaling of many images

Marshall Schor

no updates needed

Resolved

Fixed

UIMA-440

CAS heap doesn't grow correctly when first page exceeded

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-442

FileUtilsTest fail on Linux

Adam Lally

no updates needed

Resolved

Fixed

UIMA-443

fix flow ResultSpec handling

Michael Baessler

no updates needed

Closed

Fixed

UIMA-446

Create FS variables project in sandbox

Thilo Goetz

done

Closed

Fixed

UIMA-449

XMI serialization does not work with Sun Java 1.5.0_12

Adam Lally

no updates needed

Closed

Fixed

UIMA-459

References html file has 0 bytes after clean build

Marshall Schor

no updates needed

Closed

Fixed

UIMA-461

Have docbuild ant script check for JVM version 5 or better

Marshall Schor

no updates needed

Closed

Fixed

UIMA-462

CDE: when saving a remote delegate, where the remote is registered but not running, gets an internal CDE error

Marshall Schor

no updates needed

Closed

Fixed

UIMA-464

ClassCastException thrown when using subiterator and moveTo()

Thilo Goetz

no updates needed

Closed

Fixed

UIMA-465

Need getViewIterator() method to work with a variable number of views

Eddie Epstein

 

Resolved

Fixed

UIMA-467

TypeSystemUtils.typeSystem2TypeSystemDescription produces invalid output for arrays with elementType specified

Adam Lally

no updates needed

Closed

Fixed

UIMA-468

race condition in JCasImpl initializing static array

Marshall Schor

no updates needed

Closed

Fixed

UIMA-469

not all jars in the lib directory of a PEAR project are added to the PEAR CLASSPATH automatically

Michael Baessler

Done

Closed

Fixed

UIMA-473

Update README and RELEASE_NOTES

Adam Lally

no updates needed

Resolved

Fixed

UIMA-474

Log messages for duplicate resource declarations have their arguments switched

Adam Lally

no updates needed

Closed

Fixed

UIMA-476

FSArray causes error in SOAP service

Thilo Goetz

no updates needed

Resolved

Fixed

UIMA-479

fix test class names that do not end with "Test"

Marshall Schor

no updates needed

Closed

Fixed

UIMA-480

DocumentAnalyzer interactive mode only eligible if an input data directory is specified

Michael Baessler

no updates needed

Closed

Fixed

UIMA-484

Clean build fails on Saxon download (tmp dir does not exist)

Marshall Schor

no updates needed

Closed

Fixed

UIMA-486

CVD error message box cannot be closed with OK button

Thilo Goetz

no updates needed

Open

UNRESOLVED

UIMA-488

CVD doesn't handle Errors that are thrown by an AE

Michael Baessler

no updates needed

Closed

Fixed

UIMA-489

Windows .bat files should use "endlocal" command

Adam Lally

no updates needed

Closed

Cannot Reproduce

UIMA-490

release number in wrong format

Marshall Schor

no updates needed

Closed

Fixed

UIMA-491

CPE GUI doesn't handle spaces in component descriptor file paths

Adam Lally

no updates needed

Closed

Fixed

UIMA-492

uimaj-cpe test failures on some machines when run from maven

Marshall Schor

no updates needed

Closed

Fixed

UIMA-494

AnalysisEngineDescription_impl indirectly uses problematic method URL.equals()

Adam Lally

no updates needed

Closed

Fixed

UIMA-496

PEAR API does not delete the PEAR ID subdirectory before the new content is installed

Michael Baessler

Done

Resolved

Fixed

UIMA-499

Add source jars to binary distribution

Adam Lally

Done

Resolved

Fixed

UIMA-500

Reduce excessive synch lock contention caused by calls to ll_isValidTypeCode that are not needed

Marshall Schor

Done

Closed

Fixed

Documentation:

Marshall printed out all 4 books and gave them a quick read, fixing a few things he found. That may be all the review we need for this release.

Topic

Description

Who

% complete

Comments

conceptual overview

 


 

 

faqs

 


 

 

glossary

 


 

 

eclipse setup

 


 

 

 

 


 

 

annotator & AE Guide

 




Artifacts, Sofas

 


 

 

application Guide

 



 

Cas Multiplier

 


 

 

CPE

 



 

Flow Contorller

 


 

 

Multiple Views

 


 

 

XMI Emf

 


 

 

 

 

 

 

 

cde

 


 

 

cpe Gui

 


 

 

CVD

 


 

 

doc analyzer

 


 

 

jcasgen

 


 

 

annotation viewer

 


 

 

pear installer

 


 

 

pear merger

 


 

 

Pear packager

 


 

 

 

 


 

 

cas



 

 

jcas

 


 

 

pear

 


 

 

xmi

 


 

 

javadocs

 


 

 

component Descriptor

 


 

 

CPE Descriptor

 


 

 

Code Testing

 UIMA framework tests:

Component

Test case

Description

Tester 

Platform      

Test level name

% complete

Comments

Installation

UIMA_uimaj_Install_001

Installation verification testInstall release package on
a clean machine, check if the
path adjustment works correctly

Michael

Linux
Windows

uimaj-2.2.0-03

100%
100%

 

Installation

UIMA_uimaj_Install_002

Try migration, following documentation and using tool, with existing components

 

 

 

 

 

Installation

UIMA_uimaj_Install_003

Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms.
Test with different JVM vendors and JVM versions (Java 1.4, Java 5 and Java 6)

Michael

Michael

Linux

Windows

uimaj-2.2.0-02
 
uimaj-2.2.0-02

100%
 
100%

 

CPM

UIMA_uimaj_CPM_001

Running a CPE with TAE in Local Deployment Mode

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

CPM

UIMA_uimaj_CPM_002

Running a CPE with TAE in Remote Deployment Mode 

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

CPM

UIMA_uimaj_CPM_003

Runing a CPE with mixed deployment modes

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

CPM

UIMA_uimaj_CPM_004

Introduce a TAE that crashes. 
Test CPM error handling options

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

Core

UIMA_uimaj_Core_001

UIMA remoting with SOAP
Test UIMA remote analysis engines using the SOAP protocol

Marshall

Windows

uimaj-2.2.?

50%

Did a simple deployment of Soap annotator as part of issue 476

Core

UIMA_uimaj_Core_002

UIMA remoting with Vinci

Test UIMA remote analysis engines using the Vinci protocol

1) Test the provided Vinci examples from the UIMA SDK on the local machine. (start Vinci server, deploy Vinci service, access Vinci service)

2) Access a deployed Vinci service from a remote maschine.

Michael

Linux
Windows

uimaj-2.2.0-03

100%
100%

 

Core

UIMA_uimaj_Core_003

Run SofA primitive and aggregate analysis engines, run using CPE
with CollectionReader, CasInitializer, CasConsumer.

Test sofa mapping.  Test sofa creation, defaulting, multi-sofa Cas operation. 
Run as simple aggregate, as well as CPE.

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

Core

UIMA_uimaj_Core_004

Test CAS multiplier component

 

 

 

 

 

Core

UIMA_uimaj_Core_005

Test UIMA custom flow using the FlowController

Michael

Windows

uimaj-2.2.0-RC2

100%

Test flow controller examples

Core

UIMA_uimaj_core_006

Test UIMA PEAR runtime

1) install PEARs with the PEAR installer and use the created PEAR descriptor file to run the installed PEAR package (use a PEAR package that needs CLASSPATH and DATAPATH settings; use a PEAR package that use JCAS cover classes)

2) create and aggregate analysis engine descriptor where some of the delegates are PEAR descriptor files from the installed PEAR packages (use PEAR packages where two PEAR files modifies the DocumentAnnotation in different ways using JCAS classes)

Michael
 
 
Michael

Windows


Linux

uimaj-2.2.0-01
 
 
uimaj-2.2.0-02

100 %
 
 
100%

 

Tooling

UIMA_uimaj_Tooling_001

Test Cas Visual Debugger

Thilo

Windows, Linux

various

100%

 

Tooling

UIMA_uimaj_Tooling_002

Test Document Analyzer

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

Tooling

UIMA_uimaj_Tooling_003

Test Pear Installer

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

Tooling

UIMA_uimaj_Tooling_004

Test Pear Merger

1) Merge two or more PEAR files using the command line PEAR merger tooling. Install and run the merged PEAR file with the PEAR installer. Run the PEAR file using the created PEAR descriptor.

2) Merge two PEAR files where both use JCAS cover classes.

3) Merge two PEAR files where both have different UIMA DATAPATH settings.

4) Merge two PEAR files where one of them has a $main_root variable in the descriptor settings.

Michael

Windows
Linux

uimaj-2.2.0-02
uimaj-2.2.0-02

100%
100%

 

Tooling

UIMA_uimaj_Tooling_005

Test Annotation Viewer

Michael

Windows
Linux

uimaj-2.2.0-03

100%
90%

on newer linux systems is no mozilla browser installed, only firefox

Tooling

UIMA_uimaj_Tooling_006

Test CPE Configurator

Adam

Linux
Windows

uimaj-2.2.0-RC5

100%
100%

 

Tooling

UIMA_uimaj_Tooling_007

Test command line pear packager

Test all three command line packaging modes. Use for the packaging test a component that has classpath, datapath and env var settings.

1) create a complete PEAR package

2) just create the PEAR installation descriptor

3) just package a PEAR file

Michael

Linux
Windows

uimaj-2.2.0-03
uimaj-2.2.0-03

100%
100%

 

EclipsePlugins

UIMA_uimaj_EclipsePlugins_001

Test CDE (Component Descriptor Editor)

Marshall

Eclipse 3.3
Windows

uima-2.2.0-03

100%

 

EclipsePlugins

UIMA_uimaj_EclipsePlugins_002

Test JCasGen generation

??

Eclipse 3.3
Windows

uima-2.2.0-03

100%

Noticing potential failure of "merging" code if JVM target > 1.4 - need fix in next release. Updated the Docs to say not to use Java 5 syntax if you add custom Java code to JCasGen'd items by hand.

EclipsePlugins

UIMA_uimaj_EclipsePlugins_003

Test Pear packager

1) Test pear packaging with classpath, datapath and environment variable settings.

Michael

Eclipse 3.2.1
Eclipse 3.3.0
Windows
Linux

uimaj-2.2.0-03

100%

 

Examples

UIMA_uimaj_Examples_001

Test provided UIMA examples

 

 

 

 

Adam: tested UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing.
Michael: tested vinci examples as part of the vinci testing.






 



  • No labels