Test Plan for UIMA Version 2.2

This page documents the planned testing for the 2.2 release.

Test Schedule

Testing is planned starting June 25, 2007, for approx. 2 weeks.

Date(s)	Task
June 25	Code Freeze, bug fixes only
July 9	End of test, start release vote
July 10	Start vote on general@incubator.a.o
July 15	Target release date

Test Focus Areas

Classloader switching
Pear runtime

Documentation Review

Check Jira issues for necessary documentation updates:

Key	Summary	Assignee	Documentation Update?	Status	Res
UIMA-32	CPE GUI doesn't parse ${CPM_HOME} variable	Adam Lally	no updates needed	Closed	Fixed
UIMA-53	Add Flow.aborted() method	Adam Lally	Done	Closed	Fixed
UIMA-194	Tools highlight incorrect annotation offsets due to XML serialization bug in Sun Java 1.4.2	Thilo Goetz	Added "Known Issues" section to overview_and_setup	Closed	Fixed
UIMA-219	Clean up XCASSerializer code to remove what's left of Sofa mapping support	Eddie Epstein	no updates needed	Open	UNRESOLVED
UIMA-238	make docbook build script skip build if output exists and target date is later than dependent source dates (normal "make" behavior)	Marshall Schor	no updates needed	Closed	Fixed
UIMA-258	improve names of the UIMA documentation PDF files	Marshall Schor	won't be fixed in this release	Open	UNRESOLVED
UIMA-269	Test PEAR Files don't run	Michael Baessler	no updates necessary	Closed	Fixed
UIMA-270	When CVD run with -desc option, status bar still says "(No AE Loaded)"	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-271	PEAR Installer doesn't enable "Install" button if PEAR file name is input by keyboard	Adam Lally	no updates needed	Closed	Fixed
UIMA-303	Problems with BoundedQueue.dequeue(timeout)	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-307	Fix CVD screenshots	Thilo Goetz	done	Open	UNRESOLVED
UIMA-309	Change version number to 2.2-SNAPSHOT (post-2.1.0 release)	Adam Lally	no updates needed	Closed	Fixed
UIMA-325	Enhance XMI Serializer to support merging multiple XMI documents into a single CAS	Adam Lally	no updates needed	Resolved	Fixed
UIMA-326	UIMA-72 Add Out-of-typesystem Data Support to XMI Serialization	Adam Lally	no updates needed	Closed	Fixed
UIMA-327	Flow Controller API extensions in support of more complex flow options	Adam Lally	Done	Closed	Fixed
UIMA-328	CDE - handle case of searching for impl Java class, but the project is not a Java project	Marshall Schor	won't be fixed in this release	Open	UNRESOLVED
UIMA-329	extractAndBuild scripts need to check for presence of JAI libraries	Thilo Goetz	no updates needed	Resolved	Fixed
UIMA-330	Calling reconfigure() on aggregate AE doesn't call reconfigure() on FlowController.	Adam Lally	no updates needed	Closed	Fixed
UIMA-331	Provide/extend a built-in flow controller that can be configured to do ParallellStep or to continue after error	Adam Lally	Done	Closed	Fixed
UIMA-336	Schema validation fails for service client descriptors	Adam Lally	no updates needed	Closed	Fixed
UIMA-338	Add method XMLParser.parseFlowControllerDescription	Adam Lally	no updates needed	Closed	Fixed
UIMA-339	Support MBean Name Prefix in the additional parameters map passed to produceAE	Adam Lally	Done	Resolved	Fixed
UIMA-341	Support <import> in CPE Descriptor	Adam Lally	Done	Closed	Fixed
UIMA-342	make jcasgen able to used other templates	Marshall Schor	no updates needed	Closed	Fixed
UIMA-343	UIMA-341 Framework support for import in CPE descriptor	Adam Lally	Done	Closed	Fixed
UIMA-344	UIMA-341 CPE GUI should create <import> elements instead of <include>	Adam Lally	Done	Closed	Fixed
UIMA-345	UIMA-341 Documentation for <import> in CPE Descriptor	Adam Lally	Done	Closed	Fixed
UIMA-347	Custom indexes defined in C++ annotators are ignored	Adam Lally	no updates needed	Closed	Fixed
UIMA-348	CollectionProcessComplete should execute in fixedFlow order if there is a fixedFlow	Adam Lally	Done	Closed	Fixed
UIMA-351	UIMA pear runtime	Michael Baessler	Done	Open	UNRESOLVED
UIMA-352	Allow custom service adapters to be plugged in	Adam Lally	Done	Closed	Fixed
UIMA-353	Expose ResourceManager.setCasManager	Adam Lally	no updates needed	Closed	Fixed
UIMA-354	UIMA datapath support for pear files	Michael Baessler	Done	Closed	Fixed
UIMA-355	Eclipse PDE nature for org.apache.uima.runtime project	Jörn Kottmann	no updates needed	Resolved	Fixed
UIMA-356	fix IBM dependency in CVD log properties file	Michael Baessler	no updates needed	Closed	Fixed
UIMA-358	Add JMX MBeans for CAS Pools	Adam Lally	no updates needed	Closed	Fixed
UIMA-359	Blob serialization problems	Eddie Epstein	no updates needed	Resolved	Fixed
UIMA-362	CVD UIMA about box is editable	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-363	add log level configuration possibility for CVD	Thilo Goetz	done	Closed	Fixed
UIMA-364	CDE add type button and other actions broken	Marshall Schor	no updates needed	Closed	Fixed
UIMA-365	call tae.destroy() in AnalysisEngine_implTest to close open file handles	Michael Baessler	no updates needed	Closed	Fixed
UIMA-366	Rename plugin directories from xxxxx.version to xxxx_version	Adam Lally	should mention in What's New	Closed	Fixed
UIMA-367	Deadlock can occur in MultiprocessingAnalysisEngine_impl.setResultSpecification	Marshall Schor	no updates needed	Closed	Fixed
UIMA-368	Allow setting logger config file and other JVM system properties in scripts/bat files	Adam Lally	Done	Closed	Fixed
UIMA-369	Use same test data as Java project	Eddie Epstein	no updates needed	Resolved	Fixed
UIMA-371	XMI serialization to UIMA C++	Eddie Epstein		Resolved	Fixed
UIMA-372	remove deprecated methods in testcases	Michael Baessler	no updates needed	Closed	Fixed
UIMA-374	CPE GUI left in bad state if you open a CPE descriptor that refers to a nonexistent component descriptor	Adam Lally	no updates needed	Closed	Fixed
UIMA-375	Paragraph on "Eclipse has a steep learning curve..." repeated inside one section	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-376	README refers to outdated GUI label	Adam Lally	no updates needed	Closed	Fixed
UIMA-377	add API to build PEAR packages	Michael Baessler	Done	Closed	Fixed
UIMA-378	CDE plugin: change some private members to protected that derived classes can work with them	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-380	runCPE utility should report initialization time and processing time separately	Adam Lally	no updates needed	Closed	Fixed
UIMA-381	Rename CVD packages to more intuitive name	Thilo Goetz	done	Closed	Fixed
UIMA-383	Duplicate operationalProperties element in example descriptor ex2/RoomNumberAnnotator.xml	Adam Lally	no updates needed	Closed	Fixed
UIMA-385	setUimaClasspath script has extra space at end of set PATH command, making last path entry invalid	Adam Lally	no updates needed	Closed	Fixed
UIMA-386	Switching to use correct class loader	Marshall Schor	Done	Resolved	Fixed
UIMA-387	XMI Serializer can write invalid control characters	Thilo Goetz	done	Reopened	UNRESOLVED
UIMA-388	When CollectionReader wrapped as CAS Multiplier, if a second process call comes in, call reconfigure	Adam Lally	no updates needed (decided on uima-dev)	Closed	Fixed
UIMA-389	AnnotationBase.getSofa() throws ClassCastException	Adam Lally	no updates needed	Closed	Fixed
UIMA-392	Eclipse Plugin packaging not working correctly	Adam Lally	no updates needed	Closed	Fixed
UIMA-393	ibmUimaToApacheUIMA.sh migration script doesn't work	Adam Lally	no updates needed	Closed	Fixed
UIMA-394	sofa2jcasMap not be consistently set	Marshall Schor	no updates needed	Closed	Fixed
UIMA-396	Javadoc for Feature.isMultipleReferencesAllowed is incorrect	Adam Lally	no updates needed	Closed	Fixed
UIMA-397	JSR47Logger_implTest failing with Sun Java 6	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-400	Fix Eclipse plugin	Adam Lally	no updates needed	Closed	Fixed
UIMA-401	Make DocBook build work out of the box in Eclipse	Marshall Schor	Done	Closed	Fixed
UIMA-402	Adding Remote SOAP AE to Aggregate in CDE causes validation error	Marshall Schor	no updates needed	Closed	Fixed
UIMA-404	try to cast NoClassDefFoundError to Exception	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-406	Continue restructuring of CVD code	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-408	Make more CASImpl methods private, have clients use ll APIs.	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-409	Reorganization of TypeSystemImpl, CASImpl, FSClassRegistry, adding new CASMetadata class	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-410	Type priority test case failing with IBM JDK 1.5.0_5ea	Marshall Schor	no updates needed	Closed	Fixed
UIMA-411	PearInstallerTest fails when running from mvn install target - caused by class loading issues in the PEAR verification code	Michael Baessler	no updates needed	Closed	Fixed
UIMA-414	Component Descriptor Editor not marking editor as "changed" if an override is added to an existing parameter having overrides.	Marshall Schor	no updates needed	Closed	Fixed
UIMA-415	Component Descriptor Editor fails when removing parameter override	Marshall Schor	no updates needed	Closed	Fixed
UIMA-416	CVD should be able to read and write XMI documents	Thilo Goetz	done	Closed	Fixed
UIMA-418	add new UIMA analysis example descriptor	Michael Baessler	no updates needed	Closed	Fixed
UIMA-419	Reduce space used for casAddr to JCas object map by a factor of 4 or more	Marshall Schor	no updates needed	Closed	Fixed
UIMA-421	CVD broken after restructuring	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-422	update UIMA DocBook version and Date	Michael Baessler	done	Closed	Fixed
UIMA-424	update UIMA Framework version to 2.2	Adam Lally	no updates needed	Closed	Fixed
UIMA-425	CVD should have close method that doesn't shut down JVM	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-426	Component Descriptor Editor feature to edit parts which require other parts for context is broken - CDE wont start up	Marshall Schor	no updates needed	Closed	Fixed
UIMA-427	CVD throws NPE when descriptor file should be loaded	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-429	Running an AE in CVD resets the document text (making it scroll to the end).	Thilo Goetz	no updates needed	Open	UNRESOLVED
UIMA-435	Update runtime plugin manifest package list for CVD package name change	Adam Lally	no updates needed	Closed	Fixed
UIMA-436	Eclipse Runtime Plugin: add line to permit Fragments to add to API for other tooling	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-437	Annotators are not prevented from calling CAS.release()	Adam Lally	no updates needed	Closed	Fixed
UIMA-439	Docbooks: support scale= in pdfs, convert to 0.93 FOP, fix scaling of many images	Marshall Schor	no updates needed	Resolved	Fixed
UIMA-440	CAS heap doesn't grow correctly when first page exceeded	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-442	FileUtilsTest fail on Linux	Adam Lally	no updates needed	Resolved	Fixed
UIMA-443	fix flow ResultSpec handling	Michael Baessler	no updates needed	Closed	Fixed
UIMA-446	Create FS variables project in sandbox	Thilo Goetz	done	Closed	Fixed
UIMA-449	XMI serialization does not work with Sun Java 1.5.0_12	Adam Lally	no updates needed	Closed	Fixed
UIMA-459	References html file has 0 bytes after clean build	Marshall Schor	no updates needed	Closed	Fixed
UIMA-461	Have docbuild ant script check for JVM version 5 or better	Marshall Schor	no updates needed	Closed	Fixed
UIMA-462	CDE: when saving a remote delegate, where the remote is registered but not running, gets an internal CDE error	Marshall Schor	no updates needed	Closed	Fixed
UIMA-464	ClassCastException thrown when using subiterator and moveTo()	Thilo Goetz	no updates needed	Closed	Fixed
UIMA-465	Need getViewIterator() method to work with a variable number of views	Eddie Epstein		Resolved	Fixed
UIMA-467	TypeSystemUtils.typeSystem2TypeSystemDescription produces invalid output for arrays with elementType specified	Adam Lally	no updates needed	Closed	Fixed
UIMA-468	race condition in JCasImpl initializing static array	Marshall Schor	no updates needed	Closed	Fixed
UIMA-469	not all jars in the lib directory of a PEAR project are added to the PEAR CLASSPATH automatically	Michael Baessler	Done	Closed	Fixed
UIMA-473	Update README and RELEASE_NOTES	Adam Lally	no updates needed	Resolved	Fixed
UIMA-474	Log messages for duplicate resource declarations have their arguments switched	Adam Lally	no updates needed	Closed	Fixed
UIMA-476	FSArray causes error in SOAP service	Thilo Goetz	no updates needed	Resolved	Fixed
UIMA-479	fix test class names that do not end with "Test"	Marshall Schor	no updates needed	Closed	Fixed
UIMA-480	DocumentAnalyzer interactive mode only eligible if an input data directory is specified	Michael Baessler	no updates needed	Closed	Fixed
UIMA-484	Clean build fails on Saxon download (tmp dir does not exist)	Marshall Schor	no updates needed	Closed	Fixed
UIMA-486	CVD error message box cannot be closed with OK button	Thilo Goetz	no updates needed	Open	UNRESOLVED
UIMA-488	CVD doesn't handle Errors that are thrown by an AE	Michael Baessler	no updates needed	Closed	Fixed
UIMA-489	Windows .bat files should use "endlocal" command	Adam Lally	no updates needed	Closed	Cannot Reproduce
UIMA-490	release number in wrong format	Marshall Schor	no updates needed	Closed	Fixed
UIMA-491	CPE GUI doesn't handle spaces in component descriptor file paths	Adam Lally	no updates needed	Closed	Fixed
UIMA-492	uimaj-cpe test failures on some machines when run from maven	Marshall Schor	no updates needed	Closed	Fixed
UIMA-494	AnalysisEngineDescription_impl indirectly uses problematic method URL.equals()	Adam Lally	no updates needed	Closed	Fixed
UIMA-496	PEAR API does not delete the PEAR ID subdirectory before the new content is installed	Michael Baessler	Done	Resolved	Fixed
UIMA-499	Add source jars to binary distribution	Adam Lally	Done	Resolved	Fixed
UIMA-500	Reduce excessive synch lock contention caused by calls to ll_isValidTypeCode that are not needed	Marshall Schor	Done	Closed	Fixed

Documentation:

Marshall printed out all 4 books and gave them a quick read, fixing a few things he found. That may be all the review we need for this release.

Topic	Description	Who	% complete	Comments
conceptual overview
faqs
glossary
eclipse setup

annotator & AE Guide
Artifacts, Sofas
application Guide
Cas Multiplier
CPE
Flow Contorller
Multiple Views
XMI Emf

cde
cpe Gui
CVD
doc analyzer
jcasgen
annotation viewer
pear installer
pear merger
Pear packager

cas
jcas
pear
xmi
javadocs
component Descriptor
CPE Descriptor

Code Testing

UIMA framework tests:

Component	Test case	Description	Tester	Platform	Test level name	% complete	Comments
Installation	UIMA_uimaj_Install_001	Installation verification testInstall release package on a clean machine, check if the path adjustment works correctly	Michael	Linux Windows	uimaj-2.2.0-03	100% 100%
Installation	UIMA_uimaj_Install_002	Try migration, following documentation and using tool, with existing components
Installation	UIMA_uimaj_Install_003	Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms. Test with different JVM vendors and JVM versions (Java 1.4, Java 5 and Java 6)	Michael Michael	Linux Windows	uimaj-2.2.0-02 uimaj-2.2.0-02	100% 100%
CPM	UIMA_uimaj_CPM_001	Running a CPE with TAE in Local Deployment Mode	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
CPM	UIMA_uimaj_CPM_002	Running a CPE with TAE in Remote Deployment Mode	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
CPM	UIMA_uimaj_CPM_003	Runing a CPE with mixed deployment modes	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
CPM	UIMA_uimaj_CPM_004	Introduce a TAE that crashes. Test CPM error handling options	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
Core	UIMA_uimaj_Core_001	UIMA remoting with SOAP Test UIMA remote analysis engines using the SOAP protocol	Marshall	Windows	uimaj-2.2.?	50%	Did a simple deployment of Soap annotator as part of issue 476
Core	UIMA_uimaj_Core_002	UIMA remoting with Vinci Test UIMA remote analysis engines using the Vinci protocol 1) Test the provided Vinci examples from the UIMA SDK on the local machine. (start Vinci server, deploy Vinci service, access Vinci service) 2) Access a deployed Vinci service from a remote maschine.	Michael	Linux Windows	uimaj-2.2.0-03	100% 100%
Core	UIMA_uimaj_Core_003	Run SofA primitive and aggregate analysis engines, run using CPE with CollectionReader, CasInitializer, CasConsumer. Test sofa mapping. Test sofa creation, defaulting, multi-sofa Cas operation. Run as simple aggregate, as well as CPE.	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
Core	UIMA_uimaj_Core_004	Test CAS multiplier component
Core	UIMA_uimaj_Core_005	Test UIMA custom flow using the FlowController	Michael	Windows	uimaj-2.2.0-RC2	100%	Test flow controller examples
Core	UIMA_uimaj_core_006	Test UIMA PEAR runtime 1) install PEARs with the PEAR installer and use the created PEAR descriptor file to run the installed PEAR package (use a PEAR package that needs CLASSPATH and DATAPATH settings; use a PEAR package that use JCAS cover classes) 2) create and aggregate analysis engine descriptor where some of the delegates are PEAR descriptor files from the installed PEAR packages (use PEAR packages where two PEAR files modifies the DocumentAnnotation in different ways using JCAS classes)	Michael Michael	Windows Linux	uimaj-2.2.0-01 uimaj-2.2.0-02	100 % 100%
Tooling	UIMA_uimaj_Tooling_001	Test Cas Visual Debugger	Thilo	Windows, Linux	various	100%
Tooling	UIMA_uimaj_Tooling_002	Test Document Analyzer	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
Tooling	UIMA_uimaj_Tooling_003	Test Pear Installer	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
Tooling	UIMA_uimaj_Tooling_004	Test Pear Merger 1) Merge two or more PEAR files using the command line PEAR merger tooling. Install and run the merged PEAR file with the PEAR installer. Run the PEAR file using the created PEAR descriptor. 2) Merge two PEAR files where both use JCAS cover classes. 3) Merge two PEAR files where both have different UIMA DATAPATH settings. 4) Merge two PEAR files where one of them has a $main_root variable in the descriptor settings.	Michael	Windows Linux	uimaj-2.2.0-02 uimaj-2.2.0-02	100% 100%
Tooling	UIMA_uimaj_Tooling_005	Test Annotation Viewer	Michael	Windows Linux	uimaj-2.2.0-03	100% 90%	on newer linux systems is no mozilla browser installed, only firefox
Tooling	UIMA_uimaj_Tooling_006	Test CPE Configurator	Adam	Linux Windows	uimaj-2.2.0-RC5	100% 100%
Tooling	UIMA_uimaj_Tooling_007	Test command line pear packager Test all three command line packaging modes. Use for the packaging test a component that has classpath, datapath and env var settings. 1) create a complete PEAR package 2) just create the PEAR installation descriptor 3) just package a PEAR file	Michael	Linux Windows	uimaj-2.2.0-03 uimaj-2.2.0-03	100% 100%
EclipsePlugins	UIMA_uimaj_EclipsePlugins_001	Test CDE (Component Descriptor Editor)	Marshall	Eclipse 3.3 Windows	uima-2.2.0-03	100%
EclipsePlugins	UIMA_uimaj_EclipsePlugins_002	Test JCasGen generation	??	Eclipse 3.3 Windows	uima-2.2.0-03	100%	Noticing potential failure of "merging" code if JVM target > 1.4 - need fix in next release. Updated the Docs to say not to use Java 5 syntax if you add custom Java code to JCasGen'd items by hand.
EclipsePlugins	UIMA_uimaj_EclipsePlugins_003	Test Pear packager 1) Test pear packaging with classpath, datapath and environment variable settings.	Michael	Eclipse 3.2.1 Eclipse 3.3.0 Windows Linux	uimaj-2.2.0-03	100%
Examples	UIMA_uimaj_Examples_001	Test provided UIMA examples					Adam: tested UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing, and SofaExampleAnnotator as part of Sofa testing. Michael: tested vinci examples as part of the vinci testing.