Versions Compared

Old Version 11

changes.mady.by.user James Joseph Masanz

Saved on

compared with

New Version 12

changes.mady.by.user James Joseph Masanz

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

Wiki Markup
{scrollbar}

Section
Column
width65%

Overview of Constituency Parser

This parser is a wrapper around the OpenNLP parser. Since this component relies on other components as input (sentence and tokenizaton mainly), it contains configuration files that point at those components. These use relative path names for portability, but do require that the project be extracted at the same level as the other cTAKES components. For example, if your directory structure is:

Code Block
ctakes/core
ctakes/clinical documents pipeline
ctakes/...

you want it to look like the following after extracting this component:

Pre

ctakes/Constituency Parser

Once placed there, the component can be imported to Eclipse using File > Import > Existing projects into workspace...

Column
Include Page
Menu cTAKES 4.0 to Include
Menu cTAKES 4.0 to Include

 The constituency parser component includes a few different UIMA analysis engines (AEs) for different use cases:

  • AggregateParsingProcessor is mostly for testing and validation. You can run this in the UIMA Cas
    Visual Debugger (CVD) by running the CVD launch configuration (in
    resources/launch/UIMA_CVD-Constituency Parser.launch (right-click on the file in the package explorer >run as... > UIMA_CVD-Constituency Parser.launch

Once the CVD window opens, load the AE with Run->Load AE..., and navigatd to:

Constituency Parser/desc/analysis_engines/AggregateParsingProcessor.xml

Load some text either by manually entering it or with File > Open text file..., then Run > Run AE.

  • ConstituencyParserAnnotator.xml is a standalone annotator that is meant to be incorporated into cTAKES pipelines (for example, upstream from the coreference component)

Both of the above AEs assume some pre-processing as input, namely Sentence and Token segmentation. They also obviously depend on the quality of those components for quality output. With some notes the sentence segmenter does not reliably work and the parser will perform poorly (UPMC notes are known to cause trouble).

  • ParserEvaluatorAnnotator.xml is used mainly internally for evaluating the parser but may be useful for anyone else interested in parser research. It is used as part of the collection processing engine ParsingCPE.xml, which reads a line at a time from a file, where each line contains whitespace-separated tokens of a single sentence.

Parser models: This release contains two different models. The default is located in resources/parsermodel, and will be used if no configuration settings are changed. It is trained on a combination of domain-specific and general domain text. Domain specific text includes clinical notes, medpedia articles, cohort queries, clinical questions. General domain text is the Wall Street Journal section of the Penn Treebank.

The second model is in resources/fastmodel. This model is trained only on the in-domain data. As a result, our preliminary (unpublished) experiments showed it to be a little less accurate and a little faster.