This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Skip to end of metadata
Go to start of metadata

{scrollbar}

65%Contents of this Page2Menu cTAKES 3.0 to Include

Overview of LVG

This annotator wraps the National Library of Medicine (NLM) SPECIALIST lexical tools. It generates a canonical form for words, and this normalization step is helpful for dictionary lookup.* It also generates a list of lemma entries with Penn Treebank tags. These tags could be useful for a part of speech (POS) tagger. However, for the OpenNLP POS tagger, we use a tag dictionary rather than lemma information.

Refer to the documentation for the POS tagger annotator.

 

*Note: LVG adds variants that the dictionary lookup will use in an attempt to discover terms whose form in the text is not present in the dictionary database. e.g., the singular variants of plural forms, capitalization variants, etc. While LVG often increases the number of dictionary terms found in the text, there is, of course, a risk of introducing false positive returns from the dictionary.

Analysis engines (annotator) - LvgAnnotator.xml

Parameters

UseSegments
controls whether only certain sections will be annotated by this annotator

SegmentsToSkip
list of sections not to be processed by this annotator

UseCmdCache
controls whether to look up information in a cache before using norm

CmdCacheFileLocation
location of norm cache file

CmdCacheFrequencyCutoff
(cutoff value)

ExclusionSet
words for which canonicalForm is never set and Lemma entries are never posted

XeroxTreebankMap
mapping of part of speech tags used by LVG to POS tags from lexical tools to Penn Treebank tags

PostLemmas
controls whether any lemma entries are posted to the CAS

UseLemmaCache
controls whether to look up lemma information in a cache before using lvg

LemmaCacheFileLocation
the location of the cache file

LemmaCacheFileFrequencyCutoff
(cutoff value)

Resources

  • lvg.properties - The LVG config file resources/lvg/data/config/lvg.properties defines the location and attributes of the LVG database and the jdbc driver used.
  • LVG database - The database engine used is hsqldb. The database file included is a sample. Refer to the LVG section of the install instructions for details on how to replace the sample.
  • No labels