Package org.biojava.bio.program.tagvalue


package org.biojava.bio.program.tagvalue

Process files as streams of records, each with tags with values.

Overview

Many files in biology are structured as multiple records, each of which can be broken down into lines composed from some tag and an associated value. For example, EMBL files have two letter tags and values extend from column 5 to the end of the line. There are a vast array of files all of which have broadly similar structures, and this package aims to provide a framework within which parsing strategies and data consumers can be reused as much as possible.

The data associated with each record is represented by a stream of events encapsulated by callbacks on the TagValueListener interface. It is up to the user to provide implementations of this interface that build static representations of the data if they so wish.

The Parser and Pushing Sub-Documents

Often file formats have embedded sub-documents. For example, in EMBL format files the feature table area is identical to that in GENBANK files if the first five columns are ignored. In ACeDB files, every time an ace-tag is found, it causes a new sub-document to be induced with its own structure and set of allowed tags and values. Python code uses indent depth to represent code blocks.

Parser allows TagValueListener objects to request that all of the values associated with the current tag should be handled by a new TagValueParser and TagValueListener pair. The Parser instance will use the original TagValueParser to process the line as before, and then take the value that would have been handed to the listener's value method, and present it to the newly registered TagValueParser to tokenize into tag and value portions. That tag and value will then be passed onto the new TagValueListener. The new TagValueListener can itself choose to push a new pair of parser and listener to start a new sub-sub-document. This can be repeated to arbitrary depth. As soon as a parser and listener pair are registered, the pushed listener receives a startRecord() message. Once the entire containing record ends (due to a record separator line such as "//", or because the end of file has been reached), or if the tag that caused the delegation ends, the pushed listener will receive the appropriate endTag() message and also endRecord().

TagDelegator is a useful helper class that always delegates to a given parser and listener pair on a given tag.

Rewriting the Event Stream

Often while parsing, you will need to change tag names or modify values. In the simple case, all the tags and values will be String instances. You will probably want different types, such as the numeric objects (Double, Int and their friends), or to instantiate your own objects from these Strings. Additionaly, some values are themselves better represented as lists of more fundamental items. There are several TagValueListener helper classes that extend TagValueWrapper that allow you to configure a chain of event transducors while writing the minimal amount of code.

TagMapper remaps a sub-set of the tags it sees. For example, it could be configured to replace all "FOO_ID" tags with "accession.number".

ValueChanger intercepts the value() calls for specific tags and uses either a ValueChanger.Changer or ValueChanger.Splitter instance to replace or sub-devide the value before passing it onto another listener.

  • Class
    Description
    An abstract TagValueWrapper that does nothing!
    Joins multipel values into single values.
    Builds an Annotation tree from TagValue events using an AnnotationType to work out which fields are of what type.
     
    A mapping between keys and actions to turn old values into new values.
    An implementation of Changer that applies a list of Changer instances to the value in turn.
    Callback used to produce a new value from an old one.
    Callback used to produce a list of values from a single old one.
    A simple listener that just echoes events back to the console.
    This is intended as a repository for tag-value and AnnotationType information about common file formats.
     
    Listens to tag-value events and passes on indexing events to an IndexStore.
    Listens to tag-value events and passes on indexing events to an IndexStore.
    A parser that splits a line into tag/value at a given column number.
    Partician multiple values for a tag into their own tag groups.
    Encapsulate the parsing of lines from a buffered reader into tag-value events.
    ParserListener is an immutable pairing of a parser and listener.
    Interface for objects that change tag names or properties systematically.
    A ValueChanger.Changer that returns a specific match value using a regex Pattern.
     
    A TagValueParser that splits a line based upon a regular expression.
    A ValueChanger.Splitter that splits a line of text using a regular expression, returning one value per match.
    Helper class to wrap one TagValueListener inside another one.
    This class implements a state machine for parsing events from the Parser class.
    Interface implemented by State listeners that want notification when a transition leaves the State.
    Interface for a State within this StateMachine
    Pushes a new parser and listener, or delegate to a listener depending on the tag.
    Silently drop all tags except those specified, and pass the rest onto a delegate.
    TagMapper maps arbitrary object keys to new keys.
    Rename tags using a TagMapper.
    Utility class for representing tag-value pairs for TagValueParser implementors.
    Communication interface between Parser and a TagValueListener that allows listeners to request that a parser/listener pair be pushed onto the stack to handle the current tag.
    An object that wishes to be informed of events during the parsing of a file.
    Tokenize single records (lines of text, objects) into a tag and a value.
    Interface for TagValueListeners that wrap other TagValueListeners
    Intercept the values associated with some tags and change them systematically.