Class TokenInfoDictionary

  • All Implemented Interfaces:
    Dictionary

    public final class TokenInfoDictionary
    extends BinaryDictionary
    Binary dictionary implementation for a known-word dictionary model: Words are encoded into an FST mapping to a list of wordIDs.
    • Constructor Detail

      • TokenInfoDictionary

        public TokenInfoDictionary​(Path targetMapFile,
                                   Path posDictFile,
                                   Path dictFile,
                                   Path fstFile)
                            throws IOException
        Create a TokenInfoDictionary from an external resource path.
        Parameters:
        targetMapFile - where to load target map resource
        posDictFile - where to load POS dictionary resource
        dictFile - where to load dictionary entries resource
        fstFile - where to load encoded FST data resource
        Throws:
        IOException - if resource was not found or broken