Class TokenInfoDictionary

  • All Implemented Interfaces:
    Dictionary

    public final class TokenInfoDictionary
    extends BinaryDictionary
    Binary dictionary implementation for a known-word dictionary model: Words are encoded into an FST mapping to a list of wordIDs.
    • Constructor Detail

      • TokenInfoDictionary

        @Deprecated(forRemoval=true,
                    since="9.1")
        public TokenInfoDictionary​(BinaryDictionary.ResourceScheme resourceScheme,
                                   String resourcePath)
                            throws IOException
        Deprecated, for removal: This API element is subject to removal in a future version.
        Parameters:
        resourceScheme - - scheme for loading resources (FILE or CLASSPATH).
        resourcePath - - where to load resources (dictionaries) from. If null, with CLASSPATH scheme only, use this class's name as the path.
        Throws:
        IOException
      • TokenInfoDictionary

        public TokenInfoDictionary​(Path targetMapFile,
                                   Path posDictFile,
                                   Path dictFile,
                                   Path fstFile)
                            throws IOException
        Create a TokenInfoDictionary from an external resource path.
        Parameters:
        targetMapFile - where to load target map resource
        posDictFile - where to load POS dictionary resource
        dictFile - where to load dictionary entries resource
        fstFile - where to load encoded FST data resource
        Throws:
        IOException - if resource was not found or broken