Uses of Class
opennlp.tools.tokenize.TokenizerFactory
Packages that use TokenizerFactory
-
Uses of TokenizerFactory in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerFactoryModifier and TypeMethodDescriptionstatic TokenizerFactoryTokenizerFactory.create(String subclassName, String languageCode, Dictionary abbreviationDictionary, boolean useAlphaNumericOptimization, Pattern alphaNumericPattern) Factory method the framework uses instantiate a newTokenizerFactory.TokenizerModel.getFactory()Methods in opennlp.tools.tokenize with parameters of type TokenizerFactoryModifier and TypeMethodDescriptionstatic TokenizerModelTokenizerME.train(opennlp.tools.util.ObjectStream<opennlp.tools.tokenize.TokenSample> samples, TokenizerFactory factory, opennlp.tools.util.TrainingParameters mlParams) Trains a model for theTokenizerME.Constructors in opennlp.tools.tokenize with parameters of type TokenizerFactoryModifierConstructorDescriptionTokenizerCrossValidator(opennlp.tools.util.TrainingParameters params, TokenizerFactory factory, opennlp.tools.tokenize.TokenizerEvaluationMonitor... listeners) Creates aTokenizerCrossValidatorusing the givenTokenizerFactory.TokenizerModel(opennlp.tools.ml.model.MaxentModel tokenizerModel, Map<String, String> manifestInfoEntries, TokenizerFactory tokenizerFactory) Initializes aTokenizerModelinstance via aMaxentModeland related resources.