|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use it.unipi.di.tokenizer | |
---|---|
it.unipi.di.textdb | |
it.unipi.di.tokenizer |
Classes in it.unipi.di.tokenizer used by it.unipi.di.textdb | |
---|---|
Tokenizer
Basic methods to implement for a brand-new Tokenizer . |
Classes in it.unipi.di.tokenizer used by it.unipi.di.tokenizer | |
---|---|
TermTokenizer
Splits a text into a list of tokens, '\n' is added. |
|
Tokenizer
Basic methods to implement for a brand-new Tokenizer . |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |