|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.egothor.core.Filter org.egothor.parser.filter.DupWithoutDiacritics
public final class DupWithoutDiacritics
This filter transforms all (Latin) words to non-diacritical (ASCII), but still keeps the original tokens. ASCII variants of tokens (if any) are placed with reloffset=0 after the original tokens.
Field Summary |
---|
Fields inherited from class org.egothor.core.Filter |
---|
prev |
Constructor Summary | |
---|---|
DupWithoutDiacritics(Sequence<Token> prev)
Constructor for the Diacritics object. |
Method Summary | |
---|---|
Token |
action(Token t)
If the name/type of the token is <WORD> then
transform the text of the token to lower case. |
Token |
next()
Return the next token. |
Methods inherited from class org.egothor.core.Filter |
---|
getPrevTokenizer, setPrevTokenizer |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DupWithoutDiacritics(Sequence<Token> prev)
prev
- this filter's TokenizerMethod Detail |
---|
public Token action(Token t)
<WORD>
then
transform the text of the token to lower case. In other cases the
token remains untouched.
action
in class Filter
t
- the Token
public Token next()
next
in interface Sequence<Token>
next
in class Filter
org.egothor.core.Tokenizer#next()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |