Class Token

java.lang.Object
org.infosmid.stream.dsl.Token
public class Token extends Object
Holder for a kind of token, the associated data and its position in the input data stream (start/end).

  • Field Details

    • kind

      public TokenKind kind
      The kind of token.

    • data

      public String data
      Any extra data for this token instance, e.g. the text for an identifier token.

    • startPos

      public int startPos
      Index of first character.

    • endPos

      public int endPos
      Index of char after the last character.

  • Method Details

    • getKind

      public TokenKind getKind()

    • toString

      public String toString()
      Overrides:
      toString in class Object

    • isIdentifier

      public boolean isIdentifier()

    • stringValue

      public String stringValue()

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • isKind

      public boolean isKind(TokenKind desiredKind)