Go to the documentation of this file.
29 #ifndef __ScriptLexer_H_
30 #define __ScriptLexer_H_
Superclass for all objects that wish to use custom memory allocators when their new / delete operator...
ScriptTokenListPtr tokenize(const String &str, const String &source)
Tokenizes the given input and returns the list of tokens found.
String lexeme
This is the lexeme for this token.
SharedPtr< ScriptTokenList > ScriptTokenListPtr
vector< ScriptTokenPtr >::type ScriptTokenList
bool isWhitespace(Ogre::String::value_type c) const
This struct represents a token, which is an ID'd lexeme from the parsing input stream.
bool isNewline(Ogre::String::value_type c) const
SharedPtr< ScriptToken > ScriptTokenPtr
uint32 line
This holds the line number of the input stream where the token was found.
Reference-counted shared pointer, used for objects where implicit destruction is required.
void setToken(const String &lexeme, uint32 line, const String &source, ScriptTokenList *tokens)
uint32 type
This is the id associated with the lexeme, which comes from a lexeme-token id mapping.
Copyright © 2012 Torus Knot Software Ltd

This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.