Lexical tokenization is conversion of a raw text into (semantically or syntactically) meaningful lexical tokens, belonging to categories defined by a "lexer" program, such as identifiers, operators, grouping symbols and data types. The resulting tokens are then passed on to some other form of processing. The process can be considered a sub-task of parsing input.