A sequence of input terminal symbols, terminal symbol placeholders, and terminal symbol classes is such a sequence not put inside ‘[’ … ‘]’ and ‘<’ … ‘>’ and not followed by ‘~’. While processing the sequence, a parser consumes corresponding terminal symbols from a parse unit or training terminal symbol sequence.
Example
(before reading the sequence)
The sequence of input terminal symbols and terminal symbol placeholders in a grammar:
"a" . . . .The remaining part of training terminal symbol sequence:
a b c d e f g h(after reading the sequence)
The read instance of the sequence:
"a" "b" "c" "d" "e"The remaining part of training terminal symbol sequence:
f g h
The adaptive top-down parser atd-parser on passing the option --eos-marker and the adaptive bottom-up parser abu-parser supply the end-of-stream marker $$ as a terminal symbol consumed after the end of a parse unit or training terminal symbol sequence.
Example
(before reading the sequence)
The sequence of input terminal symbols and terminal symbol placeholders in a grammar:
"a" . . . .The remaining part of parse unit:
a aa aaa(after reading the sequence)
The read instance of the sequence:
"a" "aa" "aaa" $$ $$The remaining part of parse unit is empty.