Next: , Previous: , Up: Earlemes   [Contents]


4.1.7 Variable length tokens

Our next loosening of the restrictions is to allow variable length tokens. That is, instead of requiring that all tokens be of length 1, we allow tokens to be of length 1 or longer. This does change the behavior of the earleme variables.

Suppose, in the variable length token model that, for a call to marpa_r_alternative(), the following is true:

In that case, after the call to marpa_r_alternative(), the following will be true:

Suppose, in the variable length token model that, for a call to marpa_r_earleme_complete(), the following is true:

In that case, after the call to marpa_r_earleme_complete(), the following will be true: