Creates a new BackgroundTokenizer object.
The tokenizer to use
Optionalsession: EditSessionThe editor session to associate with
Emits the 'update' event. firstRow and lastRow are used to define the boundaries of the region to be updated.
The starting row region
The final row region
Returns the state of tokenization at the end of a row.
The row to get state at
Gives list of [[Token]]'s of the row. (tokens are cached)
The row to get tokens at
Sets pretty long delay to prevent the tokenizer from interfering with the user
Sets a new document to associate with this object.
The new document to associate with
Sets a new tokenizer for this object.
The new tokenizer to use
Starts tokenizing at the row indicated.
The row to start at
Stops tokenizing.
Tokenizes the current [[Document
Document]] in the background, and caches the tokenized rows for future use.If a certain row is changed, everything below that row is re-tokenized.