Tokenizes the current [[Document Document]] in the background, and caches the tokenized rows for future use.
Document
If a certain row is changed, everything below that row is re-tokenized.
Creates a new BackgroundTokenizer object.
BackgroundTokenizer
The tokenizer to use
Optional
The editor session to associate with
Emits the 'update' event. firstRow and lastRow are used to define the boundaries of the region to be updated.
'update'
firstRow
lastRow
The starting row region
The final row region
Returns the state of tokenization at the end of a row.
The row to get state at
Gives list of [[Token]]'s of the row. (tokens are cached)
The row to get tokens at
Sets pretty long delay to prevent the tokenizer from interfering with the user
Sets a new document to associate with this object.
The new document to associate with
Sets a new tokenizer for this object.
The new tokenizer to use
Starts tokenizing at the row indicated.
The row to start at
Stops tokenizing.
Generated using TypeDoc
Tokenizes the current [[Document
Document]] in the background, and caches the tokenized rows for future use.If a certain row is changed, everything below that row is re-tokenized.