Parses provided content according to provided highlighting rules and return tokens.
Tokens either have the className set according to Ace themes or have no className if they are just pure text tokens.
Result is a list of list of tokens, where each line from the provided content is a separate list of tokens.
Parameters
content: string
to tokenize
highlightRules: HighlightRules
defining the language grammar
Returns TokenizeResult
tokenization result containing a list of token for each of the lines from content
Parses provided content according to provided highlighting rules and return tokens. Tokens either have the className set according to Ace themes or have no className if they are just pure text tokens. Result is a list of list of tokens, where each line from the provided content is a separate list of tokens.