toTokens

Takes script, and separates into tokens (using separateTokens), identifies token types, retuns the Tokens with Token.Type in an array

script is the script to convert to tokens, each line is a separate string, without ending \n errors is the array to which erors will be put

As a plus, it also checks if the brackets are in correct order (and properly closed)

package
toTokens
(
string[] script
,)

Meta